Wheelodex » Projects » instructlab-eval

instructlab-eval

View on PyPI — Reverse Dependencies (1)

0.4.1 instructlab_eval-0.4.1-py3-none-any.whl
0.4.0 instructlab_eval-0.4.0-py3-none-any.whl

Wheel Details

Project: instructlab-eval
Version: 0.4.0
Filename: instructlab_eval-0.4.0-py3-none-any.whl
Download: [link]
Size: 66291
MD5: 90e0f716ab1cc625ef528681d05b2241
SHA256: 0b59e432d1598a189dc6d0325869a95224540f07961a921f4f90286c39665a8c
Uploaded: 2024-11-12 23:46:16 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: instructlab-eval
Version: 0.4.0
Summary: Evaluation
Author-Email: InstructLab <dev[at]instructlab.ai>
Project-Url: homepage, https://instructlab.ai
Project-Url: source, https://github.com/instructlab/eval
Project-Url: issues, https://github.com/instructlab/eval/issues
License: Apache-2.0
Classifier: Development Status :: 3 - Alpha
Classifier: Environment :: Console
Classifier: License :: OSI Approved :: Apache Software License
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: MacOS :: MacOS X
Classifier: Operating System :: POSIX :: Linux
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: Implementation :: CPython
Requires-Python: >=3.9
Requires-Dist: GitPython (<4.0.0,>=3.1.42)
Requires-Dist: shortuuid
Requires-Dist: openai (<2.0.0,>=1.13.3)
Requires-Dist: psutil
Requires-Dist: torch
Requires-Dist: transformers
Requires-Dist: accelerate
Requires-Dist: pandas
Requires-Dist: pandas-stubs
Requires-Dist: lm-eval (>=0.4.4)
Requires-Dist: httpx
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 10279 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.4.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
instructlab/eval/__init__.py sha256=u13xz1cK_nEH_Y5Ox328JDswGR_YI6_G9hit6NC5GZc 117
instructlab/eval/_version.py sha256=j90u3VVU4UrJf1fgMUhaZarHK_Do2XGYXr-vZvOFzVo 411
instructlab/eval/evaluator.py sha256=yUTZ8cV2H4p5Y-TKTUfjoDPUwHHxs-IUzLaf4vb-nHE 166
instructlab/eval/exceptions.py sha256=wuOM363Fssj8KSXDueOWYJ6ZYoJO0mRIIUZiXkB0KqM 4148
instructlab/eval/logger_config.py sha256=64ZUP8x6WMde_Nn-p0zW7gXSCud8njE-sX9Hy_4tqdA 169
instructlab/eval/mmlu.py sha256=khYrWSypoFt3UqqteDIXiFGu4NtnByW-9vbifL0dtfc 9205
instructlab/eval/mt_bench.py sha256=35Xqw1AlRYJvjz4v7unn1ecLktvLn_tcCGxUlQtt8N0 11409
instructlab/eval/mt_bench_answers.py sha256=h6yvkOwRfi3-WtZ4iN67bey5vlzhpo55WVBmPqtptWw 4562
instructlab/eval/mt_bench_branch_generator.py sha256=s4DTXjb8nZ_9T_Mad78jxm0JroXnU2ET6YFIFzjnp8Q 5050
instructlab/eval/mt_bench_common.py sha256=uumcb2bNR6hs32hI6OWrQyFJ3Pn8sUxF0ND8RL_GKCY 11029
instructlab/eval/mt_bench_conversation.py sha256=HAfAZut8B5YHxlFjt_mtaoZiQP_5aEIsD65s9GF10YM 7086
instructlab/eval/mt_bench_judgment.py sha256=jgeiHvK9Ctp3nSplmiRkbJVhFvL5zsCrGOc0-rnhLvU 9545
instructlab/eval/mt_bench_model_adapter.py sha256=3DWntMilwk3Cntvr99IJlLdYdIeuh3Vgu7U2VYg805Q 4769
instructlab/eval/data/mt_bench/judge_prompts.jsonl sha256=_Sgyk0BtAk9EwXSwlO9IAx0Gh6RoL9OlaymxOPgCgbY 10449
instructlab/eval/data/mt_bench/question.jsonl sha256=EZVlrbq4IicInO_bRMjX4s8E3AoOwjNjTILn1OKpRPc 48929
instructlab/eval/data/mt_bench/reference_answer/gpt-4.jsonl sha256=-VelvJd7rbZoheyXDmzQhSeEV4AxPwmVdkJg5Xd7mz8 51109
instructlab/eval/data/mt_bench_branch/judge_prompts.jsonl sha256=kM5hdF2Cw9qUDKRxTTgsyxwepztOljFW2TGK8mSg9ag 10633
instructlab_eval-0.4.0.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
instructlab_eval-0.4.0.dist-info/METADATA sha256=3kaEz3GNpfBy8rJERc9nyft9PQ-phDsVNE0K0y3KRgA 12173
instructlab_eval-0.4.0.dist-info/WHEEL sha256=a7TGlA-5DaHMRrarXjVbQagU3Man_dCnGIWMJr5kRWo 91
instructlab_eval-0.4.0.dist-info/entry_points.txt sha256=WBfxBAcDy_VmuCXpFVx3TeQBMIt8yeT5MMCBRYPfnU0 249
instructlab_eval-0.4.0.dist-info/top_level.txt sha256=0r2RZ4_KkuJG7G0dJBV-sWHaBsBxGXUifCCY9-jyRN4 12
instructlab_eval-0.4.0.dist-info/RECORD — —

top_level.txt

instructlab

entry_points.txt

[instructlab.eval.evaluator]
mmlu = instructlab.eval.mmlu:MMLUEvaluator
mmlu_branch = instructlab.eval.mmlu:MMLUBranchEvaluator
mt_bench = instructlab.eval.mt_bench:MTBenchEvaluator
mt_bench_branch = instructlab.eval.mt_bench:MTBenchBranchEvaluator