Wheelodex » Projects » instructlab-eval » instructlab_eval-0.4.1-py3-none-any.whl

instructlab-eval

View on PyPI — Reverse Dependencies (1)

0.4.1 instructlab_eval-0.4.1-py3-none-any.whl
0.4.0 instructlab_eval-0.4.0-py3-none-any.whl

Wheel Details

Project: instructlab-eval
Version: 0.4.1
Filename: instructlab_eval-0.4.1-py3-none-any.whl
Download: [link]
Size: 66420
MD5: 144dd3639b7c62a03a95bd5cb48f9e9a
SHA256: 6f56e08213beab00f34c83dbdb3c30560ccf4e59008bc99205e80526b5c3cf0a
Uploaded: 2024-11-14 22:20:54 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: instructlab-eval
Version: 0.4.1
Summary: Evaluation
Author-Email: InstructLab <dev[at]instructlab.ai>
Project-Url: homepage, https://instructlab.ai
Project-Url: source, https://github.com/instructlab/eval
Project-Url: issues, https://github.com/instructlab/eval/issues
License: Apache-2.0
Classifier: Development Status :: 3 - Alpha
Classifier: Environment :: Console
Classifier: License :: OSI Approved :: Apache Software License
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: MacOS :: MacOS X
Classifier: Operating System :: POSIX :: Linux
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: Implementation :: CPython
Requires-Python: >=3.9
Requires-Dist: GitPython (<4.0.0,>=3.1.42)
Requires-Dist: shortuuid
Requires-Dist: openai (<2.0.0,>=1.13.3)
Requires-Dist: psutil
Requires-Dist: torch
Requires-Dist: transformers
Requires-Dist: accelerate
Requires-Dist: pandas
Requires-Dist: pandas-stubs
Requires-Dist: lm-eval (>=0.4.4)
Requires-Dist: httpx
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 10279 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.5.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
instructlab/eval/__init__.py sha256=u13xz1cK_nEH_Y5Ox328JDswGR_YI6_G9hit6NC5GZc 117
instructlab/eval/_version.py sha256=H6xAc33bJwmO0oYU-O7_wWInmGAifNGi6CO6khT0G1g 411
instructlab/eval/evaluator.py sha256=yUTZ8cV2H4p5Y-TKTUfjoDPUwHHxs-IUzLaf4vb-nHE 166
instructlab/eval/exceptions.py sha256=x1UTLBtOFhk0AZvOe5CLHVeIxtbv7JADvs80RgzLpgs 4426
instructlab/eval/logger_config.py sha256=64ZUP8x6WMde_Nn-p0zW7gXSCud8njE-sX9Hy_4tqdA 169
instructlab/eval/mmlu.py sha256=khYrWSypoFt3UqqteDIXiFGu4NtnByW-9vbifL0dtfc 9205
instructlab/eval/mt_bench.py sha256=35Xqw1AlRYJvjz4v7unn1ecLktvLn_tcCGxUlQtt8N0 11409
instructlab/eval/mt_bench_answers.py sha256=h6yvkOwRfi3-WtZ4iN67bey5vlzhpo55WVBmPqtptWw 4562
instructlab/eval/mt_bench_branch_generator.py sha256=s4DTXjb8nZ_9T_Mad78jxm0JroXnU2ET6YFIFzjnp8Q 5050
instructlab/eval/mt_bench_common.py sha256=uumcb2bNR6hs32hI6OWrQyFJ3Pn8sUxF0ND8RL_GKCY 11029
instructlab/eval/mt_bench_conversation.py sha256=HAfAZut8B5YHxlFjt_mtaoZiQP_5aEIsD65s9GF10YM 7086
instructlab/eval/mt_bench_judgment.py sha256=7AWxsR9KBNsethGDKErnSr-f5i4KggmsA8hGfTH8P58 9778
instructlab/eval/mt_bench_model_adapter.py sha256=3DWntMilwk3Cntvr99IJlLdYdIeuh3Vgu7U2VYg805Q 4769
instructlab/eval/data/mt_bench/judge_prompts.jsonl sha256=_Sgyk0BtAk9EwXSwlO9IAx0Gh6RoL9OlaymxOPgCgbY 10449
instructlab/eval/data/mt_bench/question.jsonl sha256=EZVlrbq4IicInO_bRMjX4s8E3AoOwjNjTILn1OKpRPc 48929
instructlab/eval/data/mt_bench/reference_answer/gpt-4.jsonl sha256=-VelvJd7rbZoheyXDmzQhSeEV4AxPwmVdkJg5Xd7mz8 51109
instructlab/eval/data/mt_bench_branch/judge_prompts.jsonl sha256=kM5hdF2Cw9qUDKRxTTgsyxwepztOljFW2TGK8mSg9ag 10633
instructlab_eval-0.4.1.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
instructlab_eval-0.4.1.dist-info/METADATA sha256=K8E-YXMqGR_Q9MeRsnxXGkpXB41_zbbTv4poWqMY4Qs 12173
instructlab_eval-0.4.1.dist-info/WHEEL sha256=R06PA3UVYHThwHvxuRWMqaGcr-PuniXahwjmQRFMEkY 91
instructlab_eval-0.4.1.dist-info/entry_points.txt sha256=WBfxBAcDy_VmuCXpFVx3TeQBMIt8yeT5MMCBRYPfnU0 249
instructlab_eval-0.4.1.dist-info/top_level.txt sha256=0r2RZ4_KkuJG7G0dJBV-sWHaBsBxGXUifCCY9-jyRN4 12
instructlab_eval-0.4.1.dist-info/RECORD — —

top_level.txt

instructlab

entry_points.txt

[instructlab.eval.evaluator]
mmlu = instructlab.eval.mmlu:MMLUEvaluator
mmlu_branch = instructlab.eval.mmlu:MMLUBranchEvaluator
mt_bench = instructlab.eval.mt_bench:MTBenchEvaluator
mt_bench_branch = instructlab.eval.mt_bench:MTBenchBranchEvaluator