Wheelodex » Projects » instructlab-eval

instructlab-eval

View on PyPI — Reverse Dependencies (1)

0.5.1 instructlab_eval-0.5.1-py3-none-any.whl

Wheel Details

Project: instructlab-eval
Version: 0.5.1
Filename: instructlab_eval-0.5.1-py3-none-any.whl
Download: [link]
Size: 70889
MD5: fdfcd2cc17314a9e0ac31903b4cdc677
SHA256: 2b1cc72063a60250f2b2ff991bc539a8857a2425a89bbd215e7b9fb9e934968d
Uploaded: 2025-01-21 16:25:30 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.2
Name: instructlab-eval
Version: 0.5.1
Summary: Evaluation
Author-Email: InstructLab <dev[at]instructlab.ai>
Project-Url: homepage, https://instructlab.ai
Project-Url: source, https://github.com/instructlab/eval
Project-Url: issues, https://github.com/instructlab/eval/issues
License: Apache-2.0
Classifier: Development Status :: 3 - Alpha
Classifier: Environment :: Console
Classifier: License :: OSI Approved :: Apache Software License
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: MacOS :: MacOS X
Classifier: Operating System :: POSIX :: Linux
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: Implementation :: CPython
Requires-Python: >=3.9
Requires-Dist: GitPython (<4.0.0,>=3.1.42)
Requires-Dist: shortuuid
Requires-Dist: openai (<2.0.0,>=1.13.3)
Requires-Dist: psutil
Requires-Dist: torch
Requires-Dist: transformers
Requires-Dist: accelerate
Requires-Dist: pandas
Requires-Dist: pandas-stubs
Requires-Dist: lm-eval (>=0.4.4)
Requires-Dist: httpx
Requires-Dist: ragas (>=0.2.11)
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 10279 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.8.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
instructlab/eval/__init__.py sha256=u13xz1cK_nEH_Y5Ox328JDswGR_YI6_G9hit6NC5GZc 117
instructlab/eval/_version.py sha256=8W5N0WKS0YIWUpfry5TouisDYjsMUIZ7Vc0crGGGQQU 411
instructlab/eval/evaluator.py sha256=yUTZ8cV2H4p5Y-TKTUfjoDPUwHHxs-IUzLaf4vb-nHE 166
instructlab/eval/exceptions.py sha256=x1UTLBtOFhk0AZvOe5CLHVeIxtbv7JADvs80RgzLpgs 4426
instructlab/eval/logger_config.py sha256=64ZUP8x6WMde_Nn-p0zW7gXSCud8njE-sX9Hy_4tqdA 169
instructlab/eval/mmlu.py sha256=i2xjq38HsyVVXyvOAZzmCS9ZtoHKI1s0HBD3W1d-_V0 10901
instructlab/eval/mt_bench.py sha256=35Xqw1AlRYJvjz4v7unn1ecLktvLn_tcCGxUlQtt8N0 11409
instructlab/eval/mt_bench_answers.py sha256=O_T3Wt8z8fMuhaNhumU2xAoATY9YsOGy39MiYQLsnkE 4603
instructlab/eval/mt_bench_branch_generator.py sha256=s4DTXjb8nZ_9T_Mad78jxm0JroXnU2ET6YFIFzjnp8Q 5050
instructlab/eval/mt_bench_common.py sha256=uumcb2bNR6hs32hI6OWrQyFJ3Pn8sUxF0ND8RL_GKCY 11029
instructlab/eval/mt_bench_conversation.py sha256=HAfAZut8B5YHxlFjt_mtaoZiQP_5aEIsD65s9GF10YM 7086
instructlab/eval/mt_bench_judgment.py sha256=7AWxsR9KBNsethGDKErnSr-f5i4KggmsA8hGfTH8P58 9778
instructlab/eval/mt_bench_model_adapter.py sha256=3DWntMilwk3Cntvr99IJlLdYdIeuh3Vgu7U2VYg805Q 4769
instructlab/eval/ragas.py sha256=xC8HBaB34UBE7yRHhzY_lGz2PWWHXNGEl4VQTaEsAfI 11503
instructlab/eval/data/mt_bench/judge_prompts.jsonl sha256=_Sgyk0BtAk9EwXSwlO9IAx0Gh6RoL9OlaymxOPgCgbY 10449
instructlab/eval/data/mt_bench/question.jsonl sha256=EZVlrbq4IicInO_bRMjX4s8E3AoOwjNjTILn1OKpRPc 48929
instructlab/eval/data/mt_bench/reference_answer/gpt-4.jsonl sha256=-VelvJd7rbZoheyXDmzQhSeEV4AxPwmVdkJg5Xd7mz8 51109
instructlab/eval/data/mt_bench_branch/judge_prompts.jsonl sha256=kM5hdF2Cw9qUDKRxTTgsyxwepztOljFW2TGK8mSg9ag 10633
instructlab_eval-0.5.1.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
instructlab_eval-0.5.1.dist-info/METADATA sha256=qCyqLNW3-Xrrw-sas4eLSeHGWdF08DuPRdAf0rKK7gw 12199
instructlab_eval-0.5.1.dist-info/WHEEL sha256=In9FTNxeP60KnTkGw7wk6mJPYd_dQSjEZmXdBdMCI-8 91
instructlab_eval-0.5.1.dist-info/entry_points.txt sha256=WBfxBAcDy_VmuCXpFVx3TeQBMIt8yeT5MMCBRYPfnU0 249
instructlab_eval-0.5.1.dist-info/top_level.txt sha256=0r2RZ4_KkuJG7G0dJBV-sWHaBsBxGXUifCCY9-jyRN4 12
instructlab_eval-0.5.1.dist-info/RECORD — —

top_level.txt

instructlab

entry_points.txt

[instructlab.eval.evaluator]
mmlu = instructlab.eval.mmlu:MMLUEvaluator
mmlu_branch = instructlab.eval.mmlu:MMLUBranchEvaluator
mt_bench = instructlab.eval.mt_bench:MTBenchEvaluator
mt_bench_branch = instructlab.eval.mt_bench:MTBenchBranchEvaluator