lm-pub-quiz

View on PyPIReverse Dependencies (0)

0.2.1 lm_pub_quiz-0.2.1-py3-none-any.whl

Wheel Details

Project: lm-pub-quiz
Version: 0.2.1
Filename: lm_pub_quiz-0.2.1-py3-none-any.whl
Download: [link]
Size: 38070
MD5: ccbf0925b948910edb790f41ea3917fc
SHA256: b56f7403d7a10149859e4e94dc4ea551ea85ab8ccf17347b74e43cf15f771ab4
Uploaded: 2024-08-02 17:13:21 +0000

dist-info

METADATA

Metadata-Version: 2.3
Name: lm-pub-quiz
Version: 0.2.1
Summary: Evaluate language models using multiple choice items
Author-Email: Jacek Wiland <jacek.wiland[at]hu-berlin.de>, Max Ploner <max.ploner[at]hu-berlin.de>, Alan Akbik <alan.akbik[at]hu-berlin.de>
Classifier: Development Status :: 4 - Beta
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Python: >=3.8
Requires-Dist: accelerate (>0.25.0)
Requires-Dist: cordage
Requires-Dist: datasets
Requires-Dist: hydra-core
Requires-Dist: minicons (>0.2.22)
Requires-Dist: pandas
Requires-Dist: scikit-learn
Requires-Dist: seaborn
Requires-Dist: torch
Requires-Dist: transformers (>=4.38)
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 2769 characters]

WHEEL

Wheel-Version: 1.0
Generator: hatchling 1.22.5
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
lm_pub_quiz/__about__.py sha256=HfjVOrpTnmZ-xVFCYSVmX50EXaBQeJteUHG-PD6iQs8 22
lm_pub_quiz/__init__.py sha256=uNtZchV2gH7wN-RysTAvq93631hPraHDqLT0f6WaCyE 318
lm_pub_quiz/evaluator.py sha256=7hEPQhxsFL5_2dplkKVc6RoDZkzVwL3hx4YAXAVsl6o 24347
lm_pub_quiz/templating.py sha256=TByIJR1xGCYJNmtJibqTgSzTVtW5xY4A9urvl2M7-oc 5259
lm_pub_quiz/tyq_evaluator.py sha256=vS9OPxmKhjpQ7uPdb6NGIIMzbCIxGQCaypXo51Jtt-Y 4584
lm_pub_quiz/util.py sha256=hZnrvDl-rDC6xPzRK955ovLQgf1P2NTB3muRO2YL1_U 1111
lm_pub_quiz/cli/__init__.py sha256=3Lj9aafjnEkZM7DY-_WclE4oVO9A-bBSziblMTOPC-8 279
lm_pub_quiz/cli/config.py sha256=zaaWaE81m6K2hErPxz8oHQTLrklX5kH35xfDJpL3Dfc 1005
lm_pub_quiz/cli/evaluate_model.py sha256=uj9drfi0rTrYYg0t3-zP-4APIAty-9vYxfJHNHthy1E 2580
lm_pub_quiz/cli/rank_answers.py sha256=iJ9uau6cAkPNYOnvLpljIPUCH4-3WRKCUUK8xXp3S-g 924
lm_pub_quiz/cli/score_sentence.py sha256=vWoZMWHykIP89dCv2dRx9IKHZniw20BeseyZLBjggWM 1579
lm_pub_quiz/data/__init__.py sha256=syl7g1sIthUsSuLveBFAKSdXoxbIFtsbT0v4oyzgggM 296
lm_pub_quiz/data/base.py sha256=kpfqCXWokPcIjhtz8tznMZFn8nrZDp6JE2eKOHdlBmk 18597
lm_pub_quiz/data/dataset.py sha256=ElpsWNLZANz-p-jnMhn1M7kzPUpfaGc1Y-R_RS4JYa0 14365
lm_pub_quiz/data/results.py sha256=CmfBvqd3DrXM6NXg5umTXLKrKMuTX2_kdqdWppW80ZY 22628
lm_pub_quiz/data/util.py sha256=3ImZ6bR0yc91DhFecxVvIx1jLUV8_5U9C2e57eKAhq4 2247
lm_pub_quiz/integrations/__init__.py sha256=NS1N0BrOwhK3SqU6fWRTyNvR_MWce6C_kONMD0sF2zc 105
lm_pub_quiz/integrations/transformers_trainer.py sha256=hRh1XkM3zVd5OvHM9YMOzScH2cx_1sgGJDwMkFXUZFU 2763
lm_pub_quiz/metrics/__init__.py sha256=cOO6DLUOZIEI4PB4Oj6OK4SmCV5xYVeDm6uun3z44VI 466
lm_pub_quiz/metrics/base.py sha256=Zc0jz1C0A1dcvBFqF3qG77yqEEaxLq4BYNQuGvpqq9I 1581
lm_pub_quiz/metrics/basic.py sha256=n242tQz2Dh0vG5PCcunzIEelfE8x_x4Jeq17io6Awr8 2242
lm_pub_quiz/metrics/confidence.py sha256=r_WCr8hYsdCujhHjr7aTSpZg6Sfgg120vlVUO-I5-zk 6196
lm_pub_quiz/metrics/util.py sha256=ln-8Z6GATuWNWo6Nv9QEPm4xWVdEChSlhgc-iyOGbs4 226
lm_pub_quiz-0.2.1.dist-info/METADATA sha256=P49nMQZAZRRF_59nlbdBsYgVz8LWLnTRxOprpF1pN4o 3754
lm_pub_quiz-0.2.1.dist-info/WHEEL sha256=as-1oFTWSeWBgyzh0O_qF439xqBe6AbBgt4MfYe5zwY 87
lm_pub_quiz-0.2.1.dist-info/entry_points.txt sha256=U4HoSRRsMFJszsvMIoBPufLu_vU_sJ2sLRgAmrA5fcY 170
lm_pub_quiz-0.2.1.dist-info/licenses/LICENSE sha256=qRd-uZrN0OcBtaOv1oinFGvT7UA4H_3jW278tDO9qKc 1095
lm_pub_quiz-0.2.1.dist-info/RECORD

entry_points.txt

evaluate_model = lm_pub_quiz.cli:evaluate_model_cli
rank_answers = lm_pub_quiz.cli:rank_answers_cli
score_sentence = lm_pub_quiz.cli:score_sentence_cli