Wheelodex » Projects » indic-eval

indic-eval

View on PyPI — Reverse Dependencies (1)

0.1.0 indic_eval-0.1.0-py3-none-any.whl

Wheel Details

Project: indic-eval
Version: 0.1.0
Filename: indic_eval-0.1.0-py3-none-any.whl
Download: [link]
Size: 229577
MD5: 9dc380a66858b36c1d2bb940a2c5ed59
SHA256: 13e39bcb67efde4ca3295575620aa75b2749d642ed06b714d1f83558bdec9bb9
Uploaded: 2024-06-01 07:07:20 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: indic-eval
Version: 0.1.0
Summary: A package to make LLM evaluation easier
Author-Email: Adithya S Kolavi <adithyaskolavi[at]gmail.com>
Maintainer-Email: Adithya S Kolavi <adithyaskolavi[at]gmail.com>
Project-Url: Homepage, https://github.com/adithya-s-k/indic_eval
Project-Url: Issues, https://github.com/adithya-s-k/indic_eval/issues
License: MIT License
Keywords: evaluation,nlp,llm
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.10
Requires-Dist: art (==6.1)
Requires-Dist: requests
Requires-Dist: transformers (>=4.38.0)
Requires-Dist: huggingface-hub (>=0.22.0)
Requires-Dist: torch (>=2.0)
Requires-Dist: GitPython (>=3.1.41)
Requires-Dist: datasets (>=2.14.0)
Requires-Dist: termcolor (==2.3.0)
Requires-Dist: pytablewriter
Requires-Dist: colorama
Requires-Dist: aenum (==3.1.15)
Requires-Dist: nltk (==3.8.1)
Requires-Dist: scikit-learn
Requires-Dist: spacy (==3.7.2)
Requires-Dist: sacrebleu
Requires-Dist: rouge-score (==0.1.2)
Requires-Dist: sentencepiece (>=0.1.99)
Requires-Dist: protobuf (==3.20.*)
Requires-Dist: pycountry
Requires-Dist: accelerate; extra == "accelerate"
Requires-Dist: peft (==0.3.0); extra == "adapters"
Requires-Dist: indic-eval[accelerate,quality,tests]; extra == "dev"
Requires-Dist: langdetect; extra == "extended-tasks"
Requires-Dist: nanotron; extra == "nanotron"
Requires-Dist: tensorboardX; extra == "nanotron"
Requires-Dist: optimum (==1.12.0); extra == "optimum"
Requires-Dist: ruff (==v0.2.2); extra == "quality"
Requires-Dist: pre-commit; extra == "quality"
Requires-Dist: bitsandbytes (>=0.41.0); extra == "quantization"
Requires-Dist: auto-gptq (>=0.4.2); extra == "quantization"
Requires-Dist: pytest (==7.4.0); extra == "tests"
Requires-Dist: text-generation (==0.6.0); extra == "tgi"
Provides-Extra: accelerate
Provides-Extra: adapters
Provides-Extra: dev
Provides-Extra: extended_tasks
Provides-Extra: nanotron
Provides-Extra: optimum
Provides-Extra: quality
Provides-Extra: quantization
Provides-Extra: tests
Provides-Extra: tgi
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 34159 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
indic_eval/__init__.py sha256=p1_xSneNCFqkXgKKWJmb9KO4YJy4-uY1XDlUcz6Eazo 1300
indic_eval/data.py sha256=RiCG9WEJ9F3O_ry1pVMaSQGY4PfLQVYsxOccpARvsbw 11279
indic_eval/evaluator.py sha256=x4VnHiaqg3nZM1Ri8LS-gS6EbJyhO7KWdxwE2k3Zutc 7317
indic_eval/few_shot_manager.py sha256=lYyfwcz_iyPW4jB7jTumgaRY6znJMJIC7n9uyVtEwMI 14037
indic_eval/indic_accelerate.py sha256=gLWXZV0SRT9sxxh2ipdybry9O7ze-si68zNqiIyQ3d8 9138
indic_eval/main_accelerate.py sha256=J5luNY5EeK-3N8welWeamkElbxRQUSENGXhsXMpwTHM 6742
indic_eval/main_nanotron.py sha256=cCHOoUzfmmJ4XFR1l16KtA6p8dx9pSP6yfZOkNV5N0g 8282
indic_eval/utils.py sha256=sOm9CbNRnL0-BwZJnZFjGQxpkEtqk-j5s_iau93NDHE 9330
indic_eval/utils_parallelism.py sha256=l0MF-Ludi5Qd2_7BkDNSv_41_iAM04AhK0O3Qoa9SGw 6405
indic_eval/logging/evaluation_tracker.py sha256=uPWMPiePM7A0t2Dnj61HuNBZt3F1IO10om81SEhoH-4 30515
indic_eval/logging/hierarchical_logger.py sha256=mkvusaBootrUEtnEA1sOFkJPe1_Cbb0OO8ODXA0FyLQ 5773
indic_eval/logging/info_loggers.py sha256=UesFnwwV1BYUHCvOuvVlu3Dg71n9ffe5qcYrMqGNwZY 27957
indic_eval/metrics/__init__.py sha256=JO-FCq22iZZd8HLCj6Yyp_qvG-uc9eiIUmbesOP_krM 6046
indic_eval/metrics/metrics.py sha256=BxTbMYihOifXosBa-tsGRm5CYm9yc_FjIab6z_LsH2c 21324
indic_eval/metrics/metrics_corpus.py sha256=-JMkLaloBgT4skPyxWe3ZvgqtjHek7MTflMD7Y78eGE 6250
indic_eval/metrics/metrics_sample.py sha256=YmdSkbYXrNf1opwDihQoO6mPwqwhUxTG_qdbsW6Qeqc 27729
indic_eval/metrics/normalizations.py sha256=hqY6VscI3PjhT-9jhBB38G-JX6nvOKpZQNvFndPxTcg 10347
indic_eval/metrics/sample_preparator.py sha256=4AAcJiXZBfKnp0_wsqM-Y0R7gXpFcoojwxCGVHY8hPE 5761
indic_eval/metrics/stderr.py sha256=1j4gfc7KTqGMmsu3r4IOONgNg7PJ3qnwkVHruN9fqzA 4500
indic_eval/metrics/utils.py sha256=3GInQaEIKphnW1PESLGjg8lxvj3IV7x4IxWeR2snNLk 3402
indic_eval/metrics/harness_compatibility/drop.py sha256=K4eoZiHvt0j7xitGNJcrNEeIGCrW_XMOxD6QnpPeRwU 6192
indic_eval/metrics/harness_compatibility/truthful_qa.py sha256=UXowvzTaKzbtxILiWKJIZ0NeDyc6wY-BjpOr55OvU_o 2624
indic_eval/metrics/imports/bert_scorer.py sha256=3wwemy3C7ai2tlLxghfB3jeQxmxmjUuPIHx80QbT23M 18829
indic_eval/metrics/imports/data_stats_metric.py sha256=0qRoLAwP_HNUI4tZfa99Ki7AWHvlT21PqL3iaawcdFM 5850
indic_eval/metrics/imports/data_stats_utils.py sha256=x5D7GlmBBzwG5dVeM3fA8ziooTkzzAn76bcoR8mCg4Y 6339
indic_eval/metrics/imports/summac.py sha256=pRBe-cO7HYrZFasbt_syBKpGFn-Ek6B-rDuW8KblHcU 11999
indic_eval/models/abstract_model.py sha256=kHeu5pN81du2hlBsGjuLGpTMT-0Hh1jpAyiir6HEHgo 6932
indic_eval/models/adapter_model.py sha256=gLfPOzTD6SrnhftUoJUODIRUz4lmscBWa7QRXlBpymM 3601
indic_eval/models/base_model.py sha256=HVHzsfMQUU81WUtKtOQTJ5zgnQOsUNKZRCXvtCKDlsw 45207
indic_eval/models/delta_model.py sha256=6KuruCDNsyq2ON_dc3YxKP4yIFYQ4R2XzqqF6-z_k08 3536
indic_eval/models/endpoint_model.py sha256=LP5JOWrTsBXxdCHi2uO1nFxEvY1Ya5DivSKV5ljOhPQ 17126
indic_eval/models/model_config.py sha256=3N2HrNjifs2nQW5xGKId9aOMe6wxUhorWN__uJRLrL8 15030
indic_eval/models/model_loader.py sha256=XqYa2SkGj6cYAgIk4E9UaYEXfcCXL1YFB5Gm_knBJOo 5737
indic_eval/models/model_output.py sha256=GxoExyfK03aGN6SX_3uwwI5zAH-9D7G47Wi7LWsmiHs 2787
indic_eval/models/nanotron_model.py sha256=bHJE6sKtB7ZXOPz-T0aobpLA3lG1pVDjR09FbdyzjVY 65165
indic_eval/models/tgi_model.py sha256=x2zAhZvaSEfJJGa_DzUAZt3ZRR6ozZVzqZVv93TorRg 5741
indic_eval/models/utils.py sha256=QHoV-nDwO7mLfjMXwUVqODjl6NdyMT2stvnn9pAeIfI 4371
indic_eval/tasks/indic_tasks_table.jsonl sha256=5_gjlC5tE-z5QSxFT2gkgQJ5EwoPaavdbWgJYuV9blE 18478
indic_eval/tasks/lighteval_task.py sha256=iKjzbBUTY93CxBa3mdsdf15UzKtf4S6eifiC3YIWxaw 30138
indic_eval/tasks/registry.py sha256=VqjiJM_N9Eb67fp02fSZDaxTiKNv_fBI2RDJb1rAplU 12089
indic_eval/tasks/requests.py sha256=uE94uEEqlNGF3GyoTmeRsP0kQET4IDYfn-YEJBUaKwY 6758
indic_eval/tasks/tasks_prompt_formatting.py sha256=s-fVptuyUPZ3JtrhZ2-R84ldDa_W9NoXM8bekXlo5tY 108375
indic_eval/tasks/tasks_table.jsonl sha256=g-tVkgRSOmrZNYUHZm_jYnEbLzk0egsO1A3ABPCudt8 557735
indic_eval/tasks/extended/__init__.py sha256=nICZ2Y_tWB4ILkaaE9RfcioKwBy8loX2ZGYNVQUY9ss 1472
indic_eval/tasks/extended/ifeval/instructions.py sha256=XLe8stUulrVeKSKjOljxmqsDpX3eSl6t8oSufbzHol8 57585
indic_eval/tasks/extended/ifeval/instructions_registry.py sha256=GO2BrB-mvG3Cl0f5bV-g8_7dhDrL3tEFTYOpIPeM23w 7426
indic_eval/tasks/extended/ifeval/instructions_utils.py sha256=OY-1X2Lt0sjmmGA0WvAHi14y8v97fsO4TCc1gxDFX-Y 27575
indic_eval/tasks/extended/ifeval/main.py sha256=xtnaKWMb2JE57yscG0-Et_wxkoq76OfHuCDEnWKi_z0 6053
indic_eval/tasks/extended/tiny_benchmarks/main.py sha256=hWwIBbwB2YX3rI_6bYshBt15SdT3yjA6Q_FiyxkSmgQ 11625
indic_eval-0.1.0.dist-info/LICENSE sha256=SWN7IKak-0JQpEU8qJ79SbJG-8nzbAisiDpLzcCK2MQ 1094
indic_eval-0.1.0.dist-info/METADATA sha256=-Lh8W_qm2039MvyqFg65jGKTatz0pQJ8wFyO74h37lY 36966
indic_eval-0.1.0.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
indic_eval-0.1.0.dist-info/top_level.txt sha256=NgZ1U-en_CzNZnl7VBu6RHcT68whsmljmRBpAtOW72g 11
indic_eval-0.1.0.dist-info/RECORD — —

top_level.txt

indic_eval