Wheelodex » Projects » parsbench

parsbench

View on PyPI — Reverse Dependencies (0)

0.1.7 parsbench-0.1.7-py3-none-any.whl

Wheel Details

Project: parsbench
Version: 0.1.7
Filename: parsbench-0.1.7-py3-none-any.whl
Download: [link]
Size: 71015
MD5: 9e3a0d2f16a9d80cce27b89af87561ea
SHA256: 7c7ed9434ec77fb7ecc8db3315fc7427c8aa0730d07ea369f2939d8dcc1375ee
Uploaded: 2024-08-15 11:36:08 +0000

dist-info

METADATA · WHEEL · RECORD

METADATA

Metadata-Version: 2.1
Name: parsbench
Version: 0.1.7
Summary: ParsBench provides toolkits for benchmarking LLMs based on the Persian language tasks.
Author: Shahriar Shariati
Author-Email: shahriarshm81[at]gmail.com
Home-Page: https://parsbench.github.io/ParsBench
Project-Url: Documentation, https://parsbench.github.io/ParsBench
Project-Url: Repository, https://github.com/ParsBench/ParsBench
License: Apache-2.0
Keywords: llm,benchmarking,persian
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Natural Language :: Persian
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: System :: Benchmark
Requires-Python: >=3.10,<3.12
Requires-Dist: anthropic (<0.31.0,>=0.30.1)
Requires-Dist: datasets (<3.0.0,>=2.20.0)
Requires-Dist: hazm (<0.11.0,>=0.10.0)
Requires-Dist: jsonlines (<5.0.0,>=4.0.0)
Requires-Dist: openai (<2.0.0,>=1.35.10)
Requires-Dist: rouge-score (<0.2.0,>=0.1.2)
Requires-Dist: scikit-learn (<2.0.0,>=1.5.1)
Requires-Dist: scipy (==1.10.1)
Requires-Dist: transformers (<5.0.0,>=4.42.3)
Description-Content-Type: text/markdown
[Description omitted; length: 7631 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.7.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
parsbench/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
parsbench/benchmarks/__init__.py sha256=je_7hKTpSfxsPQ-q9RkN0hOhZq-8CB25wfZ7XLUnKwY 474
parsbench/benchmarks/base.py sha256=sTKove1Piq6b0qO4Et4wGRIprqgEdddrhXCPpgy0gds 2409
parsbench/benchmarks/benchmark_result.py sha256=d-OfFNKPtcAo8a7WjWO3fqIANcW5vLRR1Nw1HDDtua8 13372
parsbench/benchmarks/custom_benchmark.py sha256=00ZTu3VMM7-TNIEQ0E8nP1MfcHcSIiADSJ_6KaPKGh4 4531
parsbench/benchmarks/parsinlu_benchmark.py sha256=5QbCVDqL31UnIfBbZrcswTx4U7ozKlAv86BKprM3N6k 1046
parsbench/models/__init__.py sha256=62QpT_2SxxX1zvaiYEAO7FM-kuHKNI-eIw3mRYLfK7s 280
parsbench/models/anthropic_interface.py sha256=Dy1FpVTBkuA-Z7FqA1VEpKmDny4jLHwwloU8mwPg-tE 3458
parsbench/models/base.py sha256=ZSlQNuEYO0oUD1DRyEHy6ZgpCQ7lkH4xm9YUp1Q_eQM 3542
parsbench/models/openai_interface.py sha256=LtSxVivPKnxB1t01_BY6tJZScEMS7uf5zV1Hb12LN7k 3438
parsbench/models/transformers_interface.py sha256=N8REiTGUjsPlQOWsY8RhiWKL21gzz9NwvcSTsp5Fwjg 3230
parsbench/scores/__init__.py sha256=9rWQ7otGnqWE_9-MZbMqA9PVlre76p_Ll_dNClDVO9w 300
parsbench/scores/base.py sha256=YyKATT2WVbzYchcmBfBTus0WjHJvISq5jZrqfiuVC30 919
parsbench/scores/common.py sha256=yVd6BZiEnrZPVAOEMenytxVu3Y2ZmIsQDg59AMFetr8 152
parsbench/scores/machine_translation.py sha256=eoGbI1HmYrvY_1Ei563VWYP7dU0T0dhXlGliZJQggRw 739
parsbench/scores/summarization.py sha256=oGNnlC6aZ9pkpzGqZzySbUpmhJn2xFRkmQyyikKxyqA 675
parsbench/tasks/__init__.py sha256=yQbP1N6YW9v_sFOagg0q7Z4LAfV1AEtr_BVWr2IUy3M 890
parsbench/tasks/base/__init__.py sha256=AhzsIhZ8Xzmht3Bcgksb6rYDWw22_H-Jb6gj7UdljtE 706
parsbench/tasks/base/data_loader.py sha256=hZS_LtK8Oycwc5f7EsqSEVELQnHi7UeCeSruW0u4pUk 3984
parsbench/tasks/base/evaluation_result.py sha256=1Vx5vtiwm5E0Gez2wIE8R4W7pmfaYJTEjdPQ1duYw98 4050
parsbench/tasks/base/helpers.py sha256=JsJVRgrw9J1sCjhADaijpFWej2xJ8Le7chtCF3RjmyM 724
parsbench/tasks/base/prompt_template.py sha256=dwBchnTewqsd7ISMefhys5rSgxEBJB9Pk-OntfFXbIA 6856
parsbench/tasks/base/task.py sha256=f5xt0F8wo5VxGg_9r4jRIAKpdlwabAzuG0s4SrxkVNw 10353
parsbench/tasks/base/task_category.py sha256=88W7Hg3ASLErDJXQ1bfPGCmUC590MpQ1_BXwN29MHf8 179
parsbench/tasks/base/task_match.py sha256=zQtEiarRJTOkZhpRRevI_pehfUrV77PcuB32W6zJe9c 3592
parsbench/tasks/classification/__init__.py sha256=-AvI3UiuRGZSiuo1kjFTCmZmPl6UFrMBsYU7hUhNOwM 99
parsbench/tasks/classification/parsinlu_sentiment.py sha256=-oH7qEYhPHnL3LMiTNYXp2XpWGclQzmGQV6g0EaaBWw 2376
parsbench/tasks/classification/prompts/en_parsinlu_sentiment.txt sha256=nt62QcfoaLfn-Vybnc8y3XRGJDJrRrHyiNLJEB0_Bh8 325
parsbench/tasks/classification/prompts/en_parsinlu_sentiment_shot.txt sha256=K5Sidda2lP0wiiIU-YdmV-qK2ExDoszCTUQkCv4MAQI 35
parsbench/tasks/classification/prompts/fa_parsinlu_sentiment.txt sha256=IE7KWgidv-mdNMkyUjqJD4IG-ykdsu80LILvhlko8iI 460
parsbench/tasks/classification/prompts/fa_parsinlu_sentiment_shot.txt sha256=bQBisgdt2j07HW0hHf2Sjt50r6Mt-Lxg3oJfhVKIfoQ 36
parsbench/tasks/entailment/__init__.py sha256=_mRXDVtdhG_tdeA5Tr-JkqKkKCWtNx5oqf1I_0utLKY 198
parsbench/tasks/entailment/conjnli.py sha256=sNav5zyluRvhg4PEhh_cVfPxULHm6P2sS89_1GrUE4E 1965
parsbench/tasks/entailment/farstail.py sha256=sFgtBu94-DoAsZ9lz9p8_fLQsB6OVuC2zyiwMwF9Rps 1974
parsbench/tasks/entailment/parsinlu.py sha256=CItwQAh0DfIvfViQXgG22fy4ePUo4D2qR36I4WLBNuM 2066
parsbench/tasks/entailment/prompts/en_conjnli_entailment.txt sha256=vtwnWfgi8FMWMS6fslRfHDyvq-SRLevqE1BztTlUiwg 720
parsbench/tasks/entailment/prompts/en_conjnli_entailment_shot.txt sha256=VpTLacndb8LcpXyOSUqEIlx-cMfcbtu_mt9AgKTgzVs 74
parsbench/tasks/entailment/prompts/en_parsinlu_entailment.txt sha256=31BvTWAOm2xA3W1OIRZhD2L9btWSVtlB6h6-nL8xXbU 799
parsbench/tasks/entailment/prompts/en_parsinlu_entailment_shot.txt sha256=TSnQAKuq-spEPfN6OXS9UJ8Ygp1uDwTQLZV5uZbsZtg 50
parsbench/tasks/entailment/prompts/fa_conjnli_entailment.txt sha256=aACA4Ip8E2pHzxuZuqk3FZqYOZWT8N1ip7ygq5B3Cnw 1017
parsbench/tasks/entailment/prompts/fa_conjnli_entailment_shot.txt sha256=L_uGnUiOrdMJmQd7WPV4GqEWREvbqa9ypWT0qYjyU7g 82
parsbench/tasks/entailment/prompts/fa_parsinlu_entailment.txt sha256=7A86qxI7isT1dMLisTuPBJAE6hm7-pcfk6StLN7biLg 1137
parsbench/tasks/entailment/prompts/fa_parsinlu_entailment_shot.txt sha256=BOud-ZAJpMg1Ax3WJKsHG1R-siUg9oEI0Vk2KPAcBUY 52
parsbench/tasks/machine_translation/__init__.py sha256=UcUtcz2VAElnTfgkakXvvyUSSt5MkgmmsRSgVGDBGt4 198
parsbench/tasks/machine_translation/helpers.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
parsbench/tasks/machine_translation/parsinlu_en_fa.py sha256=i2CH1EvXwM5tNyIzQEZeLnaaqM2qsEZw1bEvpEoDsGs 1630
parsbench/tasks/machine_translation/parsinlu_fa_en.py sha256=7stJ7q9YuvpgRoV6XUPZYYR6LWc3BpU_-RvKxKvijVs 1630
parsbench/tasks/machine_translation/prompts/en_parsinlu_translation.txt sha256=OqZuK0mRRpOBbhC3k0DTJLpF5_CNnQ2_FsRENc26WZ4 228
parsbench/tasks/machine_translation/prompts/en_parsinlu_translation_shot.txt sha256=7v5I8iCkpxpkKtFP99AxrBOPJDko56be2VVToLdxE5M 23
parsbench/tasks/machine_translation/prompts/fa_parsinlu_translation.txt sha256=9j0ousfZronYkGqucu1RsxNtYvl76uVw8HqxGdod9r8 463
parsbench/tasks/machine_translation/prompts/fa_parsinlu_translation_shot.txt sha256=7v5I8iCkpxpkKtFP99AxrBOPJDko56be2VVToLdxE5M 23
parsbench/tasks/math/__init__.py sha256=x4_4prZ65EsELXaAnwAjW8XN9JZUHldo9j-usSn2Q1w 65
parsbench/tasks/math/persian_math.py sha256=7mrUjnHZlYBnw4yMQhlUx4y5WNwAzXvO7l8cTlF4OPY 2802
parsbench/tasks/math/prompts/en_math.txt sha256=glf05eQ3SFF0pCHlY9yntiWXFHbdCAu-CXrM-FwzeKw 768
parsbench/tasks/math/prompts/en_math_1_shot.txt sha256=nfpXRo7SQGtMvxYnlb6AUmMmEGwzZ48WP67OqT0RSbA 2469
parsbench/tasks/math/prompts/en_math_3_shot.txt sha256=z7J2zJy6W8BMSPH-Jb3ReVow4nGdywb6A39xOAPlFSU 6346
parsbench/tasks/math/prompts/fa_math.txt sha256=MJIzTcwik6MzPIWJ3SnH3IWUNd4OFN18R2gyGRTDsQM 1347
parsbench/tasks/math/prompts/fa_math_1_shot.txt sha256=RarKsiFi-kAlY3JdV6OOkYiz1nm-5cv-c2PVzfRoVW4 2549
parsbench/tasks/math/prompts/fa_math_3_shot.txt sha256=EtgVoWlUOPzCbsF8HfEjpEBvhq62LQMpN8SHRBH0j9o 6586
parsbench/tasks/multiple_choice/__init__.py sha256=pEKgvC4KhcbvgHFOpI_Uq3xuRGLSAc-wVpP3JHHcE8g 147
parsbench/tasks/multiple_choice/parsinlu.py sha256=jlBma3Ak-Ux3kjQs798husOXfc5ylrkxl7XZgZvIEzs 2412
parsbench/tasks/multiple_choice/persian_mmlu.py sha256=7G0Hhh33NCDaHI2fVcEsZ8pG2deFmh44WMNn9nS2FKI 7002
parsbench/tasks/multiple_choice/prompts/en_parsinlu_multiple_choice.txt sha256=CQijhoUCItnCtYMzY6vtBuj2BckE3ytf1LnLZ3LAiVI 328
parsbench/tasks/multiple_choice/prompts/en_parsinlu_multiple_choice_shot.txt sha256=th-JsNIOfOvcs3ViW3HSW9NmvkGJrsUgypkOmMaLBlc 74
parsbench/tasks/multiple_choice/prompts/fa_parsinlu_multiple_choice.txt sha256=rRC6YCbmsqOHxq7vhB564dVUQZzFT8E79pvyO41d30o 462
parsbench/tasks/multiple_choice/prompts/fa_parsinlu_multiple_choice_shot.txt sha256=0H9D43sPg2CnnIx77sxZqbNsQSdMczgtdiXY1MyMlrE 81
parsbench/tasks/ner/__init__.py sha256=tF6HXJwTPktSOpYQnZFOf4adCNon7KMnJ4zvmKwwgLU 62
parsbench/tasks/ner/persian_ner.py sha256=BOjIySWNu6ZpU0KVAPjDWAB6RaMBspm3Z1k9eSyCjYs 2594
parsbench/tasks/ner/prompts/en_persian_ner.txt sha256=-wiQ-UIaZOOtOz3r-r0xc4pmzYhnZ9bKxCA5rRim2ks 484
parsbench/tasks/ner/prompts/en_persian_ner_shot.txt sha256=M8JiIC1RnNs8G7do4J9RXU8z7LMPBjmn7H2JfqKyIDg 40
parsbench/tasks/ner/prompts/fa_persian_ner.txt sha256=E4jq2Hn_YwWFuSF29AyopIlgOeXoqz6Pw3Gr9XHkGcs 759
parsbench/tasks/ner/prompts/fa_persian_ner_shot.txt sha256=Oy9L1EqMNvsaUiHSduIR1yG8Z2-vyUJbhtoN7rSC4hM 31
parsbench/tasks/reading_comprehension/__init__.py sha256=RPyHNAQ-4dz2sjLrOp4fn12KZCbpOJcQTkorj1UziD0 95
parsbench/tasks/reading_comprehension/parsinlu.py sha256=G_B6cT-0KZvlQX17weyt8ZU0u3WLai-nHumLJatvwkU 3249
parsbench/tasks/reading_comprehension/prompts/en_parsinlu_rc.txt sha256=FuNHb6uygc6C9_GfVvF-fzwlAEgbVD8kjqqTxoG8CPM 234
parsbench/tasks/reading_comprehension/prompts/en_parsinlu_rc_shot.txt sha256=2iJAjpSo7EGy1jV8YzA_73njJxJQgYhCDHqNRTbTShQ 68
parsbench/tasks/reading_comprehension/prompts/fa_parsinlu_rc.txt sha256=aHGvgswk4RSgHB7Q1Mf7P_w3vPhckc5QadIQDktgM4M 327
parsbench/tasks/reading_comprehension/prompts/fa_parsinlu_rc_shot.txt sha256=Zgqa_GG0SkgD3_xvfxuluhjKfB2NddLZYVgMxZiSmfQ 69
parsbench/tasks/summarization/__init__.py sha256=jFIfbfXJ5ai-lER6LblGZyLS_b8MxRzBGcwLMkTqFkE 118
parsbench/tasks/summarization/pnsummary.py sha256=nqr3NBRgJPfZZqNvNb8QsCLE59CdRAf7RaHsbuwitFs 1419
parsbench/tasks/summarization/prompts/en_pnsummary.txt sha256=Xsu6B5oieHWj9LIp7iq_zqpEnVNw3FHKr5J41egmhBE 222
parsbench/tasks/summarization/prompts/en_pnsummary_shot.txt sha256=scfNXAkxPZ0_wUJhBgQGPLOahK62zeCxyLUrBD5b57c 55
parsbench/tasks/summarization/prompts/fa_pnsummary.txt sha256=FQrMrgWGNcForMPael9Mjz31VZmM_tccWrdzLOR_vzY 287
parsbench/tasks/summarization/prompts/fa_pnsummary_shot.txt sha256=gXRdXe5PhxbWoaOdNFu-MtDOHR0CJaKoo-cX7f135lM 55
parsbench/tasks/summarization/xlsum.py sha256=0pVjg5CnoJbbDmV0Te80ntqgecxa50pCIorFEuzUvgk 1381
parsbench/tasks/utils.py sha256=z9bHgirlkqX7WkxJfNAfVXK_eL3V9yHJlytqEgoO4ZQ 607
parsbench-0.1.7.dist-info/LICENSE sha256=AkSHdwNvluP8A83Z-MOQOUaDEducxCNfFVpj_JGX8kQ 11346
parsbench-0.1.7.dist-info/METADATA sha256=Qw7TB3II7LdSlmZZi1GT2_kGnbZJECLp5cFgerEKBVU 9086
parsbench-0.1.7.dist-info/WHEEL sha256=d2fvjOD7sXsVzChCqf0Ty0JbHKBaLYwDbGQDwQTnJ50 88
parsbench-0.1.7.dist-info/RECORD — —