Wheelodex » Projects » llmuses

llmuses

View on PyPI — Reverse Dependencies (0)

0.4.3 llmuses-0.4.3-py3-none-any.whl

Wheel Details

Project: llmuses
Version: 0.4.3
Filename: llmuses-0.4.3-py3-none-any.whl
Download: [link]
Size: 243674
MD5: 4fd1dedc36cd1e34e602fb7b5848dbf3
SHA256: 3eeb384c247cdc55c1efa9c4200eee67f14dc47af456f5acea366519b30d4bab
Uploaded: 2024-07-28 16:18:21 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: llmuses
Version: 0.4.3
Summary: Eval-Scope: Lightweight LLMs Evaluation Framework
Author: ModelScope team
Author-Email: contact[at]modelscope.cn
Home-Page: https://github.com/modelscope/eval-scope
Keywords: python,llm,evaluation
Classifier: Development Status :: 4 - Beta
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Requires-Python: >=3.8
Requires-Dist: torch
Requires-Dist: absl-py
Requires-Dist: accelerate
Requires-Dist: cachetools
Requires-Dist: editdistance
Requires-Dist: jsonlines
Requires-Dist: matplotlib
Requires-Dist: modelscope[framework]
Requires-Dist: nltk
Requires-Dist: openai
Requires-Dist: pandas
Requires-Dist: plotly
Requires-Dist: pyarrow
Requires-Dist: pympler
Requires-Dist: pyyaml
Requires-Dist: regex
Requires-Dist: requests
Requires-Dist: requests-toolbelt
Requires-Dist: rouge-score
Requires-Dist: sacrebleu
Requires-Dist: scikit-learn
Requires-Dist: seaborn
Requires-Dist: sentencepiece
Requires-Dist: simple-ddl-parser
Requires-Dist: tabulate
Requires-Dist: tiktoken
Requires-Dist: tqdm
Requires-Dist: transformers (<4.43,>=4.33)
Requires-Dist: transformers-stream-generator
Requires-Dist: jieba
Requires-Dist: rouge-chinese
Requires-Dist: torch; extra == "all"
Requires-Dist: absl-py; extra == "all"
Requires-Dist: accelerate; extra == "all"
Requires-Dist: cachetools; extra == "all"
Requires-Dist: editdistance; extra == "all"
Requires-Dist: jsonlines; extra == "all"
Requires-Dist: matplotlib; extra == "all"
Requires-Dist: modelscope[framework]; extra == "all"
Requires-Dist: nltk; extra == "all"
Requires-Dist: openai; extra == "all"
Requires-Dist: pandas; extra == "all"
Requires-Dist: plotly; extra == "all"
Requires-Dist: pyarrow; extra == "all"
Requires-Dist: pympler; extra == "all"
Requires-Dist: pyyaml; extra == "all"
Requires-Dist: regex; extra == "all"
Requires-Dist: requests; extra == "all"
Requires-Dist: requests-toolbelt; extra == "all"
Requires-Dist: rouge-score; extra == "all"
Requires-Dist: sacrebleu; extra == "all"
Requires-Dist: scikit-learn; extra == "all"
Requires-Dist: seaborn; extra == "all"
Requires-Dist: sentencepiece; extra == "all"
Requires-Dist: simple-ddl-parser; extra == "all"
Requires-Dist: tabulate; extra == "all"
Requires-Dist: tiktoken; extra == "all"
Requires-Dist: tqdm; extra == "all"
Requires-Dist: transformers (<4.43,>=4.33); extra == "all"
Requires-Dist: transformers-stream-generator; extra == "all"
Requires-Dist: jieba; extra == "all"
Requires-Dist: rouge-chinese; extra == "all"
Requires-Dist: ms-opencompass; extra == "all"
Requires-Dist: ms-vlmeval; extra == "all"
Requires-Dist: absl-py; extra == "inner"
Requires-Dist: accelerate; extra == "inner"
Requires-Dist: alibaba-itag-sdk; extra == "inner"
Requires-Dist: dashscope; extra == "inner"
Requires-Dist: editdistance; extra == "inner"
Requires-Dist: jsonlines; extra == "inner"
Requires-Dist: nltk; extra == "inner"
Requires-Dist: openai; extra == "inner"
Requires-Dist: pandas (==1.5.3); extra == "inner"
Requires-Dist: plotly; extra == "inner"
Requires-Dist: pyarrow; extra == "inner"
Requires-Dist: pyodps; extra == "inner"
Requires-Dist: pyyaml; extra == "inner"
Requires-Dist: regex; extra == "inner"
Requires-Dist: requests (==2.28.1); extra == "inner"
Requires-Dist: requests-toolbelt (==0.10.1); extra == "inner"
Requires-Dist: rouge-score; extra == "inner"
Requires-Dist: sacrebleu; extra == "inner"
Requires-Dist: scikit-learn; extra == "inner"
Requires-Dist: seaborn; extra == "inner"
Requires-Dist: simple-ddl-parser; extra == "inner"
Requires-Dist: streamlit; extra == "inner"
Requires-Dist: tqdm; extra == "inner"
Requires-Dist: transformers (<4.43,>=4.33); extra == "inner"
Requires-Dist: transformers-stream-generator; extra == "inner"
Requires-Dist: ms-opencompass; extra == "opencompass"
Requires-Dist: ms-vlmeval; extra == "vlmeval"
Provides-Extra: all
Provides-Extra: inner
Provides-Extra: opencompass
Provides-Extra: vlmeval
Description-Content-Type: text/markdown
[Description omitted; length: 22786 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.38.4)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
llmuses/__init__.py sha256=3eLMMrjkAIAs3vGluXNZn5-xTSbO_vfba9yNPbkVtg8 105
llmuses/cache.py sha256=y6zixcxEo28kPP4nU5Ko4ZXYasgmOd3pecLxaETpwm4 3284
llmuses/config.py sha256=-EuTb7JNMTX4AJJu9p6VwZeyO1oTGtZUiRUHzyK8RlM 6908
llmuses/constants.py sha256=hiaG6Q97xa-yjuRkBivpeziHy-o5gihb1HLgCVgLjIs 2668
llmuses/run.py sha256=eWt9_lTlZ2DX002IaCkKIL_7o_xQfdwymK3NY0MqAFw 18448
llmuses/run_arena.py sha256=CB7loeChO3ir9fbQqSqRUjadhqle99znVjfw5MQy1qg 8781
llmuses/run_ms.py sha256=ZyukWR9keDbGCw1eYOb8Vxc2Bz-puXGDdaDmYnzYXbc 5996
llmuses/summarizer.py sha256=Q3c6Ws7CD0dRCcy8PMkUszZD3Fii_hmRJYqnURDG4bY 6346
llmuses/version.py sha256=OIve2nKQX29Ino-lwyYHFgbXchSlMucsIrFoZb_APHU 118
llmuses/backend/__init__.py sha256=HX9IhXQmtfbnkjk2RKM60cE0kbImNtNXUZeN9tsmj38 133
llmuses/backend/base.py sha256=ZUvirtVOmxF6mNNb6wYwxQNdMoB322IITg8KmlP1fyU 874
llmuses/backend/opencompass/__init__.py sha256=HX9IhXQmtfbnkjk2RKM60cE0kbImNtNXUZeN9tsmj38 133
llmuses/backend/opencompass/api_meta_template.py sha256=sBW0XbVDOKeJ7mVUDLhmcG4e0yClw3eluazdp_8wtgQ 1753
llmuses/backend/opencompass/backend_manager.py sha256=3CrmOTamoHfTEmutF3ChKme18OrCX4kqpLlkNXUZ4uA 10354
llmuses/backend/opencompass/tasks/__init__.py sha256=I_ANdxdcIHpkIzIXc1yKOlWwzb4oY0FwTPq1kYtgzQw 50
llmuses/backend/opencompass/tasks/eval_api.py sha256=Fpk6zLcKXP-jG7z6qrgxmd1cbCb0yqxIu8squuDcLBc 1040
llmuses/backend/opencompass/tasks/eval_datasets.py sha256=DWwKcQGGSkkh65H1d-oKN8Jow0Q0cHJJzDC75inycFM 5186
llmuses/backend/vlm_eval_kit/__init__.py sha256=MPuaQjU1SIsT8D6uFQTGxyBDfdsweUtWvAKzJ3ghoko 81
llmuses/backend/vlm_eval_kit/backend_manager.py sha256=s76QCR0M7E-y8Gbc4w3TtmIcCYTW-Kk1MKpjwtdY8mA 6207
llmuses/benchmarks/__init__.py sha256=npughdwFFSYY4KJ88n-iIsjtQEUePwsukRSuxy1s5fA 158
llmuses/benchmarks/benchmark.py sha256=dGAt1XyTftCSUOqILuqxjzYK4lS4tt2ZZrwMRO4JxaQ 2155
llmuses/benchmarks/data_adapter.py sha256=eoMUcOX9EzLqsvr5Rz5o7QRW3ydhPLLaR8v5Tz9OHVs 10387
llmuses/benchmarks/arc/__init__.py sha256=cJMJvVPkxdDkE1PAJgy81iT87ZPbKQAiXGQomoxSOGg 308
llmuses/benchmarks/arc/ai2_arc.py sha256=Wim8JsH094og7d0eLCEI0kUwDP_0x7AT117oTRPdiAI 5608
llmuses/benchmarks/arc/arc_adapter.py sha256=o81J2EZwx_xxeYV8mvyASGU4q0BRAY0o_uB3niqOVd8 9206
llmuses/benchmarks/bbh/__init__.py sha256=nsTH0Hn5u-WUet8Y6CFuDF9-ZIE32r7c8p6clzlw_xs 300
llmuses/benchmarks/bbh/bbh_adapter.py sha256=8q4MvKgP63vGZ-mJvSMhXOKKzNf5jxGp_46igBCz0Ks 10792
llmuses/benchmarks/bbh/cot_prompts/boolean_expressions.txt sha256=hNie8uvyVSF-W0sZW721vEhH7_9lypZ0qtDRVraBgxg 1780
llmuses/benchmarks/bbh/cot_prompts/causal_judgement.txt sha256=t2ozSTodp4p2ZibgkhoAomhBFtf2keRioum9QF9E5Sk 3652
llmuses/benchmarks/bbh/cot_prompts/date_understanding.txt sha256=7GDstZmMXjlucd6RsN5WzQiLij_VASLHHEx3mMP4wJ8 1166
llmuses/benchmarks/bbh/cot_prompts/disambiguation_qa.txt sha256=qhCLqXjtlI325tGCBXgLnM8V_bUKpUW-Dohh7U-BPSY 3567
llmuses/benchmarks/bbh/cot_prompts/dyck_languages.txt sha256=Ut7JSNl4zQqeuDt1eq-Mrgdxf2kMar1i85DpVqEi5vU 2404
llmuses/benchmarks/bbh/cot_prompts/formal_fallacies.txt sha256=WNruIcuKwCaNwHPj-xs6VK1RzyVq2JDED02MadpDPl4 4476
llmuses/benchmarks/bbh/cot_prompts/geometric_shapes.txt sha256=4hn9zfKMo7HquDPsWuy5fEnkuJtsI9GrfabostMLQLo 4830
llmuses/benchmarks/bbh/cot_prompts/hyperbaton.txt sha256=Jmv9AxvfpgbLsi0Nc_3_xcSLuwpiT-Po4VgTukmA0w8 3113
llmuses/benchmarks/bbh/cot_prompts/logical_deduction_five_objects.txt sha256=LIqVgRhbD1t5ohv5FGW-Ql98kst4mIl-IpX-IY5c6mg 2504
llmuses/benchmarks/bbh/cot_prompts/logical_deduction_seven_objects.txt sha256=LIqVgRhbD1t5ohv5FGW-Ql98kst4mIl-IpX-IY5c6mg 2504
llmuses/benchmarks/bbh/cot_prompts/logical_deduction_three_objects.txt sha256=LIqVgRhbD1t5ohv5FGW-Ql98kst4mIl-IpX-IY5c6mg 2504
llmuses/benchmarks/bbh/cot_prompts/movie_recommendation.txt sha256=gkMO9u025Uc4RClBeQtF11FDcNb9EsxUlrbwGDdllZc 2120
llmuses/benchmarks/bbh/cot_prompts/multistep_arithmetic_two.txt sha256=g7Y4iyJ0fQGmWyLYWwzaqlpmaypQ3x2sK49AX_YL3NU 2385
llmuses/benchmarks/bbh/cot_prompts/navigate.txt sha256=DATvl8pqWOblx260R3muCt1sYErASv0TAviag1UZrVE 2146
llmuses/benchmarks/bbh/cot_prompts/object_counting.txt sha256=pTYwcwnt-yypHJ9hRLyDVW0hMgBPgxUwX6f6TZnFriw 1417
llmuses/benchmarks/bbh/cot_prompts/penguins_in_a_table.txt sha256=juEuZ97hBp8vgQl_mkKiAsMdbb5MqxatkMRKkKDvopc 2385
llmuses/benchmarks/bbh/cot_prompts/reasoning_about_colored_objects.txt sha256=5KJQPIDdCPkyRmk9riKDHlSFfTtlhyG8aIeTDl7h6JA 2294
llmuses/benchmarks/bbh/cot_prompts/ruin_names.txt sha256=OqEgTV80zfH8Mu2_IZkpPMKUREqVWOFSJo6t7D2sUx4 3480
llmuses/benchmarks/bbh/cot_prompts/salient_translation_error_detection.txt sha256=nBP1tctGuL8pCBYvH3BNW3nQRrRzY7lFNd5bWG6Hs64 6140
llmuses/benchmarks/bbh/cot_prompts/snarks.txt sha256=QSAKws7Of09NdrmFPjJJCVc0zvAIMak6xROhpdgxSt4 3113
llmuses/benchmarks/bbh/cot_prompts/sports_understanding.txt sha256=vgTwHu4mowIeCtaaD24fRmfsaU-V9lG1z4U6izcoFBg 820
llmuses/benchmarks/bbh/cot_prompts/temporal_sequences.txt sha256=xZeBUTWvnAT3jL8SgQJqiC_a82FfYYcgEra6frIuvlA 3022
llmuses/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_five_objects.txt sha256=RmuGDIzsjWNt1ZlkqmerLHiVAWPzZOTVENcgoiM7AZg 2603
llmuses/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_seven_objects.txt sha256=RmuGDIzsjWNt1ZlkqmerLHiVAWPzZOTVENcgoiM7AZg 2603
llmuses/benchmarks/bbh/cot_prompts/tracking_shuffled_objects_three_objects.txt sha256=RmuGDIzsjWNt1ZlkqmerLHiVAWPzZOTVENcgoiM7AZg 2603
llmuses/benchmarks/bbh/cot_prompts/web_of_lies.txt sha256=aPWMXg6mdgoqMao8Oc3jcjeOBh0RUPqN3aBvxaWv9pc 2944
llmuses/benchmarks/bbh/cot_prompts/word_sorting.txt sha256=uhRRz8y0hfHI96olJS9IU32XafGcdiqsPPCOexB1hL4 2163
llmuses/benchmarks/ceval/__init__.py sha256=leLyCeaBU3JwpYe5c9exttJEqnH5QIF9XXHtpJ6PfGg 337
llmuses/benchmarks/ceval/ceval_adapter.py sha256=sG_g9Pyiw7-wH4TgQhhGGEIXvLDR3M1p6oLvPgxPl8I 15844
llmuses/benchmarks/ceval/ceval_exam.py sha256=S32eMfGUBMrUDP39HzO6XfvSir0tthHCPItNtriE-hc 5063
llmuses/benchmarks/cmmlu/__init__.py sha256=nnlJjTxf0a9msVUw0M-GtW5FxmhcCkER23jJff4AUTg 336
llmuses/benchmarks/cmmlu/cmmlu.py sha256=q_6ONrjdcHNqpXTUmSVbNOfl1yMd0zEQZWnh0PMQmYY 5153
llmuses/benchmarks/cmmlu/cmmlu_adapter.py sha256=uSwPmW09VkpiesxhgoleTvkoLEKOxr-mR-rIWhKDbGY 15208
llmuses/benchmarks/competition_math/__init__.py sha256=pb98wO9lQvjvUVoxf5oRlMdUlVTg8W46SKYf34bzaIw 387
llmuses/benchmarks/competition_math/competition_math.py sha256=0p5iKUfU6WpXgplb44YgVWZUYkeWLLmOdj66_dapdDc 2678
llmuses/benchmarks/competition_math/competition_math_adapter.py sha256=sCnlGt8gauQCTVHzs-XFALqjzZQX8xeemt75AtUIVKQ 19079
llmuses/benchmarks/general_qa/__init__.py sha256=3qPGPLSuS08w7YmHYnXvXpGz_5HuboiYGFK9zGjK36o 340
llmuses/benchmarks/general_qa/general_qa_adapter.py sha256=Aqv-DBjlReknY5LIp9DIJZz-jxOYokUiW2GsJGJPJFg 6087
llmuses/benchmarks/gsm8k/__init__.py sha256=qYsPU_-dVDkhwulkOsOeujnzzNh5bGen7fi6IVvKJHw 309
llmuses/benchmarks/gsm8k/gsm8k.py sha256=WZ8k4EEMjNWWCxY-Dhs2BSR4EHHqYBViyl_UZIGNu7U 4282
llmuses/benchmarks/gsm8k/gsm8k_adapter.py sha256=aHpFi9tUbGECP9TaWgawrsxIMfrT_ozc98QSvExyFp0 13968
llmuses/benchmarks/hellaswag/__init__.py sha256=XF8C_g_1vj7d74lQ0w8-YdiVVhDGWeQ3BhhpEJJVm84 351
llmuses/benchmarks/hellaswag/hellaswag.py sha256=bNOUDpGHtAOAyWrQlMiqEGyp0ePTcpIeYbZH3XaFczI 4690
llmuses/benchmarks/hellaswag/hellaswag_adapter.py sha256=NvydILYOkimvePySWd36CpMLGjuv48kfsS_M7tPospY 8547
llmuses/benchmarks/humaneval/__init__.py sha256=V_ypYJ7TTwmjVAm_8fRDuoHmiSAasYTyGj_ZNthZrEg 329
llmuses/benchmarks/humaneval/humaneval.py sha256=oNxRcVkYxlzS18N2JmwSaQb1aTZOVHlZMKwIETjfvNs 3482
llmuses/benchmarks/humaneval/humaneval_adapter.py sha256=1YiAvNbWRUcaTu9oGwpDMmvS4_zoHt_bNWmNpzJmo-g 1661
llmuses/benchmarks/mmlu/__init__.py sha256=NnE8RfLH7Ix2FkF30C3kk9s0FZGk2-i5AD-e0AIYTUA 331
llmuses/benchmarks/mmlu/mmlu.py sha256=GhjZFOgX5qG041eVrSWggOcRcMyl0oAI_yGXmufwEzc 5256
llmuses/benchmarks/mmlu/mmlu_adapter.py sha256=WpEIaB-pqh5kyi40eD4NJha0C6gHS2XHHPaUimYffJ4 16393
llmuses/benchmarks/race/__init__.py sha256=nagPjhk8b3qIkHLxDUb5f-c9JKy29xpdrIeS1_Er7Vg 331
llmuses/benchmarks/race/race.py sha256=giY44Vr6CePdVQxpi0x4CLsaknye47Gdlc_PVqN9VCA 3835
llmuses/benchmarks/race/race_adapter.py sha256=M6XKOvgTjEFTOO4mp7vOI7ja-gSWPG2-QwmbWlpNWE8 9892
llmuses/benchmarks/trivia_qa/__init__.py sha256=-DfZ7_AhY0iGhnJHCXV-BQ4pfaq16aVRs_fautt73Sg 345
llmuses/benchmarks/trivia_qa/trivia_qa.py sha256=xrebA71r_Ek9NvwkDfsmWTuRCsae2HZEGmTBtZMGwfM 3296
llmuses/benchmarks/trivia_qa/trivia_qa_adapter.py sha256=8yXT-XDXYqo3d9sIAVM9Kq8pss-x70zvMWzBnzjRNvg 7653
llmuses/benchmarks/truthful_qa/__init__.py sha256=kRYgOrcw3EDMKMUCqnqi653HxK5jrPJ_jR4aE3R8_-s 361
llmuses/benchmarks/truthful_qa/truthful_qa.py sha256=eOcYBjR7XZ4VFSAY4r1_UUoKXakhR-yzd2I3FiOmlUw 7017
llmuses/benchmarks/truthful_qa/truthful_qa_adapter.py sha256=jIyyxI45UvlTsUm1sKaawpLLbpShsXjz5YtbgjqPPhI 14944
llmuses/cli/__init__.py sha256=I_ANdxdcIHpkIzIXc1yKOlWwzb4oY0FwTPq1kYtgzQw 50
llmuses/cli/base.py sha256=m1DFlF16L0Lyrn0YNuFj8ByGjVJIoI0jKzAoodIXjRk 404
llmuses/cli/cli.py sha256=bTnu63PEqGD67fIhZdVnLe1bt_2Q-24NzrTiRCptTnA 838
llmuses/cli/start_perf.py sha256=wmaftn4OCTr0GjjbzlDHSDAnTGmChZDD1daaou2owYQ 990
llmuses/cli/start_server.py sha256=Py9LTkUdeL3TYrlgSK6N89I6B7dTKJ1fCN6WiEqTfWg 3883
llmuses/evaluator/__init__.py sha256=QceQgfWZS3ByiSyKTc5tkDnfOn0kjTK7i7OW9Kf5LZ4 101
llmuses/evaluator/evaluator.py sha256=3J2iBrGBkYkoL-8dACXFpx1M9BXnWUwrxozqs0nCuvU 30701
llmuses/evaluator/rating_eval.py sha256=bBmhIvb6JtY_2Y1bOLHgJZ8iAIoitMe8D60HeL87uE8 5760
llmuses/evaluator/reviewer/__init__.py sha256=I_ANdxdcIHpkIzIXc1yKOlWwzb4oY0FwTPq1kYtgzQw 50
llmuses/evaluator/reviewer/auto_reviewer.py sha256=AB5Bld_aysePln-4z3Wj9Y1OUtrpIY0V14ccGOlTC2A 17034
llmuses/metrics/__init__.py sha256=I_ANdxdcIHpkIzIXc1yKOlWwzb4oY0FwTPq1kYtgzQw 50
llmuses/metrics/code_metric.py sha256=zK1tpNDZbvmSHt3a_JJ5Y2Hdu2cqeFriy__wUOl2tSw 3462
llmuses/metrics/math_accuracy.py sha256=H_-S_FJVUc1gYS6dbNp3m94hGLbeMy3WJIVHZ1EXBNY 1986
llmuses/metrics/metrics.py sha256=sDZljGiZwgHsFZ5eNi65-3z3BLCdIwWUzPcq2QpKf1k 12545
llmuses/metrics/rouge_metric.py sha256=UWA0WJMiWUDf5fkVK_P9tfUSsGkUglEPC5UUG1vrGmY 4516
llmuses/metrics/bundled_rouge_score/__init__.py sha256=PwbTdk8168FwDJe_l8XIqDuBgZQooDsP31vj7di05Fs 650
llmuses/metrics/bundled_rouge_score/rouge_scorer.py sha256=xSLis-zx1hnHuj_9JI7HuUKMS4ZQsX-D8wECZg4D2bg 11450
llmuses/models/__init__.py sha256=KaISO3ex3aDxzWB1hU6X8F6-JmWzEEv5s_WrcttRUU0 141
llmuses/models/dummy_chat_model.py sha256=AtLg8VynxUiRliqxkQ2R0IPOf5wWeyNNMoHpT3tdK4w 1321
llmuses/models/model.py sha256=ZzzVzZHVzuzdt5F1r-rEBT44ZfW9B7R1spsrV-T8nSw 3020
llmuses/models/model_adapter.py sha256=ZxriA_8IB7FZ39lU13O7WqlQ3zBd1iQApKkk6_emTJg 22478
llmuses/models/openai_model.py sha256=B-qvmrEOX7mS_CEb6v6LcsWlCyucGUXdzY_SbktROxk 3448
llmuses/models/template.py sha256=_cyMDn1m7U0azKPx4VV8AsfBQBVAm-vZQaKng6U-_M0 56033
llmuses/models/custom/__init__.py sha256=iiTYPFf7-tlpm2RV6q6J6PFWZyN2knOhn8-lmcybbcU 101
llmuses/models/custom/custom_model.py sha256=2ivxfGQs5V5HDnQEhTBi5v8KNBxJDbzPVJdNOGo3iSg 1566
llmuses/perf/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmuses/perf/_logging.py sha256=v-a1uhqUt8116OEGXa-uhCPNE3mLxBaJZaKo2ReJgp8 1034
llmuses/perf/api_plugin_base.py sha256=vn_LGE2Mx67X6Ak--rI8BLXyF14_TugXdgznFyq_k_8 2241
llmuses/perf/custom_api.py sha256=jnypFhQ5R9JxfEzp90fRG9n_0zyB6uRC7ePByXK6i6Q 3706
llmuses/perf/dashscope_api.py sha256=buMN_oi3yv_Xu26x3qIjZ5hyBQCTuxVB51quuoLCAS8 3404
llmuses/perf/dataset_plugin_base.py sha256=z5Q--G1kW7YdFUUYUnUNcNcYX11s2l4ebBoqg1c048g 1812
llmuses/perf/how_to_analysis_result.py sha256=UVd_aYJ_7N5hl_wK9oIZig1vSwfgzodxW7XC6IWqbdg 1044
llmuses/perf/http_client.py sha256=ks8_1dREvsUCI-foAlpQv2CBdLEn8Kug8IvsiirbKdA 34520
llmuses/perf/openai_api.py sha256=AAFO2-kXlw8DTgJGwHKwLI5gm41AmOrtI8GyYFgRreo 5964
llmuses/perf/plugin_registry.py sha256=D2MG2AXDBScjuKxB4g_Hg026pSRO752dBimonYtaAzM 782
llmuses/perf/query_parameters.py sha256=HfGRZJSzRMVfPezWTvbWhYeprCetGNPX_M_paoDtuOY 1346
llmuses/perf/server_sent_event.py sha256=s2UqUr1qAMWzBG1XWCFxhulyztd6FM0tGqVvPC8jD5o 1153
llmuses/perf/datasets/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmuses/perf/datasets/line_by_line.py sha256=LfiTGyz05N1AH_jMnH1KZn-WU7FHXcGceFZ-viDB920 824
llmuses/perf/datasets/longalpaca_12k.py sha256=YdnCp0hd7vvApwqfS-H0JadgglTDZrc-XKkgYkw7AMI 928
llmuses/perf/datasets/openqa.py sha256=F4h6drP6svnq6jNTBIrDNHQdWycPVyEJFpuHnS3ctXk 1012
llmuses/preprocess/__init__.py sha256=I_ANdxdcIHpkIzIXc1yKOlWwzb4oY0FwTPq1kYtgzQw 50
llmuses/preprocess/tokenizers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmuses/preprocess/tokenizers/gpt2_tokenizer.py sha256=8dOPVWrzAXhzmzSKBWdWjfDqPlRaMH9slK8v5aWhwcQ 7810
llmuses/registry/__init__.py sha256=I_ANdxdcIHpkIzIXc1yKOlWwzb4oY0FwTPq1kYtgzQw 50
llmuses/registry/tasks/arc.yaml sha256=phXsBLsAgvHWmU31J89QMnJJnUioRphraQrF9SrJ53c 863
llmuses/registry/tasks/bbh.yaml sha256=Ircb_-_eVri2B1MHeSrFs9vIol7RY8ZaWwdz1j57NHA 701
llmuses/registry/tasks/bbh_mini.yaml sha256=eZYash__XJcfJau0VqujehuYE2WnFzrWr9s9jCkNT8Q 775
llmuses/registry/tasks/ceval.yaml sha256=OoSPrz6c3jPy_T7NH162N1lemwwU2OcnT1zo3S-nPRA 703
llmuses/registry/tasks/ceval_mini.yaml sha256=Aw9zzw_6STRVA21mVuAvmGiWCdXzL6ktmdFOCiQWRw4 769
llmuses/registry/tasks/cmmlu.yaml sha256=mkTqqXCdc8bqMcCDI_J3d375RaxX_8v4jw5fyAKAW0A 703
llmuses/registry/tasks/eval_qwen-7b-chat_v100.yaml sha256=388jRmFzt6NjVCPBgLVO21BvSucl9szMPRNXHZKq30U 807
llmuses/registry/tasks/general_qa.yaml sha256=7uiytV5kgs23eP5sBCpg5KXs6b9yFtPFWU1pnCCQIpg 703
llmuses/registry/tasks/gsm8k.yaml sha256=KYLK-xtv_3qtgCZiwwP4-rP_ftc_qUmtsl1Tf-jNlCg 730
llmuses/registry/tasks/mmlu.yaml sha256=504yhHVfi9pvUBk_SGPs-Yx7R2hx_2_-nAFiGIiFGx4 726
llmuses/registry/tasks/mmlu_mini.yaml sha256=wVbosZ5Tm9pwLG5nCphalezXilIjcq5j33nz3MR7_BE 778
llmuses/third_party/__init__.py sha256=I_ANdxdcIHpkIzIXc1yKOlWwzb4oY0FwTPq1kYtgzQw 50
llmuses/third_party/toolbench_static/__init__.py sha256=ws0yucN4XdDJw-JQiwcYHr5Ym4lcqJtwN_mnOL5_6zk 126
llmuses/third_party/toolbench_static/eval.py sha256=TqjMuuYePnD3bGRhQe1_9bIOlAW41kiFSztaEuppRLM 8237
llmuses/third_party/toolbench_static/infer.py sha256=o5HR4ZU8fG3FmKPHtYsbWsZXqo_HwC8FdIa70zvfqDw 9329
llmuses/third_party/toolbench_static/toolbench_static.py sha256=n4BA9rACCdJ5LOuAWWBVqGksKQ4aEzj9NHgqm72HBFs 1924
llmuses/third_party/toolbench_static/llm/__init__.py sha256=I_ANdxdcIHpkIzIXc1yKOlWwzb4oY0FwTPq1kYtgzQw 50
llmuses/third_party/toolbench_static/llm/swift_infer.py sha256=UywM8SU2ByFTzD4YkbB17SXJyxmzY1QDwARDuGzbCvs 1452
llmuses/tools/__init__.py sha256=I_ANdxdcIHpkIzIXc1yKOlWwzb4oY0FwTPq1kYtgzQw 50
llmuses/tools/combine_reports.py sha256=KQbxhDgH6k02j_6gqOIg-nToUovMlR9XqxObhUDSSGU 5386
llmuses/tools/gen_mmlu_subject_mapping.py sha256=CUmRdReEU7QfMyprh9I56KmHoRww_zUda_JuyxmCL1A 3277
llmuses/tools/rewrite_eval_results.py sha256=A7KylbiL7qJeu6Hf7f0jor-MMu8Mg15rK_pGUclOfBQ 3183
llmuses/utils/__init__.py sha256=lP9fnDsoDwMdVUESwn862qj7GlIg15Z_L-yoDxCOl0Y 124
llmuses/utils/arena_utils.py sha256=fwDsFSKhrYfcUPbHIWDs006Qj5Qr1IW_EEFkbr7ZNuY 7668
llmuses/utils/completion_parsers.py sha256=x5uiRhaKN_ydrSqhuR5Ihn_P0QvmS2DQZTJRKE9AwSg 2993
llmuses/utils/logger.py sha256=Ycd0W17Z_oiByPuPX3_umNrOCHjT9O_e_Kws7ZWUSvU 1855
llmuses/utils/task_cfg_parser.py sha256=LiNQ2X8lbZU0cODpaY_PbKyUhNoxZIC495UsLJigX64 138
llmuses/utils/task_utils.py sha256=9izZ6H7nso1OJmdoduDpaFN2KA3DmZ91dkKXA8GTIUc 460
llmuses/utils/utils.py sha256=zvRAxwguRfIJysxaeQ6tgBfo1tF6QAXQhc_rA4wzS_E 20503
llmuses-0.4.3.dist-info/METADATA sha256=FA7Tq10qodmGTa3vhSIpD5_XCLjcgqKRcDX2gPNGeZ8 27169
llmuses-0.4.3.dist-info/WHEEL sha256=2wepM1nk4DS4eFpYrW1TTqPcoGNfHhhO_i5m4cOimbo 92
llmuses-0.4.3.dist-info/entry_points.txt sha256=g2TBjYSsFE2y7Yiditc8pTgffLfeTNQFGI9iuFzzFBo 53
llmuses-0.4.3.dist-info/top_level.txt sha256=1QCXulcfroT1lrSiNr4vvBrlUETBsdhhPuFA0Q7jtR4 8
llmuses-0.4.3.dist-info/RECORD — —

top_level.txt

llmuses

entry_points.txt

[console_scripts]
llmuses = llmuses.cli.cli:run_cmd