alpaca-eval

View on PyPIReverse Dependencies (4)

0.6.5 alpaca_eval-0.6.5-py3-none-any.whl

Wheel Details

Project: alpaca-eval
Version: 0.6.5
Filename: alpaca_eval-0.6.5-py3-none-any.whl
Download: [link]
Size: 343604
MD5: cce131ce80e7ef2905b0c2438ab069b3
SHA256: f2c84000147e4a35539a979f3e2edfe999a1556e3d21b587bd3620a660b78959
Uploaded: 2024-08-17 23:39:29 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: alpaca_eval
Version: 0.6.5
Summary: AlpacaEval : An Automatic Evaluator of Instruction-following Models
Author: The Alpaca Team
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.10
Requires-Dist: python-dotenv
Requires-Dist: datasets
Requires-Dist: openai (>=1.5.0)
Requires-Dist: pandas
Requires-Dist: tiktoken (>=0.3.2)
Requires-Dist: fire
Requires-Dist: scipy
Requires-Dist: huggingface-hub
Requires-Dist: patsy
Requires-Dist: scikit-learn
Requires-Dist: accelerate; extra == "all"
Requires-Dist: transformers; extra == "all"
Requires-Dist: bitsandbytes; extra == "all"
Requires-Dist: torch; extra == "all"
Requires-Dist: xformers; extra == "all"
Requires-Dist: peft; extra == "all"
Requires-Dist: optimum; extra == "all"
Requires-Dist: einops; extra == "all"
Requires-Dist: vllm; extra == "all"
Requires-Dist: anthropic (>=0.18); extra == "all"
Requires-Dist: cohere (<5.0.0a0); extra == "all"
Requires-Dist: replicate; extra == "all"
Requires-Dist: boto3 (>=1.28.58); extra == "all"
Requires-Dist: google-generativeai; extra == "all"
Requires-Dist: seaborn; extra == "all"
Requires-Dist: matplotlib; extra == "all"
Requires-Dist: jupyterlab; extra == "all"
Requires-Dist: pre-commit (>=3.2.0); extra == "all"
Requires-Dist: black (>=23.1.0); extra == "all"
Requires-Dist: isort; extra == "all"
Requires-Dist: pytest; extra == "all"
Requires-Dist: pytest-mock; extra == "all"
Requires-Dist: pytest-skip-slow; extra == "all"
Requires-Dist: pytest-env; extra == "all"
Requires-Dist: python-dotenv; extra == "all"
Requires-Dist: seaborn; extra == "analysis"
Requires-Dist: matplotlib; extra == "analysis"
Requires-Dist: jupyterlab; extra == "analysis"
Requires-Dist: anthropic (>=0.18); extra == "api"
Requires-Dist: cohere (<5.0.0a0); extra == "api"
Requires-Dist: replicate; extra == "api"
Requires-Dist: boto3 (>=1.28.58); extra == "api"
Requires-Dist: google-generativeai; extra == "api"
Requires-Dist: pre-commit (>=3.2.0); extra == "dev"
Requires-Dist: black (>=23.1.0); extra == "dev"
Requires-Dist: isort; extra == "dev"
Requires-Dist: pytest; extra == "dev"
Requires-Dist: pytest-mock; extra == "dev"
Requires-Dist: pytest-skip-slow; extra == "dev"
Requires-Dist: pytest-env; extra == "dev"
Requires-Dist: python-dotenv; extra == "dev"
Requires-Dist: accelerate; extra == "local"
Requires-Dist: transformers; extra == "local"
Requires-Dist: bitsandbytes; extra == "local"
Requires-Dist: torch; extra == "local"
Requires-Dist: xformers; extra == "local"
Requires-Dist: peft; extra == "local"
Requires-Dist: optimum; extra == "local"
Requires-Dist: einops; extra == "local"
Requires-Dist: vllm; extra == "local"
Provides-Extra: all
Provides-Extra: analysis
Provides-Extra: api
Provides-Extra: dev
Provides-Extra: local
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 84461 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (72.2.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
alpaca_eval/__init__.py sha256=Tx4widfpcKo3m5oxevv2pG7-JtVVqiubadF5cwd3BlE 98
alpaca_eval/analyze.py sha256=mkvnKJlI3CJJb-9NrGLzy_537cWaF1fe3dcPTW9lrjU 26164
alpaca_eval/completion_parsers.py sha256=9asWPIH_eJ7d9YoFs5SAACOFeK_JNXvdDjOuyPXj7oc 15013
alpaca_eval/constants.py sha256=CuES5D3zRfh5l9Yhdg5V7em9Ki1Q5JxrVOMIgorBccY 8022
alpaca_eval/main.py sha256=4IZxm6XuSq-sj2c6sBEUGSEQ8C-hXZonrOP4O1P_1Ao 28404
alpaca_eval/plotting.py sha256=c2-iZ06TUOl_tdrsah0Tg7zqmbexNE3i2R9RQZY24p4 30592
alpaca_eval/processors.py sha256=2eAjXd7au8Wt8wGFPNu-nh30RVPvmmMEBYVxGZvkSMI 12890
alpaca_eval/types.py sha256=8HLSXehZRLOJ24xpqN4IFTGQNoG67VznWGkFv-sLjMc 356
alpaca_eval/utils.py sha256=JCHz_Uk7ukL-uFftn4hn9cB4xs1pER8XRuKI_u-ZT2w 22523
alpaca_eval/annotators/__init__.py sha256=1Hwqc8H9AdbPscwqM7NsPkNNSYdajZhv69ZbaXr6blY 54
alpaca_eval/annotators/base.py sha256=T0yhg-oWzRNOpmRm2ADNK28zELB8kKTf1ruNzPzjqps 36119
alpaca_eval/annotators/pairwise_evaluator.py sha256=cvWQDc6MURq4ZssK1e9z9RyU7IPU9VNA8kqY7p91s40 16910
alpaca_eval/decoders/__init__.py sha256=mkMgPTSg40NZFZ5pp2TthnRilw7psEFvaOwEuFkYmGI 3543
alpaca_eval/decoders/anthropic.py sha256=h2o4BLkf-TC3_MYiqUndCpy8MBi_4B0FZbEw8PmiVZA 6202
alpaca_eval/decoders/bedrock_anthropic.py sha256=szjSVQjkHGhwBwbVJosec2A80jfZE9knwP-6UT9R2OU 4070
alpaca_eval/decoders/cohere.py sha256=t-l4dwOcKqQ4dL7Fm6efIeOqticWePCcNoi20KhVszM 3290
alpaca_eval/decoders/google.py sha256=-sEUvBEDJZhTxXhJBTIYwHiRASWLwV4nBOoUUHKOzJk 5078
alpaca_eval/decoders/huggingface_api.py sha256=eG0OgBD5oNLbnWduBIBTkALTcZds3EPH_Xpk_Xo7auI 3651
alpaca_eval/decoders/huggingface_local.py sha256=3wy2BPGoT7bGFYXX0CTPV1dFAE8BcQQq3pzvo2PL2DA 5441
alpaca_eval/decoders/jinachat.py sha256=62T-cWyCVdLL67m70G9Z0KjywUQZ-LVtcuTxBixbT3k 3120
alpaca_eval/decoders/openai.py sha256=I63HLeV1ScqbndpohzPX2Uvwk438X-EiXvs7VOwsuus 14531
alpaca_eval/decoders/replicate.py sha256=QyNg2-Hq8zlrMHYddHVuLl7Zae6z8sS058Yb08qhAR4 2440
alpaca_eval/decoders/vllm_local.py sha256=NZro9OmvbEZbReQ3JGRapoLjT7GdfGC6IFgAQmXuo1g 2891
alpaca_eval/evaluators_configs/README.md sha256=--pRV-y7aghLUzgMKJVL2RVQ-GtcYflmRKIuE6CClrw 10038
alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/alpaca_eval_clf_cot.txt sha256=Aq3rWPVwfGrujPkN-It0WfXNhnnZW_gW52TbcgUZ87A 1655
alpaca_eval/evaluators_configs/alpaca_eval_clf_cot_gpt4_turbo/configs.yaml sha256=6sg7-nVNio3piY8A7AC9tskIjH6yp14rrlv5YkG5s9w 643
alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/alpaca_eval_clf.txt sha256=eEIn5twoMvwIxD0sjqOjCOdSN4AYehqq0vheMLrIX2I 1398
alpaca_eval/evaluators_configs/alpaca_eval_clf_gpt4_turbo/configs.yaml sha256=hp209mapy_M4w6XJY36xt9kjtUO5-vA0guiEXPGSHdY 550
alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/alpaca_eval_fn.txt sha256=EkkNcwb83MbTljrgPqDRbAQ8--Ly0Qp_82ditsFYCy4 1206
alpaca_eval/evaluators_configs/alpaca_eval_cot_gpt4_turbo_fn/configs.yaml sha256=bQcksllZoHOfSdCC11VjObbRRfUq7r5qIQwv1DC55L0 1815
alpaca_eval/evaluators_configs/alpaca_eval_gpt4/alpaca_eval.txt sha256=z0us5D-mrHGUS5yiUGWHrXxQlHiiGemKOVCr-dW0Kpg 1204
alpaca_eval/evaluators_configs/alpaca_eval_gpt4/configs.yaml sha256=Z2cX05ktVZMH1jZh7xJxEy39YTEA90f2zo1Ypwd8Yj0 270
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0314/configs.yaml sha256=EO6tHSlkdRzwe1n7gfx6-ZWCMu49NJG5ATL-l_OqOE4 263
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_0613/configs.yaml sha256=qAM-6iHl5hYYE0Hr5_hJ0oRrmricSN2DkdsFOWMfGaI 263
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/alpaca_eval_fn.txt sha256=9zTCMVT1nvo-SCQMoNHfbyAgvQVvstLML4iuuddbYFQ 905
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_fn/configs.yaml sha256=5ikW6_YUAmpWLs4DUWhS_C2VHGGiYP3QPJjYn7dyIO4 1477
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/alpaca_eval_fn.txt sha256=EkkNcwb83MbTljrgPqDRbAQ8--Ly0Qp_82ditsFYCy4 1206
alpaca_eval/evaluators_configs/alpaca_eval_gpt4_turbo_fn/configs.yaml sha256=Lmead4blXpwdDOtP1eymFKL3-Q21gulLdHoJUSJqeP4 1593
alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/alpaca_eval_fn.txt sha256=z0us5D-mrHGUS5yiUGWHrXxQlHiiGemKOVCr-dW0Kpg 1204
alpaca_eval/evaluators_configs/alpaca_eval_llama3_70b_fn/configs.yaml sha256=6FZZLHn7uiRCNOw2cfRkqg2WeeamOvWFkukuhpxmhxY 416
alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/alpaca_eval_fn.txt sha256=YP345AV9hiqO1HfeUv8fcej9E6UCdFeeLMjz0sl_Cb0 1201
alpaca_eval/evaluators_configs/alpaca_eval_vllm_llama3_70b_fn/configs.yaml sha256=YWAwp2f9rquxUihV4qmecvkP9sHNdgW1zanOIzNus8I 554
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_v0_without_inputs.txt sha256=4VRVSzcJpnryc8yHTx3K3aK4WWFpwZzjKB0gBQMVP1o 1650
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_chat_without_inputs.txt sha256=Cll_ks6pOhHARQ0yGxFssI4C_umPPJwUxCKv6aX0TRs 5869
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_cot_json_without_inputs.txt sha256=yZ7au5tYkFdFCgOzbl8gfu8VzKKqK2LMOx2-9Oyxw-A 2475
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b1_without_inputs.txt sha256=bQe5XEzsMFMBZXmD21NJwBcf5fhVpnXAm_plQyOonJ4 3721
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b4_cot_json_without_inputs.txt sha256=VK2beVTCnIavX-q2i0lWZrAA8cLMI0Efa4P4oaoSHxk 3423
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_diana_without_inputs.txt sha256=s9T1FPC3yxAexzb0a9SZOzg9444jzrKraYRvNzDSRV0 6849
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_joe_without_inputs.txt sha256=q-s4owUh0sIGwIiCfyK0Xs8IyOwLS2eHukRyH47XFpM 6797
alpaca_eval/evaluators_configs/alpaca_farm/chatml_b5_without_inputs.txt sha256=6gfwH7o3IaZqaOW9bqglvn2HmUzGK7IkCEVreIfGKIc 6700
alpaca_eval/evaluators_configs/alpaca_farm/configs.yaml sha256=Dtrmj42kXO3wjeQn5M6rBuDJcS1nIg-eFQs1RC53UuM 6045
alpaca_eval/evaluators_configs/alpaca_farm/text_b1_v0_without_inputs.txt sha256=24FS2HDAuG5xEcloqKnUNqdXd_dNbdW4O2_2J3UpA8Y 1016
alpaca_eval/evaluators_configs/alpaca_farm/text_b1_without_inputs.txt sha256=IYW9P6ETBgN2F7Ik8qjEollpWTuu92KqORcSF5KuNac 3969
alpaca_eval/evaluators_configs/alpaca_farm/text_b4_reasoning_without_inputs.txt sha256=RyfwflTDqRso7HTUZJs_mV0eSyfC9ybMQdT_5SO0XUg 5932
alpaca_eval/evaluators_configs/alpaca_farm/text_b5_without_inputs.txt sha256=cv6mHjAODbT1v9eDjI3ToOFMdKmnuUGiDR2jXaiysnI 5370
alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/chatml_b5_without_inputs.txt sha256=dr3cjE02RI2kyIKHsqOWyMzp4bwvBBguBNHVKx-tH04 7373
alpaca_eval/evaluators_configs/alpaca_farm_greedy_gpt4/configs.yaml sha256=U4sd7U_DNeMAM6Tn5CQM1Jt9nAzzOqypizG7w05Aiww 362
alpaca_eval/evaluators_configs/aviary_gpt4/aviary_prompt.txt sha256=BL867OYK2tnxjR2T65kEOtFQLQShlhtC7py8TBUZd7o 1048
alpaca_eval/evaluators_configs/aviary_gpt4/configs.yaml sha256=qGy-Ry647x_8jTHD8mCu83zdunWkfMD_P7mnKtdUMQc 324
alpaca_eval/evaluators_configs/bedrock_claude/configs.yaml sha256=4exFkwDMahl1UKmPPX7Zl6wTq1jMYWp-eTN62_sVoF4 353
alpaca_eval/evaluators_configs/bedrock_claude_2/configs.yaml sha256=h3Hu5QQOkfyBDkdnTAR6bV3S0vS5fv5_UIRoVvthjW0 355
alpaca_eval/evaluators_configs/chatgpt/basic_prompt.txt sha256=rwQQTdGqV2oCmSi9jQWia4iLAR-7vjJ8Yt26ymh_UKU 1116
alpaca_eval/evaluators_configs/chatgpt/configs.yaml sha256=z5rMMY7ppnDBkmlKAs0AMaeXciM3t-BL122jxVTK3fk 325
alpaca_eval/evaluators_configs/chatgpt_fn/basic_function_prompt.txt sha256=35qjKHOV1dy5PwpQnBY69T1HgR_u_xlx057egWH5Jwk 1197
alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml sha256=L0oNdcYETEJk-MmHeiK3KE-xjeyYfpO3LmcByxtT_z8 886
alpaca_eval/evaluators_configs/claude/basic_prompt.txt sha256=-eqQpv17cZMhcY4NVY2VcFMzyFzkrYrgtilyzzPQvco 1137
alpaca_eval/evaluators_configs/claude/configs.yaml sha256=kzFUCCwDehO-uOuKp09HyELhVshyl4lxfqvC9I3beGw 367
alpaca_eval/evaluators_configs/claude_2/configs.yaml sha256=niC56E_ruq3dRvk9Y1mzyUndf0S6M_B6WiOZB_OlPjU 368
alpaca_eval/evaluators_configs/claude_3_opus_ranking/configs.yaml sha256=v80QSajOyrXfRJp-z0XoqfvoyqGa0_7jSRYoG_4kGeM 322
alpaca_eval/evaluators_configs/claude_3_opus_ranking/ranking_prompt.txt sha256=qKxRToezBjZ2AKtyEkW-ClZCa5RXuEi6vmd9alIBpCI 1094
alpaca_eval/evaluators_configs/claude_ranking/configs.yaml sha256=fKDNFyy7sfHmlO5kegVfs5RMWxRlCC_-kOiDy5NAXLs 269
alpaca_eval/evaluators_configs/claude_ranking/ranking_prompt.txt sha256=OfHk_hUfoJKhH6gJCDr99pzAZlBsR53Ds02vG-Z2a08 1087
alpaca_eval/evaluators_configs/cohere/configs.yaml sha256=-cNayFIGhr8CZdz0VLyrQIV4GjZkY12NTMQ8rzwtlwQ 310
alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/configs.yaml sha256=Fs-IaDj-67yZeqXI1BBjHqvynNaKkau-1e5D4Gp3Nk0 289
alpaca_eval/evaluators_configs/gpt-3.5-turbo-1106_ranking/ranking_prompt.txt sha256=z0us5D-mrHGUS5yiUGWHrXxQlHiiGemKOVCr-dW0Kpg 1204
alpaca_eval/evaluators_configs/gpt35_turbo_instruct/configs.yaml sha256=BVqZa6wvYoZZxjbrVluwe_aoeYDO51P05evCHk5OW64 351
alpaca_eval/evaluators_configs/gpt4/configs.yaml sha256=3qG3NBGx2uHev1Skl9vcXf1-MC3GY8J8UeLEblESS1M 314
alpaca_eval/evaluators_configs/gpt4_turbo/configs.yaml sha256=6DXjx8dmBeStOVnMgH1gB_aoRaXt9sRi0ZUi-jXs8S4 328
alpaca_eval/evaluators_configs/gpt4_turbo_clf/basic_clf_prompt.txt sha256=64ulGN3dpHwNoP2ui9n_tYRpqcUfyenxFy8AQWhVo9U 1005
alpaca_eval/evaluators_configs/gpt4_turbo_clf/configs.yaml sha256=K3qNyVtTDNvMVv-dWutU2d_1C-wr7DTrdoxgio2keAA 528
alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/basic_clf_cot_prompt.txt sha256=fH1B9USktWpO6AwOHAHrdSXah_Qu_KOHpgRa1smwPDM 1266
alpaca_eval/evaluators_configs/gpt4_turbo_cot_clf/configs.yaml sha256=U-eT0TV1p0Bkb4eWwmT14jdFR39o8iChe7RIjHQvMH4 565
alpaca_eval/evaluators_configs/gpt4_turbo_cot_logprob/configs.yaml sha256=joEkqdEM22D1Wdn1zVpm54L85HLsTcSNi_W5LcwmN2U 570
alpaca_eval/evaluators_configs/gpt4_turbo_logprob/configs.yaml sha256=K40jgDMsiWZL2FFwulAhdxpCF0B-Qqaum4U8pAM66Kw 533
alpaca_eval/evaluators_configs/guanaco_33b/basic_prompt.txt sha256=xBgbTZlelyXRLn_Q2X3OLLE4lV_Pg7pq20gVxCVMDdA 1298
alpaca_eval/evaluators_configs/guanaco_33b/configs.yaml sha256=si-gfneuNq6FVkGuvETwSeREYTx3S2_3eBh6hSCF_EM 452
alpaca_eval/evaluators_configs/improved_aviary_gpt4/configs.yaml sha256=HYsADbFZ_2CWMIQH4RlC0t2KX_l3Ro3gTLgOASzvj2M 322
alpaca_eval/evaluators_configs/improved_lmsys_gpt4/configs.yaml sha256=imCB9vrHIJCu1SIHFlGvMS6SJlv6b_M3uqpEJU4Bpik 317
alpaca_eval/evaluators_configs/lmsys_gpt4/configs.yaml sha256=AImjL3flznl5i8EHC-OH1CPhnDSToRf0-X9pIZV1QPU 319
alpaca_eval/evaluators_configs/lmsys_gpt4/lmsys_prompt.txt sha256=-uJdKpGLh316NJdWlsW3BiTnvlbSVUhZbcJxKmHQRqo 1051
alpaca_eval/evaluators_configs/mistral-large-2402_ranking/configs.yaml sha256=W80F3DPZwlcckaO5W_Fe-6OP2rzptgLFVxaHzx3XP8I 398
alpaca_eval/evaluators_configs/oasst_pythia_12b/basic_prompt.txt sha256=UaRuxfczwfI1keeluht1ZBMnnNRphTIghNkhz-M_Ysk 1054
alpaca_eval/evaluators_configs/oasst_pythia_12b/configs.yaml sha256=4bNuCEpLUwL1xR2eOR0udE81lRhcVK4zl6BVstlwNzs 367
alpaca_eval/evaluators_configs/test/configs.yaml sha256=UWUcEZBhPwkb7UfPV5T_e69rdNQS2rjDv_1ZefIKhnU 329
alpaca_eval/evaluators_configs/text_davinci_003/basic_prompt.txt sha256=lxxVEKg3FjfxeTuJ0QpFVsRSBw4gRXLzUU04xxyUMh0 1017
alpaca_eval/evaluators_configs/text_davinci_003/configs.yaml sha256=yHQT2yNxBOZ7-7RMvjOW7aORc--ZZi-8BghvE0Z5uRs 341
alpaca_eval/evaluators_configs/weighted_alpaca_eval_cot_gpt4_turbo/configs.yaml sha256=fzu9hgjDmaPfWVOPLNVF-Zh7fYW-OBxZ0cGtlARoKHc 593
alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo/configs.yaml sha256=_VxlbZlZ_9Y7mGyCFqgeg-AB0XztWgje_ByFfOndAz4 556
alpaca_eval/evaluators_configs/weighted_alpaca_eval_gpt4_turbo_new/configs.yaml sha256=C9hYDBvKKMA418Ra_PivjI1Bj_Qn5iTfiL_JD1eiVY8 553
alpaca_eval/leaderboards/data_AlpacaEval/alpaca_eval_gpt4_leaderboard.csv sha256=moa7jNFpZ6uUeWym5StjoUzrWclTGU7AZO3-aQ-4LtY 10033
alpaca_eval/leaderboards/data_AlpacaEval/chatgpt_fn_leaderboard.csv sha256=4RR_bcm4i0RvvHXXnaTkORPSjG5PYXLclohuljhK2Ko 898
alpaca_eval/leaderboards/data_AlpacaEval/claude_leaderboard.csv sha256=6J5OHNr-6iwR-7JPdnUQUPzf0Fu_WWIqApYqjC9lUAs 2402
alpaca_eval/leaderboards/data_AlpacaEval/text_davinci_003_leaderboard.csv sha256=L8DQ_8Xm02hC0Gq6b-6kQtfxqqRoUC7VseR012xx6hk 351
alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_cot_gpt4_turbo_fn_leaderboard.csv sha256=67lJL1ZQ7bDujwu2qwSR4Tc9vfm9J4h8m6nE-hd3VNU 1307
alpaca_eval/leaderboards/data_AlpacaEval_2/alpaca_eval_gpt4_turbo_fn_leaderboard.csv sha256=osOTquFlLog6des8oqmDjHJs6cO1U4XwdIAV8Pv3Z10 1027
alpaca_eval/leaderboards/data_AlpacaEval_2/claude_3_opus_ranking_leaderboard.csv sha256=GlDVq0Zu-tXot2qGJbkpQ85ScdR3ayJEAcDONgsdzsg 766
alpaca_eval/leaderboards/data_AlpacaEval_2/mistral-large-2402_ranking_leaderboard.csv sha256=gNpnu59nZO3tacQxUDETFaINcH9xuIplXedDpjKL8KQ 767
alpaca_eval/leaderboards/data_AlpacaEval_2/weighted_alpaca_eval_gpt4_turbo_leaderboard.csv sha256=NVGG6PeL0HFFzgqrillwoiEd9GTzUwm5EunEcDHfIDg 25880
alpaca_eval/leaderboards/evaluators/evaluators_leaderboard.csv sha256=e19Lw4XP3rPzoE45P5nyB1Nat6ymbUZGv4zsgzLwU9c 5986
alpaca_eval/metrics/__init__.py sha256=g4_i-0Ytrl-luO5gwAUhHpRn0JRS5gFWbkw8Cle8890 201
alpaca_eval/metrics/glm_winrate.py sha256=K61arNSNoTuFtIkCiUQPpZoBqHYGdGRh020kCWTB9wI 16184
alpaca_eval/metrics/helpers.py sha256=QFsM1nh5YPgVjEvGPAvxzxGgOKiuabibqpW36oPFCpA 7140
alpaca_eval/metrics/winrate.py sha256=TzWY0eNe8KednhGdDCeF-NdRPG30ACxH7K2lbkZLajc 1189
alpaca_eval/models_configs/Conifer-7B-DPO/configs.yaml sha256=wohPWAlMUtl5dTGTO_05BhKy2l33PwxMDeMPh7qJy8o 376
alpaca_eval/models_configs/Conifer-7B-DPO/prompt.txt sha256=WsTBbeQYSdN684jIt7iIZItZQ8WqRSi1RO-cm00Q7XQ 50
alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/configs.yaml sha256=6dUOr3xSwQBBU8QvM63HTj6kSxq-ReScDNYwk4b5U1A 676
alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM/prompt.txt sha256=SRlDv0pFl6WGz5Ad_C2E8iJo1_2kkDLmvlyekhokSXE 36
alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/configs.yaml sha256=IShysWJC_pA-e_GEmaR9vkLWuzDYUZgB8yMA99JFq8o 654
alpaca_eval/models_configs/Contextual-KTO-Mistral-PairRM-Verified/prompt.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/Ein-70B-v0.1/configs.yaml sha256=_VPIEP_lW9R36tMRGb9HHKwzZgfhmrqIo2rhH46CFsA 772
alpaca_eval/models_configs/Ein-70B-v0.1/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/FsfairX-Zephyr-Chat-v0.1/configs.yaml sha256=9ExyCgQjsbnZhu85HtzB17cTLi2PyupuEDHphfogzSo 453
alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/configs.yaml sha256=4UXeZcBTtTXltPEsc_G2y3GGb63ubVGnMbdVgMK0f-g 830
alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Llama3-70B/prompt.txt sha256=3hCRJVU0uRHhLw8_KVJtEhpzTrGIr70cR5hVX_DGsbs 128
alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/configs.yaml sha256=TAEN0msAM3Nk-2O_OqnoLaUV4H4Agb1YunyqHOPFKbE 830
alpaca_eval/models_configs/Infinity-Instruct-3M-0613-Mistral-7B/prompt.txt sha256=CrpUVbJ9Kn0XDybHpjHngGAKm4LnXzjAKZ9ae8TRVx4 292
alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/configs.yaml sha256=4yX0ygAvG_eN1JTtKOv1hEHTKs6Xqs9vF8hSl3A5l_s 830
alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-70B/prompt.txt sha256=3hCRJVU0uRHhLw8_KVJtEhpzTrGIr70cR5hVX_DGsbs 128
alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/configs.yaml sha256=Fcoy7QHTDHQNckXP9wG_sjcgz_7pckJvK88o5FPvWv4 825
alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Llama3-8B/prompt.txt sha256=3hCRJVU0uRHhLw8_KVJtEhpzTrGIr70cR5hVX_DGsbs 128
alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/configs.yaml sha256=m8gR6WzOuomgLXO7UKBhM3r1zmGJV2rK_7qigVYPKGk 830
alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Mistral-7B/prompt.txt sha256=CrpUVbJ9Kn0XDybHpjHngGAKm4LnXzjAKZ9ae8TRVx4 292
alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/configs.yaml sha256=FTeH1rsv8uQcyvcL4hYybXIgj4RkcLZ8gFmZmNPbn1U 820
alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Qwen2-7B/prompt.txt sha256=EE1z3-KdHosCIH7QHpeYhTNNP7plqAy6dDnLmmk34JY 98
alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/configs.yaml sha256=0IyeX_TozhuJrN-6KNKkWPHUgjLLmxmBpPMuMMjDVCk 825
alpaca_eval/models_configs/Infinity-Instruct-3M-0625-Yi-1.5-9B/prompt.txt sha256=I9hqrz7HepJ-R9HRoGpLqpu3Lt2rKEK6K3apKOhu5b4 40
alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/configs.yaml sha256=TQuCKPPnMAWltR178jIEOdzZI0wTnJzpQotyue2li8U 835
alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-70B/prompt.txt sha256=3hCRJVU0uRHhLw8_KVJtEhpzTrGIr70cR5hVX_DGsbs 128
alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/configs.yaml sha256=CXeMTldDVc8uFe_52OhfkQjCwOVGrIVzFN3Y8ZJEkvQ 830
alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-Llama3_1-8B/prompt.txt sha256=3hCRJVU0uRHhLw8_KVJtEhpzTrGIr70cR5hVX_DGsbs 128
alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/configs.yaml sha256=Owe0rZIdEFSwkjqi92u1jXk7WdF9sfUC8juV-DqkTls 825
alpaca_eval/models_configs/Infinity-Instruct-7M-Gen-mistral-7B/prompt.txt sha256=CrpUVbJ9Kn0XDybHpjHngGAKm4LnXzjAKZ9ae8TRVx4 292
alpaca_eval/models_configs/LMCocktail-10.7B-v1/configs.yaml sha256=4urn1P5iDLEe-JFgAyvDymDlsytVwWE7I1nv-dZLImE 488
alpaca_eval/models_configs/LMCocktail-10.7B-v1/prompt.txt sha256=B1Y_o1VTLPfpjt_p-_tnBm7oLFN1us0mQEibQwaimIs 344
alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/configs.yaml sha256=6YIPti9cNHimV6dQYI92Shv171MskIUI9Wi2mTuIKLo 509
alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO/prompt.txt sha256=OfZalJN09tTGeGW_Y1zJCgE2WfY07Uq0Ad2lQ7yqoR0 130
alpaca_eval/models_configs/Llama-3-Instruct-8B-SimPO-ExPO/configs.yaml sha256=Jm1_tdCaR2xz9WR-YOc7LRfKL23NPvgaY23Rb6ANGpg 594
alpaca_eval/models_configs/Llama-3-Instruct-8B-WPO-HB-v2/configs.yaml sha256=I6_kp_EeRazxkmLPyfSkz-fViDCatt-jaFkNrRHBLOQ 558
alpaca_eval/models_configs/Meta-Llama-3-70B-Instruct/configs.yaml sha256=sO8U9M_25EUODgqyw3Hv_-GHiX5ka9mxr33m8qsgXPo 452
alpaca_eval/models_configs/Meta-Llama-3-8B-Instruct/configs.yaml sha256=Z2rMKifolNFaodh5tmfXtZ37Zya2a1CectSku6tXZ1I 448
alpaca_eval/models_configs/Meta-Llama-3.1-405B-Instruct-Turbo/configs.yaml sha256=K2vMuS7j0ThZQ-Prd23iJkIGWvM7IkJZEQQNO0wbCOQ 454
alpaca_eval/models_configs/Meta-Llama-3.1-70B-Instruct-Turbo/configs.yaml sha256=8vxtshpDBrirphAUJYQdv58EiioZbaYj704GpQnbQug 451
alpaca_eval/models_configs/Meta-Llama-3.1-8B-Instruct-Turbo/configs.yaml sha256=V8gHak-iOWq0b73k1T2ATtQ4GW6-iIi2PoEF3G1k6ZM 447
alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/configs.yaml sha256=ao2Frqy1198vWiZyd4_u2XpkQnB0u9CVseVb-ivGK5s 453
alpaca_eval/models_configs/Mistral-7B+RAHF-DUAL+LoRA/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/Mistral-7B-Instruct-v0.2/configs.yaml sha256=vtN7KkihgJvQXlTHVL1L2y7eeMkhgit_cDmnfQH9bRo 483
alpaca_eval/models_configs/Mistral-7B-Instruct-v0.3/configs.yaml sha256=uK7GzDciLXNDSzLqk4fT5cLuYYp3JIsjhPgTr9jRWas 457
alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/configs.yaml sha256=3n84ZPvzeRAZjKV0Z8yzljcoizcgQZGE4-SyxbztrAo 434
alpaca_eval/models_configs/Mistral-7B-ReMax-v0.1/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/Mixtral-8x22B-Instruct-v0.1/configs.yaml sha256=bw2d3S4adB-414iGqcucG1i8FR9hvee6H0DOFBbqpHo 460
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/configs.yaml sha256=PrL2fqRcXJxnCEJiSp7lmFjwFi5Ee8LBNsvKwakZVSE 491
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1/togetherai_prompt.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/configs.yaml sha256=bwUylgKa6Ai9svJ_WEQe1l4-2QXjiUpEJw3_BumBCmA 488
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_concise/togetherai_prompt_concise.txt sha256=TsjyeFWXFeDLyZjJQgJC5DMdOLFrw73XAPVJ7Ng1nAs 143
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/configs.yaml sha256=wj74j2wisIBjdaRRxu9OiA7xmDoIZGPw-fIEPogalAg 488
alpaca_eval/models_configs/Mixtral-8x7B-Instruct-v0.1_verbose/togetherai_prompt_verbose.txt sha256=IbEkMM-iCIqNrynY_yzOtpgEEGvBkU21si21xDma4UM 81
alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/configs.yaml sha256=okPPP8uZmiCxu2SCYM3ooppNZ9faRCT53kAUoe83Mr4 419
alpaca_eval/models_configs/Nanbeige-Plus-Chat-v0.1/prompt.txt sha256=tCLvnQQuKbHklEkpx0uVVAOEj6_8nqBJb-dVCii1EP0 696
alpaca_eval/models_configs/Nanbeige2-16B-Chat/configs.yaml sha256=g7KgHoTry7JyOXkVurY5X4_4zYQveauUZQACARxUYU8 459
alpaca_eval/models_configs/Nanbeige2-16B-Chat/prompt.txt sha256=oU7zgHT6t6RS92AHtaGtBRw7KMcD3UCoL3Ec1Ejat2U 648
alpaca_eval/models_configs/Nanbeige2-8B-Chat/configs.yaml sha256=Gtp7JwzbbuPNSmsMfRcHn3YF_7v7JY21KIGyhQKlq28 382
alpaca_eval/models_configs/Nanbeige2-8B-Chat/prompt.txt sha256=XHF3y3wv1mK5E52-_9iI-t1uQGD9N_hTNuQdXrXm6FM 671
alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/configs.yaml sha256=_FFTD7r7RiCEHOA62WRMhOWhZQeQhVxR9vIAJsRzizs 493
alpaca_eval/models_configs/OpenHermes-2.5-Mistral-7B/togetherai_prompt.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/Qwen-14B-Chat/configs.yaml sha256=UjJvogANe_tUngYI4wlkkV9paJLpSyADaD5yIWFP3vA 467
alpaca_eval/models_configs/Qwen-14B-Chat/prompt.txt sha256=E8xe9wyYrLGzPaTco7iTaa3sJcJ3U4k5lN-p_nB4Dns 63
alpaca_eval/models_configs/Qwen1.5-1.8B-Chat/configs.yaml sha256=bhpgG2UC646uiqcZn5iGYGA0prHEQBNrOIqXgf5vvvU 452
alpaca_eval/models_configs/Qwen1.5-110B-Chat/configs.yaml sha256=FVsj77akyJlES-DpQL19Uv1uyOHDoAx4EEaZv1lx8i8 446
alpaca_eval/models_configs/Qwen1.5-110B-Chat/prompt.txt sha256=r7l3eAAI7XpdcoYlTN2O9LMp_a2sIGqDpzeb6pcqrcM 99
alpaca_eval/models_configs/Qwen1.5-14B-Chat/configs.yaml sha256=HCvKEJW5GKBt35Dnhs01Y6EGcp7M4nxWMppxPvRw3J4 448
alpaca_eval/models_configs/Qwen1.5-72B-Chat/configs.yaml sha256=9o1KuMvIGpN6RZj5bxXA7Y_YVGcXJP5wYdfH4De9-DA 448
alpaca_eval/models_configs/Qwen1.5-72B-Chat/prompt.txt sha256=r7l3eAAI7XpdcoYlTN2O9LMp_a2sIGqDpzeb6pcqrcM 99
alpaca_eval/models_configs/Qwen1.5-7B-Chat/configs.yaml sha256=IQ391__HgM574f-Ni5xOmMGfel8W5RxF3er9BGYs8yg 444
alpaca_eval/models_configs/Qwen2-72B-Instruct/configs.yaml sha256=TCC2Sg3zvBHHfYzcaNUV3if3Ce83RdHE-_AhQ-30tAU 382
alpaca_eval/models_configs/Qwen2-72B-Instruct/prompt.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/configs.yaml sha256=wA_PhjJ7QVVg0rpmy25AKWvgNv_FPy0lltPXz7oGNXk 476
alpaca_eval/models_configs/REBEL-Llama-3-8B-Instruct/prompt.txt sha256=zNjneVZIqEvvtMNcSJiwFJBtjtOE0Rt39cRCfZcrYD0 112
alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/configs.yaml sha256=K-BazxdjyF4AvMqdsonBtppbTtqTs5w7xsw_geFRXLQ 583
alpaca_eval/models_configs/SPPO-Gemma-2-9B-It-PairRM/prompt.txt sha256=ra9cCavG99c8UKv7-pq3WJDB8LF0-uFhK9NlyNms3iE 72
alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/configs.yaml sha256=YRYstL4HDsSOkLU9_RbvVc-dLjD6cR4jw8nXIsr3Nik 520
alpaca_eval/models_configs/SPPO-Llama-3-Instruct-8B-PairRM/prompt.txt sha256=OfZalJN09tTGeGW_Y1zJCgE2WfY07Uq0Ad2lQ7yqoR0 130
alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/configs.yaml sha256=asO8Q9NbjsDJVvxDOmwKHxublNvSRZX8KjIc8Q69J2w 564
alpaca_eval/models_configs/SPPO-Mistral7B-PairRM/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/SPPO-Mistral7B-PairRM-ExPO/configs.yaml sha256=j-vFPvQCBN1sBDgcPQl34fMeKveNpOnCsks5-AnKhKE 574
alpaca_eval/models_configs/Samba-CoE-v0.1/configs.yaml sha256=0YJGaSI9FO0-4v0CPx4exOeGNM7uIgBv8-L7S62qArc 361
alpaca_eval/models_configs/Samba-CoE-v0.1/prompt.txt sha256=kI8MC7ikclXO-9TjdVWtsIx0adk9Zk__75fGwe2idrU 428
alpaca_eval/models_configs/Samba-CoE-v0.2/configs.yaml sha256=oDudS4QVcjuMMJRNOv81qN7EJZ-jKA9xsQJ8pv_TiCk 361
alpaca_eval/models_configs/Samba-CoE-v0.2-best-of-16/configs.yaml sha256=wNQICaf3xY7ltoIwtUz6UlU72v-TR-w1l5qeAmA_QuA 385
alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/configs.yaml sha256=7IVtfU6a4egyUEE_0WTNk5QJPKILVBxjhzIUWdmWm18 722
alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO/prompt.txt sha256=La57oXsb44fGIaCXqUmtqYfrhzIknQ6MkJg2PLq4G0I 31
alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/configs.yaml sha256=zAV44kmNhzCQSOSUV8iJqPYy57p80LYCQDYVQQwM0Ks 827
alpaca_eval/models_configs/Snorkel-Mistral-PairRM-DPO-best-of-16/prompt.txt sha256=La57oXsb44fGIaCXqUmtqYfrhzIknQ6MkJg2PLq4G0I 31
alpaca_eval/models_configs/Starling-LM-7B-alpha/configs.yaml sha256=BjAas0I9IYJ_GPqiTXYEc3ArdnYvzHnA_feOKqQh4zM 435
alpaca_eval/models_configs/Starling-LM-7B-alpha/prompt.txt sha256=iBbalHHywhjz86p6mQiRyAXzWCIJVsS0PpIznE42g04 70
alpaca_eval/models_configs/Starling-LM-7B-alpha-ExPO/configs.yaml sha256=YeT4wwXUI3tNDXN0phfMB0Vs632VSPwDyidwwJwSvSU 576
alpaca_eval/models_configs/Starling-LM-7B-beta-ExPO/configs.yaml sha256=Aha0AKR6a-WsXEmSowPBGNDj1zu24H0dVTUrnN-gbNU 572
alpaca_eval/models_configs/Storm-7B/configs.yaml sha256=Et9NnDfmkzgNeDIb9dMrcClMSYVkgojtcJzjSgfa9uY 334
alpaca_eval/models_configs/Storm-7B/prompt.txt sha256=iBbalHHywhjz86p6mQiRyAXzWCIJVsS0PpIznE42g04 70
alpaca_eval/models_configs/Storm-7B-best-of-64/configs.yaml sha256=a4pHvc93IDedG53V35hYE-moxXM23MR7m4WtwI2163M 351
alpaca_eval/models_configs/TempNet-LLaMA2-Chat-13B-v0.1/configs.yaml sha256=UUc7jjXmvz256CnMOS6Md2fNy5Fge2FrYXsWhBLxBtg 406
alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/configs.yaml sha256=Dud09CZHmAIshcpDBj2zJ9t1e2qClpi59osFpmI4UsQ 407
alpaca_eval/models_configs/TempNet-LLaMA2-Chat-70B-v0.1/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/configs.yaml sha256=nhUNhYG0JmfIWqCBptoo0KvuH6iATJiWEweJ5-v8g-Q 403
alpaca_eval/models_configs/TempNet-LLaMA2-Chat-7B-v0.1/prompt.txt sha256=JlUi3JsCiHISbsxcmAKY0YV81uoUOgs8rNsducw6ERc 558
alpaca_eval/models_configs/Together-MoA/configs.yaml sha256=nVUlqevsFCbz458zw1OYxX9A1jYvzSBbY34BKc1OaGw 344
alpaca_eval/models_configs/Together-MoA-Lite/configs.yaml sha256=DB0mnrmwkM_w3EpQRlH7Wqg6XuaEUxjp8zzi7jKYB_s 358
alpaca_eval/models_configs/Yi-34B-Chat/configs.yaml sha256=AQXfDz-8Y6qu7kXbvfBN2AjdoTOT7W-rWFfv3UbaX_8 432
alpaca_eval/models_configs/Yi-34B-Chat/prompt.txt sha256=E8xe9wyYrLGzPaTco7iTaa3sJcJ3U4k5lN-p_nB4Dns 63
alpaca_eval/models_configs/Yi-34B-Chat-Verified/configs.yaml sha256=fcmRwvK7rKURpJ7xVjZWZQN_CZquEaZcorg1IFHh5i8 405
alpaca_eval/models_configs/Yi-34B-Chat-Verified/prompt.txt sha256=gVMoe5Vdb0aB9c1wFPiGE75e8k5nVROSvconwpD0Igo 41
alpaca_eval/models_configs/airoboros-33b/configs.yaml sha256=RojwP5mDycbxowDd_vDHCOMOKa8t_Lrv34J_bo1ywuM 415
alpaca_eval/models_configs/airoboros-33b/prompt.txt sha256=7Len5nRwR3rPmHWgtiRZ5pGavle5XaLP2t5IwRZw2yA 171
alpaca_eval/models_configs/airoboros-65b/configs.yaml sha256=wCbPdu0yWeBYnvASjWgtcbm5gpZF5XU0hM54W5su1UQ 415
alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/config.yaml sha256=KmYtANEenPZpH4uwGezy6RPfA7FS82cWX4I-WL871Y4 435
alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/configs.yaml sha256=KmYtANEenPZpH4uwGezy6RPfA7FS82cWX4I-WL871Y4 435
alpaca_eval/models_configs/aligner-2b_claude-3-opus-20240229/prompt.txt sha256=RDX9mWKBAkd70N77DjoR7hcmQeQSfmYu7nYxYTBIt_E 98
alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/config.yaml sha256=v7m_Jyt5fUWixawMTqAI-pK5wOXVN1jZYtCo8hdKRTE 441
alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/configs.yaml sha256=v7m_Jyt5fUWixawMTqAI-pK5wOXVN1jZYtCo8hdKRTE 441
alpaca_eval/models_configs/aligner-2b_gpt-4-turbo-2024-04-09/prompt.txt sha256=RDX9mWKBAkd70N77DjoR7hcmQeQSfmYu7nYxYTBIt_E 98
alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/config.yaml sha256=rskjNaTKfAMiOZo8b73iJt7zGi3iv7utV6MdJqsYvEI 426
alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/configs.yaml sha256=rskjNaTKfAMiOZo8b73iJt7zGi3iv7utV6MdJqsYvEI 426
alpaca_eval/models_configs/aligner-2b_qwen1.5-72b-chat/prompt.txt sha256=RDX9mWKBAkd70N77DjoR7hcmQeQSfmYu7nYxYTBIt_E 98
alpaca_eval/models_configs/alpaca-7b/configs.yaml sha256=k2YoxKEb9zXxN7xSGn2GZmul8JSZprU2eLwiUnYXHmE 382
alpaca_eval/models_configs/alpaca-7b/prompt.txt sha256=NRAbw20QmXx9km2PIffRc67GUj86V9eIIblEqJklzco 152
alpaca_eval/models_configs/alpaca-7b-neft/configs.yaml sha256=pXOP1GFnCp519_4R7rxFkEt-4HA3teJ2ER-5vlTi_aI 383
alpaca_eval/models_configs/alpaca-7b-neft/prompt.txt sha256=NRAbw20QmXx9km2PIffRc67GUj86V9eIIblEqJklzco 152
alpaca_eval/models_configs/alpaca-7b_concise/configs.yaml sha256=KqlevP5CrR0MA7h53nGvXYLOcuBBf0cnu-UM39b2iEY 478
alpaca_eval/models_configs/alpaca-7b_verbose/configs.yaml sha256=vwhQlC6sbmSxCYBmRW-JTgdT89-it46r0m90h7pcl1Q 478
alpaca_eval/models_configs/alpaca-farm-ppo-human/configs.yaml sha256=JEOapM_OWv44Fyxm-wdBb6C1cji4cBwpl_UtuZKn_4U 433
alpaca_eval/models_configs/alpaca-farm-ppo-sim-gpt4-20k/configs.yaml sha256=wy5ibYQ4_BVIv0LdE63g5jc_5pIWWLSRQfsQrpD1A2o 456
alpaca_eval/models_configs/baichuan-13b-chat/configs.yaml sha256=t0vri-V1HE_3GQT_K0O2N0zwGumeB2C_DjwXXYHsdkY 417
alpaca_eval/models_configs/baichuan-13b-chat/prompt.txt sha256=hHA7taxoeGgAGyIov2caoGgST53HR8WVmsffifuxL-k 29
alpaca_eval/models_configs/baize-v2-13b/configs.yaml sha256=TekFFvDsDLkCPhWKgCCEU7GyPW4xQKeq6bZJCt7QmD8 394
alpaca_eval/models_configs/baize-v2-13b/prompt.txt sha256=49cS93u95lriRC1ArUlWyqrkbNyDWqUiPi1FFI64udc 109
alpaca_eval/models_configs/baize-v2-7b/configs.yaml sha256=6OZB3JFwJr35Yni-ayydjuAKtdTypfI14cPyLDrdz64 390
alpaca_eval/models_configs/bedrock_claude/configs.yaml sha256=Z4OXl4e9tvdUN9h7FybUzA5DB3lYF-ex19nQkxy-koY 227
alpaca_eval/models_configs/bedrock_claude_2/configs.yaml sha256=B7r1UXoZcEPEs10Xl21x5ZP6MTbxMDDe9gNxNNog8mU 231
alpaca_eval/models_configs/blendaxai-gm-l3-v35/configs.yaml sha256=DN-SHYoeVQ8JleRXYfnhl9tvyfsaoYZYrtQaIPsJUOk 298
alpaca_eval/models_configs/causallm-14b/configs.yaml sha256=XtmGqD8rTSsMTNbYStnmdBmyN6_nFWARW03SFH4qnWQ 392
alpaca_eval/models_configs/causallm-14b/prompt.txt sha256=lB3CRjiLrKGYFK_6mReCIHjCvqNVQrdw3Y6tLvlcAi8 123
alpaca_eval/models_configs/chatglm2-6b/configs.yaml sha256=uTLieoMKeYWgqMtZIXwoM3HYjWzroPV38D9IWwEjjhM 373
alpaca_eval/models_configs/chatglm2-6b/prompt.txt sha256=lvZkvjA8TZb9VpaJOlu0hYMTBVl_4MyTDUUGKVyqokY 43
alpaca_eval/models_configs/claude/configs.yaml sha256=3EdnA1Acpt9E5Ztvbzk4E1ePdeTvUuJcfFvVYVFrm-c 194
alpaca_eval/models_configs/claude/prompt.txt sha256=PvC8O9ekfFdmoh0MAWzKtEJyLz7rmqu_BC50YGd1lyc 34
alpaca_eval/models_configs/claude-2/configs.yaml sha256=DvqKBkAOXWJTY8Cv8OTmeMTVdTzPugZ1LrQKKHuDdVM 197
alpaca_eval/models_configs/claude-2.1/configs.yaml sha256=7LETdoGV-HU1wlJdGsjzx4CeBP0COYrHEyCyxFyDxj4 203
alpaca_eval/models_configs/claude-2.1_concise/configs.yaml sha256=vZkudeovLQJriM3rm3Z2sV_Xxd7XJy4V_wnbLpiMMgs 241
alpaca_eval/models_configs/claude-2.1_concise/prompt_concise.txt sha256=7QSdEYREcBdwzgdmvum-W0OC4tIIhlUOAOBpoGISfGg 136
alpaca_eval/models_configs/claude-2.1_verbose/configs.yaml sha256=2_asZrpaUQORrHPiQEfj0tCRdzJVWv5NrQLJnhkYdHU 241
alpaca_eval/models_configs/claude-2.1_verbose/prompt_verbose.txt sha256=ytOQDgaGUhBCldUPDgI8SPoNWMxBL36lsxCqFb2eUVY 74
alpaca_eval/models_configs/claude-3-5-sonnet-20240620/configs.yaml sha256=ce6Z1nfDQgjmMdHAZpyhq5BdSBtFDjEaV2FKxwsTaJ4 370
alpaca_eval/models_configs/claude-3-5-sonnet-20240620/prompt_chatml.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/claude-3-opus-20240229/configs.yaml sha256=zTfLmg5XOSj_wmC3Er8o2n1pTjrY3hKTK5xG0YIpb2Q 358
alpaca_eval/models_configs/claude-3-sonnet-20240229/configs.yaml sha256=F4ETT9B15UasXv9gJVro2TrOfQfq9RrJg89s47TeKcg 363
alpaca_eval/models_configs/claude-3-sonnet-20240229/prompt_chatml.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/claude-instant-1.2/configs.yaml sha256=1sEsXpNBfVMUXAFlu4GGSQo6HBSa0Nxp6ivPRyvQBOY 227
alpaca_eval/models_configs/claude2-alpaca-13b/configs.yaml sha256=psEyY4CRgjXC2X0IxGj063XI_BSFGb9CHBDgLyZj0H8 407
alpaca_eval/models_configs/cohere/configs.yaml sha256=DGSOfysfddMCsX1nc8OnfLQ7iX1bFMjva9Ne-qv7zRw 234
alpaca_eval/models_configs/cohere/prompt.txt sha256=9kTp7EdLbsJld0AetmPMdAyzo5UgyCYsuuEA30rI5JI 13
alpaca_eval/models_configs/cut-13b/configs.yaml sha256=TmoejdUqememZeVrgkKEYFO8K4vEiP-O6wbxg18cUNE 355
alpaca_eval/models_configs/cut-13b/prompt.txt sha256=NRAbw20QmXx9km2PIffRc67GUj86V9eIIblEqJklzco 152
alpaca_eval/models_configs/dbrx-instruct/configs.yaml sha256=zofJutMBPeNoc47kyy2fy4roiDS4OC5r4r95Gm_cCnA 416
alpaca_eval/models_configs/deepseek-llm-67b-chat/configs.yaml sha256=Mq5vd6MMxfRIHCI5MnRCeV7BOTswmfJlNoXw8lEr6mo 435
alpaca_eval/models_configs/deepseek-llm-67b-chat/prompt.txt sha256=2nWlVa3ftKkRHnTe93igfgFPlVuuzGx7V8Ln6ueSHfk 32
alpaca_eval/models_configs/deita-7b-v1.0/configs.yaml sha256=vjijTEhzQs49EuPhBACUMxu8MQgT6KMC6tges-iHpaM 368
alpaca_eval/models_configs/dolphin-2.2.1-mistral-7b/configs.yaml sha256=nXRga5oOWpPu_gIu3RKIV58-Zo9B3HmIfKgPj8HBNWk 483
alpaca_eval/models_configs/evo-7b/configs.yaml sha256=lNLUo1IWgr8W5cQSWD8lr8i66QWO-G8Psy0ieQoruKM 312
alpaca_eval/models_configs/evo-v2-7b/configs.yaml sha256=EcyeoTXWt2OG3vDVCr1ppcopclX4YIKCPX5ryMtp12g 350
alpaca_eval/models_configs/falcon-40b-instruct/configs.yaml sha256=A1-g5lZKRaMv8sjy4Fa72HwmwqbfatUQr6ctc0OnvRM 435
alpaca_eval/models_configs/falcon-7b-instruct/configs.yaml sha256=DX5sdQm5ZA0V9WLvzX4jpnvzrzDXTkrvVUWmGCfnu5k 761
alpaca_eval/models_configs/gemini-pro/configs.yaml sha256=JtL_GpwTidpPcS5_n5fVMBBuzUQbLSYnVOQB44pbjic 223
alpaca_eval/models_configs/gemini-pro/prompt.txt sha256=9kTp7EdLbsJld0AetmPMdAyzo5UgyCYsuuEA30rI5JI 13
alpaca_eval/models_configs/gemma-2-9b-it-DPO/configs.yaml sha256=mFIEDFt6nfqjXEsBtm4XR9t--m6G79_pMva1cjoxiLI 459
alpaca_eval/models_configs/gemma-2-9b-it-DPO/prompt.txt sha256=mUeQryOxm5iNiZo6DhPH75N2rzvlHjYXiI4xN3sybbU 73
alpaca_eval/models_configs/gemma-2-9b-it-SimPO/configs.yaml sha256=650qPmPBy-yL120fqM2IO49cIURB18M1WK6v0BMWbeo 467
alpaca_eval/models_configs/gemma-2-9b-it-WPO-HB/configs.yaml sha256=rJz06Tof4zJiZbcuPQ_QcOSlNI9cs484k-Fxk9yMwR8 532
alpaca_eval/models_configs/gemma-2b-it/configs.yaml sha256=EjOQqjBzK9LCIDEnZQqrIgD3ZpbXBw5E_NqPqXa08zo 442
alpaca_eval/models_configs/gemma-7b-it/configs.yaml sha256=qVZpDQleHm3j7a5w0rISKsdk-sjbv_tcqUKJcTO0XqA 442
alpaca_eval/models_configs/ghost-7b-alpha/configs.yaml sha256=xPZWlAPmnFL05aIcy-of4d4hAVolT4SojjkiRP2hWGQ 358
alpaca_eval/models_configs/ghost-7b-alpha/prompt.txt sha256=2w3khg7YIrWG7xWp6cYL9WEb8-zx7vYvsh8eozFlvIU 57
alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/configs.yaml sha256=vxxlgEwVzyJLzvWGjDolw3_48zPTpyFWZWBTH3gjQWs 515
alpaca_eval/models_configs/ghost-8b-beta-disl-0x5/prompt.txt sha256=-AeuPnPgcnYwrTt8uX85CbA2Nk5tUNwo2RAl3iGu6sU 136
alpaca_eval/models_configs/gpt-3.5-turbo-0301/configs.yaml sha256=_SHUwLud_etxDRUUh9MeVlaCbZb2xe93mhRSTpnXbrc 221
alpaca_eval/models_configs/gpt-3.5-turbo-0613/configs.yaml sha256=2gDLJKIjKEayQ7yQqj0OgePiRSSP0BE6oHD3C7qYVCc 221
alpaca_eval/models_configs/gpt-3.5-turbo-1106/configs.yaml sha256=V4jhWgwJiu2URGb3Vwuaxa5r8MgZZ66vB4i12i3Ppi0 221
alpaca_eval/models_configs/gpt-3.5-turbo-1106_concise/configs.yaml sha256=XtlgOb8Gjg9P2nC1AQ8dqumCFwdAFuGwXZMFJVnLhrE 265
alpaca_eval/models_configs/gpt-3.5-turbo-1106_verbose/configs.yaml sha256=tESbW1te9Pfr4icy92isZ8bB2R97-9l-ijki1imAws4 265
alpaca_eval/models_configs/gpt-3.5-turbo-16k-0613/configs.yaml sha256=DF2G0iFGuq4gf0h8dWCDPoQScWM0es1cYhFM_dvVc5k 229
alpaca_eval/models_configs/gpt-4-0125-preview/configs.yaml sha256=DQAzZXvLByZtlt2uV6c1UTqlKyqySBHfDI9XN8VPGi8 234
alpaca_eval/models_configs/gpt-4-turbo-2024-04-09/configs.yaml sha256=s8kIvACCB1E-yUQa0CLdmRDdGZLeCkR6HSsQojaNb70 240
alpaca_eval/models_configs/gpt-4o-2024-05-13/configs.yaml sha256=bfjvhf9Et5rACLSCgCqD9SXdIcBFTgPqUIHYPv84ZsY 229
alpaca_eval/models_configs/gpt-4o-2024-08-06/configs.yaml sha256=vF_ECvGbi9kDngS6lRUVBHjv0XXjSDoHmzKrAN5hWtM 229
alpaca_eval/models_configs/gpt-4o-mini-2024-07-18/configs.yaml sha256=42CE92aESdeWcdcuh7kIR61t8LsbAkTQcQ-GiMvnDDc 240
alpaca_eval/models_configs/gpt35_turbo_instruct/configs.yaml sha256=0csU48ilVSFI7rFVPX4pnGEo0BsXf9F_aSOdTZ0MjWo 218
alpaca_eval/models_configs/gpt4/chatml_prompt.txt sha256=arTl2x29spY85yctvxTqcDP3mQfjubCeiTKw-cu1Gc0 100
alpaca_eval/models_configs/gpt4/configs.yaml sha256=yGWFWZBvDQEaZM-4YZ7xXcWFb5RNMyDVyd18dIoxD4Q 178
alpaca_eval/models_configs/gpt4_0314/configs.yaml sha256=9-dN4H6-WBU2Qqii7HATvBwjJWCLAtGNakvIaNaVBWM 196
alpaca_eval/models_configs/gpt4_0613/configs.yaml sha256=HS87_3bp0R-cRvkFfKMfKcxOKIIrW-qT2dNA-J4REPs 196
alpaca_eval/models_configs/gpt4_0613_concise/configs.yaml sha256=9yhpQMcEC8BmIlLODmU29Vemv03Nj9Q7hn_kndUHkkU 240
alpaca_eval/models_configs/gpt4_0613_verbose/configs.yaml sha256=BO_KnO68RA7gFVH9DhnJGSiu1rvS5Zvov6jtb_LMeuA 240
alpaca_eval/models_configs/gpt4_1106_preview/chatml_prompt.txt sha256=arTl2x29spY85yctvxTqcDP3mQfjubCeiTKw-cu1Gc0 100
alpaca_eval/models_configs/gpt4_1106_preview/configs.yaml sha256=RwteKdtEjT-o3wNBj9bvMf7EqUdPPQ9WUHcVWdU7U6I 233
alpaca_eval/models_configs/gpt4_1106_preview_concise/chatml_prompt_concise.txt sha256=9rz5pmAu41lUOS93wx6Uf-tm2H2_PUtLP3QiJxOLSGI 202
alpaca_eval/models_configs/gpt4_1106_preview_concise/configs.yaml sha256=HHrbddjJzkaqU6b9aREkSxWbZ7NnPbzndphnHrGQreM 259
alpaca_eval/models_configs/gpt4_1106_preview_verbose/chatml_prompt_verbose.txt sha256=c5-gdgtMpnXNfFdt_blH08epVY4-LK-4ECKKlL7Ik84 147
alpaca_eval/models_configs/gpt4_1106_preview_verbose/configs.yaml sha256=jKz9SEthGDhiwh_6lKa1mQzakfTSNRCIftJP9SkoATo 259
alpaca_eval/models_configs/gpt4_gamed/configs.yaml sha256=sCdRaKaRoKSyRSF7CPmcm8VjkyIh389NtqpOx7Dd5FM 277
alpaca_eval/models_configs/guanaco-13b/configs.yaml sha256=4cOqkCd5WObgxDxrylD7I7xB3-C8vvN2s9lJOa2tjA4 430
alpaca_eval/models_configs/guanaco-33b/configs.yaml sha256=HiuZonrB3iXe3jpQUQkSKeldhBq8PTAkXlw7W_SxMuU 430
alpaca_eval/models_configs/guanaco-33b-api/configs.yaml sha256=IguBvUe1E_Nkq1npVGQT6iepauvOTfBg02cm4zUMxsE 257
alpaca_eval/models_configs/guanaco-65b/configs.yaml sha256=pMLykSK0hp6UoGM3w0YLtm9ofNUMgF4_ICbjqy2XbgU 430
alpaca_eval/models_configs/guanaco-7b/configs.yaml sha256=vxPzRaJaTkMwHxJiuFlnfiIJBcML3RH-rBvofgxzhPg 425
alpaca_eval/models_configs/guanaco-7b/prompt.txt sha256=APH_lUF2II27aqsmv9WPrqqJhUZrvHYJybO-XSXhp0k 195
alpaca_eval/models_configs/higgs-llama-3-70b-v2/configs.yaml sha256=otLquTiUXl3Ihi6VvfK5zhUykm5yH7bWotGgGrRX6fE 390
alpaca_eval/models_configs/humpback-llama-65b/configs.yaml sha256=ciRQhEWB_o9Zg-Qp2kqdgQNa9tdTfiBRBsZ7BeeH70E 288
alpaca_eval/models_configs/humpback-llama-65b/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/humpback-llama2-70b/configs.yaml sha256=NUEI3wB9jh-Xluw_3-vvTTdWZwFA3jF-bpIWqW4aRss 290
alpaca_eval/models_configs/internlm2-chat-20b-ExPO/configs.yaml sha256=FFQGdk4mFzit7V8uQqVv-I-3ItswT0_yesDP7e6Nzm8 600
alpaca_eval/models_configs/internlm2-chat-20b-ppo/configs.yaml sha256=ome2oFydypKmPWJraaJnHsRLA5P8TDj_6pZ5XUErF2A 501
alpaca_eval/models_configs/internlm2-chat-20b-ppo/prompt.txt sha256=E8xe9wyYrLGzPaTco7iTaa3sJcJ3U4k5lN-p_nB4Dns 63
alpaca_eval/models_configs/internlm2-chat-7b-ExPO/configs.yaml sha256=J1MgiaZ1M3RYVL-B2ehRQ30guXeObPAwBFwy4OJj3Xc 596
alpaca_eval/models_configs/jina-chat/configs.yaml sha256=lbLyWmJm9sIOS-OnUStw_XgIgcR6hcrbXii7KE2yx-s 145
alpaca_eval/models_configs/jina-chat/prompt.txt sha256=7L82PT6HE-QIY0kspD9YYFJG0VAP7ZGbFjK1XBP24Ns 404
alpaca_eval/models_configs/llama-2-13b-chat-hf/configs.yaml sha256=0ZLLZfAf_lMxsT4vX5tZ6VAXxGo4doo0fBKfct4_hTI 391
alpaca_eval/models_configs/llama-2-70b-chat-hf/configs.yaml sha256=dTNs18MGjMnVFIKNGlB_dtEpteqFjGbhq43bg9LvWtU 374
alpaca_eval/models_configs/llama-2-70b-chat-hf/prompt.txt sha256=6BYR5tJbonmv-m6POePzAF01STolAe12KVW4E-cKb0s 28
alpaca_eval/models_configs/llama-2-7b-chat-hf/configs.yaml sha256=0R6EYKLXJMQd074Fbm5ifJImdv4STo-V7C0FcRmtBo4 388
alpaca_eval/models_configs/llama-2-7b-chat-hf/prompt.txt sha256=JlUi3JsCiHISbsxcmAKY0YV81uoUOgs8rNsducw6ERc 558
alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/configs.yaml sha256=q27-4rzmc46M38_JiXIc1lewk2i5hS3enzxnoiBThTs 434
alpaca_eval/models_configs/llama-2-chat-7b-evol70k-neft/prompt.txt sha256=NRAbw20QmXx9km2PIffRc67GUj86V9eIIblEqJklzco 152
alpaca_eval/models_configs/merlinite-7B-AOT/configs.yaml sha256=-dtQdokuKL8w55Z2-4G76NWZCVRE3rkBMF76kCv5Wuw 332
alpaca_eval/models_configs/merlinite-7B-AOT/prompt.txt sha256=TegyWeAQ-eDbTfE3LvGVKxjMgnCp4Mrkjh_aPOZo-hg 60
alpaca_eval/models_configs/minichat-1.5-3b/configs.yaml sha256=DyGaC-GazY4QBCK_cjpxj7flOuQOeWEkSGz_meD-CeU 390
alpaca_eval/models_configs/minichat-3b/configs.yaml sha256=bl1e8_zoRaaRHBjW8aLLDuceqd59ydI7FmCAwE9URm4 374
alpaca_eval/models_configs/minichat-3b/prompt.txt sha256=Bt6bzPgWMi7mfMKu8AYdvc9oLSyyHY7dmBJnraxPV3A 285
alpaca_eval/models_configs/minotaur-13b/configs.yaml sha256=MEHthFt8AloykOkY0ppsX2ibhD6njYR_TAawJSKZqxs 429
alpaca_eval/models_configs/minotaur-13b/prompt.txt sha256=tqN6XNRzD9DhM5wEafFYCCI2mB1_6mEENWpCOUydprM 186
alpaca_eval/models_configs/mistral-large-2402/configs.yaml sha256=utfjndit2rhhi-46eNJONSrPpmcfd37zkiUElKBjpxg 439
alpaca_eval/models_configs/mistral-medium/basic_chatml_prompt.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/mistral-medium/configs.yaml sha256=Mg6bXcmjMxEriKUVm93xpOBVJ3eNcaK2_DpIkTM1tY4 424
alpaca_eval/models_configs/mistral-orpo-beta/configs.yaml sha256=Y7_cmNnUNqjbQfS-ejEtad4n866W7Su0RAscXZ-LcfY 394
alpaca_eval/models_configs/mistral-orpo-beta/prompt.txt sha256=TdvP1M4EoFF-LD1LRvsCwVZ9byIzgLb0-9phj37R51c 41
alpaca_eval/models_configs/nous-hermes-13b/configs.yaml sha256=pn7O29arABiT8TFUTthU8oO5Mh9nDg0r-eQZSXkPw1A 407
alpaca_eval/models_configs/nous-hermes-13b/prompt.txt sha256=xo9TqyfhIAGjoxRYOMyFxsIwZ1k2fq9lrnnjJ0LQRmk 185
alpaca_eval/models_configs/oasst-rlhf-llama-33b/configs.yaml sha256=RpVH_q0JKJne6E0GHsm1er1QFPaICkIOLzLfdaBkt4M 449
alpaca_eval/models_configs/oasst-sft-llama-33b/configs.yaml sha256=EihXA4LnHO656XnYZoptUyjLdD9dN45yI3mtIddV8aY 436
alpaca_eval/models_configs/oasst-sft-llama-33b/prompt.txt sha256=e4vHUbrNTKpS68p8sK0gBd2KpVRT9HFotvL8DCVQegk 42
alpaca_eval/models_configs/oasst-sft-pythia-12b/configs.yaml sha256=oC7UcXtTwldBbSA7-ZpUhRjaToCBTJCOulfd5DXIhcg 458
alpaca_eval/models_configs/oasst-sft-pythia-12b/prompt.txt sha256=uMUj-Kfo1PWb8Fj9PHwWb2ESSUL-_lxr-YbL5Z01eCA 51
alpaca_eval/models_configs/openbuddy-falcon-40b-v9/configs.yaml sha256=J--PumtizRpe5b0bQBGMbMzO08ToTGqjAZfTz4YYrU8 470
alpaca_eval/models_configs/openbuddy-falcon-40b-v9/prompt.txt sha256=v0q2Ka9DkQII-beWonpSgvM1lIctSkareZTThmPEEfI 747
alpaca_eval/models_configs/openbuddy-falcon-7b-v6/configs.yaml sha256=ctgcMv0o8Lx9un2JrZvYz1fovXwyv7RGSGyfcm4YHE4 465
alpaca_eval/models_configs/openbuddy-falcon-7b-v6/prompt.txt sha256=v0q2Ka9DkQII-beWonpSgvM1lIctSkareZTThmPEEfI 747
alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/configs.yaml sha256=WOucZir-7-Mgtj4aCIHezbVV5zhzJxTTws4dP3WiXD4 475
alpaca_eval/models_configs/openbuddy-llama-30b-v7.1/prompt.txt sha256=6BmVISSrKbMKLYPVcnFDScyUZrmd9yc5VvyimxZGBP0 736
alpaca_eval/models_configs/openbuddy-llama-65b-v8/configs.yaml sha256=-qSFJs0-uaUAjkR7rYvW2AH6yMHQ0Be6wsAvNJ-3F5w 465
alpaca_eval/models_configs/openbuddy-llama-65b-v8/prompt.txt sha256=v0q2Ka9DkQII-beWonpSgvM1lIctSkareZTThmPEEfI 747
alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/configs.yaml sha256=Irj0g_DJqrhKCp9XAiTQXddfXVV9pqSNbU6Uh2QDStU 697
alpaca_eval/models_configs/openbuddy-llama2-13b-v11.1/prompt.txt sha256=eZWEsMfoE2DI8CDTEocBnKmSw-4cj52YJ1NuUXN8SCA 601
alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/configs.yaml sha256=lg3g_TuwQIjXFY_Co8SMkxWnMhDJsTWaDDV2Iv_TFdE 691
alpaca_eval/models_configs/openbuddy-llama2-70b-v10.1/prompt.txt sha256=eZWEsMfoE2DI8CDTEocBnKmSw-4cj52YJ1NuUXN8SCA 601
alpaca_eval/models_configs/openchat-13b/configs.yaml sha256=EcTbsNKyLOs2q0DEKaxFyG8UwbIdnpz0JU4g28NczI8 374
alpaca_eval/models_configs/openchat-13b/prompt.txt sha256=vnQBS89qcthUFp5CacV-PZ4WsKYrNo8QeUtXU_glgbs 41
alpaca_eval/models_configs/openchat-v2-13b/configs.yaml sha256=tNPLMnlHrmzCyQ4_D3zYc9WIh90XFho9ujDVQl4WqKo 403
alpaca_eval/models_configs/openchat-v2-w-13b/configs.yaml sha256=qZ8qt-JRKgprfW9Ud8IgfHuxIs7P6_M9xHTsU4R128k 407
alpaca_eval/models_configs/openchat-v3.1-13b/configs.yaml sha256=2vLNXksRwzt_uEiM17elL0s-8OLK5GuYNOFobzCNZd8 416
alpaca_eval/models_configs/openchat8192-13b/configs.yaml sha256=Ahc5nmsaVI5vobbgUNGEB773F1M4k16nPIlOj2QYH74 387
alpaca_eval/models_configs/opencoderplus-15b/configs.yaml sha256=WUfx-DUulUjpdcKiLl-ih1pOqMYAUk-e6va-__NXwMM 389
alpaca_eval/models_configs/openpipe-moa-gpt-4-turbo-v1/configs.yaml sha256=IlUrmqgBXHgJoVke4I1ccBrDnf4Gmddj6PdJx3tVqJY 313
alpaca_eval/models_configs/pairrm-Yi-34B-Chat/configs.yaml sha256=SG9Bi_PLsaYD584byQknPHmIjSlVTlI5tS0pAvlHY4U 565
alpaca_eval/models_configs/pairrm-tulu-2-13b/configs.yaml sha256=EcmtEJfqAB05FgDyp1MyHxkIERMKAbszmjSNGktymmM 549
alpaca_eval/models_configs/pairrm-tulu-2-70b/configs.yaml sha256=fmSMaRLWgKnKczkJyhnvSGG65p4mG3TLXE_LTo8IdnY 604
alpaca_eval/models_configs/pairrm-tulu-2-70b/prompt.txt sha256=3tOd2J19_58LQPWdTrl3D2A-GlvQPHLs9J2bZz9tSNQ 37
alpaca_eval/models_configs/pairrm-zephyr-7b-beta/configs.yaml sha256=NHywWpLwJWZB61U8Isvkyf0wOFLuCENa1EdRgxYf9ZM 516
alpaca_eval/models_configs/phi-2/configs.yaml sha256=WU6npXyR3baHCTKZaX_v4yvWG3t8q2B-CXe2YeC-wCE 433
alpaca_eval/models_configs/phi-2/prompt.txt sha256=YxP2ZOna53_b5aNnPBsfHeE5wWEK1ZdGq--9e5pjJDk 31
alpaca_eval/models_configs/phi-2-dpo/configs.yaml sha256=-RBFSshc-9tJrxk3S_ZvgsSeY9jkOeWMiXJvAuoL_k4 400
alpaca_eval/models_configs/phi-2-dpo/prompt.txt sha256=f8Prz_H_9mcL5siIFjUYW296Ndy2dj-dfTuq-7QYFu4 40
alpaca_eval/models_configs/phi-2-sft/configs.yaml sha256=yrXeRMGJvoHNRipUeLD7of06xI-d5H03gBKibgtFxFs 400
alpaca_eval/models_configs/phi-2-sft/prompt.txt sha256=f8Prz_H_9mcL5siIFjUYW296Ndy2dj-dfTuq-7QYFu4 40
alpaca_eval/models_configs/platolm-7b/configs.yaml sha256=-k4Nxe4QkuXc-fKoZsJbUWXEkn8yWs-VwJSXo9Nhjck 397
alpaca_eval/models_configs/platolm-7b/prompt.txt sha256=WXs8FSJnz_muStpA9uB5SnqKaJILFV-PfFR24AZ9K9c 197
alpaca_eval/models_configs/pythia-12b-mix-sft/configs.yaml sha256=Sq2NY9tPJnS1kckOTVNoUgcG9FQwauNQrJp_FeNR69o 438
alpaca_eval/models_configs/recycled-wizardlm-7b-v1.0/configs.yaml sha256=XdKAajgP45JJEHde92D_7RhMKtIHFjy2DXTRLpERTx8 409
alpaca_eval/models_configs/recycled-wizardlm-7b-v2.0/configs.yaml sha256=mnQgP1d0EYViOjtcWj6DB8Pin6ShpqoW_T-W3Izcz50 409
alpaca_eval/models_configs/text_davinci_001/configs.yaml sha256=fK3G_pxpeHbSD3WE0knIGGZgdxBo3k12EhYZysexXkQ 211
alpaca_eval/models_configs/text_davinci_003/configs.yaml sha256=nNY1SiewhsPBSHliZkRP91609s2sGHUsyOnk5CRv_Mc 211
alpaca_eval/models_configs/text_davinci_003/prompt.txt sha256=ItEGOBsJHb4frai68-HdKRxNQqTsFLwpuxkpIlAKBgU 34
alpaca_eval/models_configs/tulu-2-dpo-13b/configs.yaml sha256=SUoN1agTClfMqe7uah5-zQLZOuRAa1-kCYZiAkdZt0Y 436
alpaca_eval/models_configs/tulu-2-dpo-13b-ExPO/configs.yaml sha256=DBYpB2gdtG6X5p0yozh4WgH90yfIeY_EquJtQ7lBRfQ 545
alpaca_eval/models_configs/tulu-2-dpo-70b/configs.yaml sha256=ysiV5Cc-dxdw6CZwIRlsKCJKkxzQhKDxt7prCxfTg0A 491
alpaca_eval/models_configs/tulu-2-dpo-70b/prompt.txt sha256=3tOd2J19_58LQPWdTrl3D2A-GlvQPHLs9J2bZz9tSNQ 37
alpaca_eval/models_configs/tulu-2-dpo-70b-ExPO/configs.yaml sha256=YHz7D4FCKLYF8RwySya6QgqawyxeK32i3ybTkojedpY 630
alpaca_eval/models_configs/tulu-2-dpo-7b/configs.yaml sha256=fZhB3mMEIM3SParsjte8fzAgencfWMT5_bSJFqOhu_E 432
alpaca_eval/models_configs/tulu-2-dpo-7b-ExPO/configs.yaml sha256=WIQ-Aac3ULZiv4fxdSuxMQo9u1CXsX_4St99KjdUc6g 541
alpaca_eval/models_configs/ultralm-13b/configs.yaml sha256=TIfJyJzBGgN2Bpreev2hRDcubPLMvmHtazSMBtwa6-g 401
alpaca_eval/models_configs/ultralm-13b/prompt.txt sha256=Sm-9tJ-a_a__SFOWvxTUdoPX9xzcoQ0Bmi7Q_VbO37A 271
alpaca_eval/models_configs/ultralm-13b-best-of-16/configs.yaml sha256=llWTdhIhfYA_yxh5xpsV1rA1Ehm13HyURgF_n-fpqHQ 560
alpaca_eval/models_configs/ultralm-13b-best-of-16/prompt.txt sha256=Sm-9tJ-a_a__SFOWvxTUdoPX9xzcoQ0Bmi7Q_VbO37A 271
alpaca_eval/models_configs/ultralm-13b-v2.0/configs.yaml sha256=awCPNoIZpnlJojtUmk2JyCx_CSyBiM6QqkgiHiP2Abk 421
alpaca_eval/models_configs/ultralm-13b-v2.0/prompt.txt sha256=Sm-9tJ-a_a__SFOWvxTUdoPX9xzcoQ0Bmi7Q_VbO37A 271
alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/configs.yaml sha256=VDzOt2VLaIhFSJtHIvwBMNzHj5UsrNSNeQP_kcOv7bk 575
alpaca_eval/models_configs/ultralm-13b-v2.0-best-of-16/prompt.txt sha256=Sm-9tJ-a_a__SFOWvxTUdoPX9xzcoQ0Bmi7Q_VbO37A 271
alpaca_eval/models_configs/vicuna-13b/configs.yaml sha256=8Hym23QJExR043vS1uH4iiXjNJarh0wYcEogcnD9UkI 387
alpaca_eval/models_configs/vicuna-13b-v1.3/configs.yaml sha256=CZq9E2298VCSs54tUvc-1lZPsoSeQuNC1xhUj1hTjgE 387
alpaca_eval/models_configs/vicuna-13b-v1.5/configs.yaml sha256=pmVnZWfskuamcOAY4tui1Bps4cW58AOUVQprbY2GU5g 388
alpaca_eval/models_configs/vicuna-13b-v1.5-togetherai/configs.yaml sha256=RprECDoqI_ddXa-sHWypSlIchCurXKkE_hGV838-z3U 470
alpaca_eval/models_configs/vicuna-33b-v1.3/configs.yaml sha256=d0bZ6b5TPRZEBFS1qWZoONghW9wNNxbasxvUnF7h1f4 387
alpaca_eval/models_configs/vicuna-7b/configs.yaml sha256=3q2N5Vr09-0ImFh6Ux2IlUU8VU6U6UBu6McoikE2ZZ8 383
alpaca_eval/models_configs/vicuna-7b/prompt.txt sha256=xo9TqyfhIAGjoxRYOMyFxsIwZ1k2fq9lrnnjJ0LQRmk 185
alpaca_eval/models_configs/vicuna-7b-v1.3/configs.yaml sha256=UrmUKNcTIj3rzqS1Ht3lomsqX3_RLCJZjobaEe6hJA0 383
alpaca_eval/models_configs/vicuna-7b-v1.5/configs.yaml sha256=VssFwCGzYi7R8Pd-AIqwp_h7buLqt80mChqJ4rmKD7Y 384
alpaca_eval/models_configs/wizardlm-13b/configs.yaml sha256=7cQAwmaRjSxhD80NfKFMtEhYZzsnwRT0XXbgeRNsvDA 394
alpaca_eval/models_configs/wizardlm-13b/prompt.txt sha256=xo9TqyfhIAGjoxRYOMyFxsIwZ1k2fq9lrnnjJ0LQRmk 185
alpaca_eval/models_configs/wizardlm-13b-v1.1/configs.yaml sha256=MfAQB3jv4-iQEkmxrUGi7gx6rL5XpSIcWiFcPhk0MIs 410
alpaca_eval/models_configs/wizardlm-13b-v1.2/configs.yaml sha256=-7Lqy467tkDNY4W0VC2eljPFPrcwp0HK4rDGWLJXoJ8 410
alpaca_eval/models_configs/wizardlm-70b/configs.yaml sha256=-aGYzXNyQtalQbxUlXJlWMV2DbVgaz_lWJm0Z5Haz-U 394
alpaca_eval/models_configs/xwinlm-13b-v0.1/configs.yaml sha256=MdN0EJuqwQss08z1KbypKZBleDyc-n-9HI7Af0nLRBg 391
alpaca_eval/models_configs/xwinlm-70b-v0.1/configs.yaml sha256=o9qwq57oR73RnyGCxqqkSsu6tqy1zGqH4W0M5xZEy1E 391
alpaca_eval/models_configs/xwinlm-70b-v0.3/configs.yaml sha256=R8C0eowkDNHFNfuppFqoDbM8Xz_ic8mNT-u20NLGars 391
alpaca_eval/models_configs/xwinlm-7b-v0.1/configs.yaml sha256=lc1jN5Iqdqu9LO85sdzcMl03G0v7hhfpCog4mVI09xo 388
alpaca_eval/models_configs/xwinlm-7b-v0.1/prompt.txt sha256=xo9TqyfhIAGjoxRYOMyFxsIwZ1k2fq9lrnnjJ0LQRmk 185
alpaca_eval/models_configs/yi-large-preview/configs.yaml sha256=AyDJUqxXdfDwCEdzLGcNvVw_87z7KWtdjFxEwq9AsXw 357
alpaca_eval/models_configs/yi-large-preview/prompt.txt sha256=gVMoe5Vdb0aB9c1wFPiGE75e8k5nVROSvconwpD0Igo 41
alpaca_eval/models_configs/zephyr-7b-alpha/configs.yaml sha256=NGVRx0X_BH8Yv6VBCkcEdKbQitWofuKUTKAQrbctwhE 409
alpaca_eval/models_configs/zephyr-7b-alpha/prompt.txt sha256=2w3khg7YIrWG7xWp6cYL9WEb8-zx7vYvsh8eozFlvIU 57
alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/configs.yaml sha256=sP5E8E0vAKNBb6hXpL4M32q2cWMwEgqjEYUVB9veV1Q 552
alpaca_eval/models_configs/zephyr-7b-alpha-ExPO/prompt.txt sha256=TdvP1M4EoFF-LD1LRvsCwVZ9byIzgLb0-9phj37R51c 41
alpaca_eval/models_configs/zephyr-7b-beta/configs.yaml sha256=yy0sde0x12o0Dn4SdFE1GPsh8N7tReeA4xtkbQKdKyw 405
alpaca_eval/models_configs/zephyr-7b-beta-ExPO/configs.yaml sha256=TKNLgFTJy9W4K9uSM-EJj7xEzSj6o-Bkqqekh9rtZPY 548
alpaca_eval-0.6.5.dist-info/LICENSE sha256=bhdenb4mu0Leg2e_IhUwGnGz9AMkOi7vxWN4swdji-g 11409
alpaca_eval-0.6.5.dist-info/METADATA sha256=JIsV7TisT0l5z_de9yomGlpCW_SK3LFxjyTGdgg11_E 87757
alpaca_eval-0.6.5.dist-info/WHEEL sha256=HiCZjzuy6Dw0hdX5R3LCFPDmFS4BWl8H-8W39XfmgX4 91
alpaca_eval-0.6.5.dist-info/entry_points.txt sha256=80Fbhb475MjCZie0wJzpm3dJZXQ5_jXdIeumUSvXkHg 54
alpaca_eval-0.6.5.dist-info/top_level.txt sha256=k6m1kZMZ1fuDbyOuJKNqDIdgvnqsg-PcVO7-ejJXOAU 12
alpaca_eval-0.6.5.dist-info/RECORD

top_level.txt

alpaca_eval

entry_points.txt

alpaca_eval = alpaca_eval.main:main