Wheelodex » Projects » flexeval

flexeval

View on PyPI — Reverse Dependencies (0)

0.9.1 flexeval-0.9.1-py3-none-any.whl

Wheel Details

Project: flexeval
Version: 0.9.1
Filename: flexeval-0.9.1-py3-none-any.whl
Download: [link]
Size: 274363
MD5: ef27744a11c26643cdd60ff5615684ff
SHA256: 06c5f95aef4fd45c948bc45332f26fc949226b8ad062cd155479a79b1b81277c
Uploaded: 2025-01-15 01:16:25 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.3
Name: flexeval
Version: 0.9.1
Author: ryokan-ri
Author-Email: ryokan.ri[at]sbintuitions.co.jp
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Requires-Python: >=3.9, !=2.7.*, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*, !=3.5.*, !=3.6.*, !=3.7.*, !=3.8.*
Requires-Dist: datasets (<3.0.0,>=2.14.6)
Requires-Dist: evaluate (<0.5.0,>=0.4.1)
Requires-Dist: fuzzywuzzy (<0.19.0,>=0.18.0)
Requires-Dist: google-api-python-client (<3.0.0,>=2.131.0)
Requires-Dist: jinja2 (<4.0.0,>=3.1.2)
Requires-Dist: jiwer (<4.0.0,>=3.0.4)
Requires-Dist: jsonargparse[jsonnet] (<5.0.0,>=4.26.1)
Requires-Dist: loguru (<0.8.0,>=0.7.2)
Requires-Dist: openai (<2.0.0,>=1.52.2)
Requires-Dist: peft (<0.11.0,>=0.10.0)
Requires-Dist: pyarrow (==16.1.0)
Requires-Dist: python-levenshtein (<0.24.0,>=0.23.0)
Requires-Dist: rouge (<2.0.0,>=1.0.1)
Requires-Dist: sacrebleu[ja] (<3.0.0,>=2.4.1)
Requires-Dist: scipy (==1.13.0)
Requires-Dist: smart-open (<8.0.0,>=7.1.0)
Requires-Dist: transformers[ja,sentencepiece,torch] (<5.0.0,>=4.34.1)
Requires-Dist: vllm (<0.7.0,>=0.6.4.post1); extra == "vllm"
Requires-Dist: wandb (<0.18.0,>=0.17.2); extra == "wandb"
Provides-Extra: vllm
Provides-Extra: wandb
Description-Content-Type: text/markdown
[Description omitted; length: 2783 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 2.0.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
flexeval/__init__.py sha256=qRBhiKkqZ9t2zuN8nRb_ToVq4itjO2vx0ss3Nh-e7lU 990
flexeval/core/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
flexeval/core/chat_dataset/__init__.py sha256=DJkVaiZ4tCSFq3bvv-WKRt_qtJwsN3TiIdrUTgVwg7U 217
flexeval/core/chat_dataset/base.py sha256=cdPt2m3pmvsBYfn1kBLZDn9WVfOhczUUlakHfYS1zgY 2732
flexeval/core/chat_dataset/chatbot_bench.py sha256=4sYfFMCHtHGWLz_RdOQQ7OYIOhtNIpa_qBL8N7dMDRw 2972
flexeval/core/chat_dataset/chatbot_bench_datasets/README.md sha256=AEY1X-aqKzzxFfgEquPL3PV_wdSM8T3DzdZsw5bWaQY 1370
flexeval/core/chat_dataset/chatbot_bench_datasets/mt-en-ref-gpt4.jsonl sha256=-VelvJd7rbZoheyXDmzQhSeEV4AxPwmVdkJg5Xd7mz8 51109
flexeval/core/chat_dataset/chatbot_bench_datasets/mt-en.jsonl sha256=EZVlrbq4IicInO_bRMjX4s8E3AoOwjNjTILn1OKpRPc 48929
flexeval/core/chat_dataset/chatbot_bench_datasets/mt-ja-ref-gpt4.jsonl sha256=BjFoXE68ZjkJcFiLZY5NGQR_r7CgDsHYQWFmhsB7DWs 164189
flexeval/core/chat_dataset/chatbot_bench_datasets/mt-ja.jsonl sha256=4LS7BskJOGqbky4kf4el79iHeAiqiGBi7xf4fCnkeaQ 42254
flexeval/core/chat_dataset/chatbot_bench_datasets/rakuda-v2-ja.jsonl sha256=AIrxBPgPTYzKvISCU3Fe5qldQE0zmbRMiOgqXbzbzaI 8842
flexeval/core/chat_dataset/chatbot_bench_datasets/vicuna-en-ref-gpt4.jsonl sha256=91QtwlpahpsyGXSG9WmaFOtWgqs8cmRRhAI5nsCatHA 11301
flexeval/core/chat_dataset/chatbot_bench_datasets/vicuna-en.jsonl sha256=wkjFyYukW7DCqtri8nDmQ70yZ5xsMGo7KlA6xCVM2qU 13125
flexeval/core/chat_dataset/chatbot_bench_datasets/vicuna-ja-ref-gpt4.jsonl sha256=B4kYqROGB7keRhQJfB9rEgjpVjYW70ocwDOaplJuRCc 8535
flexeval/core/chat_dataset/chatbot_bench_datasets/vicuna-ja.jsonl sha256=CmaiLmwHdzw1v9LBLBIm_yhz0-e3CYG53sfKjvtytdA 16828
flexeval/core/chat_dataset/sacrebleu_dataset.py sha256=RndpQOEiqvyCXu_W_IGDYyLDPH7lfgiyIpSC-M5AK6o 1131
flexeval/core/chat_dataset/template_based.py sha256=dh7hHMxMMLMciRVnSq8sP3tw2BokqTbY5P5KOeP4gWM 8336
flexeval/core/eval_setups.py sha256=Qf3zASkKY46upPo-Gj7jGVKKgnkNKXDo_DT29K9e1KU 5397
flexeval/core/evaluate_chat_response.py sha256=fXWCSySPX0_AHofst4f7PnZgSP8Rba7RQQ6fddRcStA 5736
flexeval/core/evaluate_from_data.py sha256=zr2TvEa-06du361sVTTsCAhFpYCLqi_0MAdRrpTTXZ4 2209
flexeval/core/evaluate_generation.py sha256=JAnx0tzI6IErPxYNSRTqn7ouT5hnN9yhTM-YComqcrM 4008
flexeval/core/evaluate_multiple_choice.py sha256=5zttt2oQhdFjt6g8c1RBqV8_hsZYE8240nfxJ9nm5tw 4957
flexeval/core/evaluate_pairwise.py sha256=jea8boxn276gPkQP7RbAVHx4QsslKd-T995xYzQVhGQ 2700
flexeval/core/evaluate_perplexity.py sha256=tPiIMOnhRhZrJ1zUzZvL-xpaWxUG3smpiAzWUFLHgpE 1750
flexeval/core/evaluate_reward_model.py sha256=k4NZssXzR24knFDwsi7HzGPH_t7Dq4cyys9WQKrMu8Q 2841
flexeval/core/few_shot_generator/__init__.py sha256=0KO1YdQuyeXDDWzuO2IDlvH3CE82mQFICBXU4K6GbXA 164
flexeval/core/few_shot_generator/balanced.py sha256=7RmhCzm2wiJreG7YuWat-YKqym9Ag8jZZ8wuhp3XDQg 2446
flexeval/core/few_shot_generator/base.py sha256=FJB-eYwYU52jJMBqGmczfPfL2HBGO6TKYj4DuuGponw 2462
flexeval/core/few_shot_generator/fixed.py sha256=JVBzvYn3Wh2YITEURuiuznEqfB5xD89Zv5ih-16ZvYA 1096
flexeval/core/few_shot_generator/rand.py sha256=DlwsnYUR_aBEhEIBc40nMAkF5PHfApQHKvEDDppqdZ0 1194
flexeval/core/generation_dataset/__init__.py sha256=0wmny5_zjSyKdKyvAS_V_vJSbiDmXqQv5KWod0BsrJ8 203
flexeval/core/generation_dataset/base.py sha256=r3A3Q1MDGGqBDnzmEUayrNDWtOM9f6Y7T10sHRNuQ1w 1193
flexeval/core/generation_dataset/sacrebleu_dataset.py sha256=DLS3i51bXZ8GFMrKzK4LSQW1ETdhbM1APupRcZRbctY 1035
flexeval/core/generation_dataset/template_based.py sha256=JYYKQUAyCBvBugCOh6xYVgCBhMLWXaNGX-hY59G8vIA 6429
flexeval/core/language_model/__init__.py sha256=aFgkf1ytLt498ZFoDlJ8pM__qSlQT3UCWwg_Q6bI-U8 202
flexeval/core/language_model/base.py sha256=beqAinSYDpeP-AKRJXPkoxnOxMqqURU0yNSmXhbQD1c 6877
flexeval/core/language_model/hf_lm.py sha256=GwiHGkIC_yb5dgx9DpGtoSinyn9A-Fhwa3wC_fy8KYU 18133
flexeval/core/language_model/openai_api.py sha256=62ndWwc3NjvLGxyUh63-MXC_fK7ZCWA70xMJsLoo6NQ 8900
flexeval/core/language_model/openai_batch_api.py sha256=S-U8XWEcPyLT3VZpjEVd8Ke-ZgxegQK8gNinctvRPPQ 9122
flexeval/core/language_model/vllm_model.py sha256=2U7Kc9Tgft-vC1f8QEm6N2yFxSDTfYx8Dy20uLYoolM 11620
flexeval/core/metric/__init__.py sha256=t_yOjSw6GN-4nT-0bTnpYMqJLuDW8TBgdr8oRt-NiM8 578
flexeval/core/metric/base.py sha256=XrkozsrISv_MC8L7AsUxdmloOIfTbWkgX9khoH0q2T4 1065
flexeval/core/metric/bleu.py sha256=awH_f6i6HojRFCpOetULZ5JEejzo92bNw7ltlJPspSY 2899
flexeval/core/metric/char_f1.py sha256=ouB8d-eMHoxprNdxAedJJmr60IMi7cSgBm-Us86G_xc 2655
flexeval/core/metric/code_eval.py sha256=l_8HtKssL-93Sb-LNy-AT7Pqnbw1LstlLBzXq_J3vbk 4123
flexeval/core/metric/common_prefix_length.py sha256=7C5jBDg1N6fP5Gof3XQhpYp1-SNp57OHknntNPxtQYU 1839
flexeval/core/metric/common_string_length.py sha256=OKcXbTB2vuTASepjnjy2D25nGTVaINccXptLw_G9B9U 2654
flexeval/core/metric/correlation.py sha256=j-2wgJSbrpeqfuy8J_LBXhgEWRd-z7aB5deOh1u0_R0 4526
flexeval/core/metric/exact_match.py sha256=ubXm60OlX8xJTw9yt8tMgtZX6w19cPUdAdC_0Kn9WDs 2831
flexeval/core/metric/llm_label.py sha256=cxSbwZBBvgxlBz8Q-AAkJEbM99b-Dk6gUGV35iO3L0w 14977
flexeval/core/metric/llm_score.py sha256=CmxxX0M9nPpcXKB8ierXfVyYrWh2Bw6iVznAvzqqFTw 15100
flexeval/core/metric/output_length_stats.py sha256=UGdUVOZG4lHQPR9NQe4Vk-SXwdAZ68xcjOAeyTBh6Zs 1272
flexeval/core/metric/perspective_api.py sha256=0z8kiubgsDhFXDniKRik7UgnunIvare7aswiKs28rog 3571
flexeval/core/metric/rouge.py sha256=xeQ0skMBCRm1b4kRwNZ82Ll8PmBHyHKTwhljyck1sTI 3153
flexeval/core/metric/string_processor/__init__.py sha256=_LNwzUS0ZWtpEdTyrILarimB1gh-zZZKGxv5wuj-Znc 242
flexeval/core/metric/string_processor/aio.py sha256=97PAPvkulKhQIAjmSjh0t6Fs-6tShDnw7FtKnp0ppW4 1394
flexeval/core/metric/string_processor/base.py sha256=AOHuNtZ9yfSM4yrxlr3APSvLsbemMhOwZ-eBqDrt-E4 393
flexeval/core/metric/string_processor/last_line.py sha256=UK1oKYeRUNxIMu_4ipPkZ7oSDyW2aGTvA04nfi7ecYw 412
flexeval/core/metric/string_processor/lower.py sha256=pb0i8yObvJ0y2A22OLsFwGHQR8aZdXZZjgf05qyJpvQ 426
flexeval/core/metric/string_processor/nfkc.py sha256=B6y0BqeKXemwFcYGg19ux4anp5CSB1d9GL4HmztxvjM 497
flexeval/core/metric/string_processor/regex.py sha256=1vGfffOR0-8RFu22tVdzGO58Gg1Ma2C3oImg2qucx0A 797
flexeval/core/metric/string_processor/string_strip.py sha256=3ZxFgocIowCIpp5mLkWz1XcdL_hCkPNsrpSYfTJPcWk 429
flexeval/core/metric/substring_match.py sha256=Ohz7WFe6w8hLWdt8RPAAvX5aZgeK448dAA3O-46c0M4 1544
flexeval/core/metric/tokenizer/__init__.py sha256=prvwgbsusn0GcWt55IWm8ehlOo1t_GqVm4ij4UJkMq8 158
flexeval/core/metric/tokenizer/base.py sha256=D_HCGaum40KPpEWmjV0ztcp7C4XJSzthrpkDnXMeX9Y 369
flexeval/core/metric/tokenizer/mecab.py sha256=5UwXJ4lD4tdrCTOVAfhv8VBpp-oEgR8oqkA5Mw3SMkY 397
flexeval/core/metric/tokenizer/sacrebleu_tokenizer.py sha256=8mpsS6jkaTlhCkWrG5-vnkBXbSOCUKgBC9EdxNhK0DY 468
flexeval/core/metric/tokenizer/whitespace.py sha256=lDFiYbdTk3XR_zbTaCHz1sm9qc3M4HaHjFBb6Gza2lg 232
flexeval/core/metric/xer.py sha256=ukAp9cu34cQ_k2RfoI8B71f3Zqn-4vf3REqpdmRuag8 2620
flexeval/core/multiple_choice_dataset/__init__.py sha256=EeaPAoMmZ6shiTytU9rJRSEx73TsebVXbDg6V8BHxzA 175
flexeval/core/multiple_choice_dataset/base.py sha256=YEXPHzYL2D7tesHEbzpuhTU6YvlcylbdwEoJ2m8N4-M 1215
flexeval/core/multiple_choice_dataset/template_based.py sha256=Axkpi85X0djM9pWL63ZoCFoP7t-dtFc6gSMdZGblbbs 6297
flexeval/core/pairwise_comparison/__init__.py sha256=jc1rofDv6zvdVqYbthfdRZ-7MDdHqFYAUfPeSsYNLGQ 91
flexeval/core/pairwise_comparison/judge/__init__.py sha256=yU0xhlqFRXUn-I9208hIcvd7Ly90clc8iwV58PGsgeg 84
flexeval/core/pairwise_comparison/judge/base.py sha256=L1ZCLwPRAUxBwDn-E7KxDlDt8IKcn0f3zYTYsvh1jV0 876
flexeval/core/pairwise_comparison/judge/llm_judge.py sha256=ebIEfQCzZ33n0f8CSiY3ZRGqsbYHVOOGpyZxlZ0MXCU 3418
flexeval/core/pairwise_comparison/match.py sha256=87ekOCdWuzMIsrlcTFPg6uCmRZ8c6OSoZp1CZn64rNo 885
flexeval/core/pairwise_comparison/match_maker/__init__.py sha256=06FcEJeSIaOOSk9f7A51n_JQRHIZtQbeA-h0CGtPxfE 127
flexeval/core/pairwise_comparison/match_maker/all_combinations.py sha256=9WX471mFltRewCUHtMdcWFZD-UQ3PNiNBe0c8VGQWco 1139
flexeval/core/pairwise_comparison/match_maker/base.py sha256=brOIA9V25lxkHlV0YZKZCzHtlvVn2f3JQS4_Ohz_AL4 523
flexeval/core/pairwise_comparison/match_maker/random_combinations.py sha256=lopfeoyDICC5913D0LyeGt7LXkUEOTIhmOVKsElBIxI 2444
flexeval/core/pairwise_comparison/scorer/__init__.py sha256=uxaXZCz3iqOBRvviTmqETOGVTFDmU1n0H_C3-JgNBAo 115
flexeval/core/pairwise_comparison/scorer/base.py sha256=rX7sPejZqA5tMWesdBVmKTP3ShrRBwbt7jOK8nNnm9Y 621
flexeval/core/pairwise_comparison/scorer/bradley_terry.py sha256=p_LW5pZFTXzbYgFdSjrUs3kjHUXRRirMzIMP0C3GrD0 3425
flexeval/core/pairwise_comparison/scorer/win_rate.py sha256=XEgYyX8tr01SJ50KAJhLJpbunzGkdm6ua0kuXdmKdbo 1233
flexeval/core/prompt_template/__init__.py sha256=aw1AvERiiEjQ2kMyOgszyYIR8kgKufZWPLJ1BbTfRIw 115
flexeval/core/prompt_template/base.py sha256=lU2tADVr2YqWfbrwY233DWFu2NhJyNqrNmThTNRvNcA 485
flexeval/core/prompt_template/jinja2.py sha256=OHai77r6VgZWCz7t1QSWp85rt6xWdddKgVjzwWUqWyM 1681
flexeval/core/result_recorder/__init__.py sha256=t1emKTuvsYzh4Ir1RpLwrY7Jgb0I8k_H0N54FxYPWcs 117
flexeval/core/result_recorder/base.py sha256=EzG06ZjkPdy7Ln00iX-kUVwJK4xbk-ABGx_Owisawsk 1787
flexeval/core/result_recorder/local_recorder.py sha256=dmeuGzzc_Gtk1PAQJwL0lftPc4yMpS-A59VndW2alGw 3268
flexeval/core/result_recorder/wandb_recorder.py sha256=xiMqnfl8UDvPEVp6AepH2dpDcbWRjF1p-DITSjy0ivo 1525
flexeval/core/reward_bench_dataset/__init__.py sha256=Jih3sLCoUl9tnxzHzLPHDAcm7ysXUsHluB2U4ytVssI 132
flexeval/core/reward_bench_dataset/base.py sha256=mdCXJslAKAhD3-PMceTIYmx8CP06tgzer8Jw0tUTL-s 1515
flexeval/core/reward_bench_dataset/template_based.py sha256=kEL9Dxg4uWKxKJjkNZl7EBwSsFHur6FjjqteHl8tFCU 6627
flexeval/core/reward_model/__init__.py sha256=lbkU9huhgYlWbvm8IqCKc3_f4LNVr194XTCat10ikHM 208
flexeval/core/reward_model/base.py sha256=QeHPCSU2ALM69gkNhDHlYsuEQTfGP82DQpxfAxvHEpI 902
flexeval/core/reward_model/log_prob.py sha256=4zVwiZ-wlV7Q44gBYTxmpTjjQyVaNDp6I5Gm1s1XqtU 2113
flexeval/core/reward_model/pairwise_judge_reward_model.py sha256=YmPtF8J8VIBkUfledQcVeKvKvhEqt8EqgjkLhIvKF8U 5797
flexeval/core/reward_model/sequence_classification.py sha256=thJJoQ0qSrYV3Z4aE1-JskYwn0kuZIKKsDjq4htTUQk 2747
flexeval/core/text_dataset/__init__.py sha256=V6JgwXC069WQT2ACQxUlXLavZwG7xSE6DiVnseNFEvc 110
flexeval/core/text_dataset/base.py sha256=ypaemSr_ESnm40UIAd2tsVFBtWYkLONeM_BpLtTmCmE 577
flexeval/core/text_dataset/hf.py sha256=4c_fmT_ALipUn5sCq7BimVx4CVeYTm-2noRqPbM8zK4 2700
flexeval/core/text_dataset/jsonl.py sha256=eWojSqFIHVcTnCP-7f9EacHDzEY1ouVHOmK33qidE6s 824
flexeval/core/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
flexeval/core/utils/data_util.py sha256=erY_rjNTfb604q5sECN8hgLIR-gYaC9J6KEwKNZfZc0 1050
flexeval/core/utils/jinja2_utils.py sha256=_nDL-XhDhmMXr4KUSl2NDlp4BqLunl3f914mlQgfUJY 439
flexeval/preset_configs/EvalSetup/code_chat/mbpp_chat.jsonnet sha256=jm8-_7dEGtVYfLRLvT2cMc5MBTpRSryjcP1MeyDd-H0 1348
flexeval/preset_configs/EvalSetup/code_generation/jhumaneval.jsonnet sha256=Vg9watWyVdo4NvLVNHZ8TlhiHp13v5OysImJ2DNm4Jw 878
flexeval/preset_configs/EvalSetup/code_generation/jhumaneval_tab_indent.jsonnet sha256=o9QDuVHVpVSDz4UAeoSDHLyAnxSMCePttwKQGVMqQTo 671
flexeval/preset_configs/EvalSetup/code_generation/mbpp.jsonnet sha256=16ofJuFHjJC7BkVpUUfygzVv42s6myApYFUZjWwc6Y4 1326
flexeval/preset_configs/EvalSetup/code_generation/mbpp_tab_indent.jsonnet sha256=HWolSm0-D6df72G9QEaszUUfAkmzIzsTKHqOHi7PY14 806
flexeval/preset_configs/EvalSetup/code_generation/openai_humaneval.jsonnet sha256=AG7e6gOuBrwNo2D_YDR10GZ0Ym4YDtxNcSSHh9jZki4 812
flexeval/preset_configs/EvalSetup/code_generation/openai_humaneval_tab_indent.jsonnet sha256=IjcrTI8uE03d6xSPWTEgCB28l8HzfLwCjP1Ou8gBxBI 691
flexeval/preset_configs/EvalSetup/en_chat/mt-en.jsonnet sha256=RvTKK2uNjAfU5TzgLUaL867mul2jDbOwlMbCA0IRsls 586
flexeval/preset_configs/EvalSetup/en_chat/vicuna-en.jsonnet sha256=pwNT39I5zQLdGI4EtYoPyLtSBqaXzYDc_M0grUvH2hA 497
flexeval/preset_configs/EvalSetup/en_generation/babi.jsonnet sha256=EtLpkKzlL-xg4KbP8sCfbem9ukFL80LsSR3hXs0zbBE 1197
flexeval/preset_configs/EvalSetup/en_generation/commonsense_qa.jsonnet sha256=TTEKUQtkt0XIAjmW34gtpd-l7a9dHQGKxZE1H7FlddQ 1764
flexeval/preset_configs/EvalSetup/en_generation/gsm8k.jsonnet sha256=JCY1v9WM1GySByraPetQwohxXOAfs_-ZThueLJ9Wq9w 1501
flexeval/preset_configs/EvalSetup/en_generation/squad_v1.jsonnet sha256=6JO9xEiy_LT-gDJn3Wh92e0pLcX2K16YliCYEWm-yGI 1398
flexeval/preset_configs/EvalSetup/en_generation/trivia_qa.jsonnet sha256=36LH6cXYMo9TvnMRkR5G8KwFKpgvi72jLzOt4-bh2pc 1431
flexeval/preset_configs/EvalSetup/en_generation/twitter_sentiment.jsonnet sha256=2lEHu7QE8FgPn-DAVed-eFGfSDiNxxllc2X83ayrUDc 1335
flexeval/preset_configs/EvalSetup/en_multiple_choice/arc_challenge.jsonnet sha256=kAI9RfYZsUJPt7gh7jGI5Ak3ToV-7mtFgkVDFkzCGog 1916
flexeval/preset_configs/EvalSetup/en_multiple_choice/arc_easy.jsonnet sha256=IYokeCYapb2XQMdihyT98SfQZdDl9Ytkrixxe7EIrT4 1906
flexeval/preset_configs/EvalSetup/en_multiple_choice/commonsense_qa_mc.jsonnet sha256=tq5hOuXNyzJWas6tcD3WfvPzqQchbwQPGl-PeFf18SY 1587
flexeval/preset_configs/EvalSetup/en_multiple_choice/hellaswag.jsonnet sha256=gR5uUSWojtBo4-U4j2roId8R_6LDhZE4kubWdgz4dHo 1220
flexeval/preset_configs/EvalSetup/en_multiple_choice/openbookqa.jsonnet sha256=QCN63_B85_ArnSktgVMcwUi-InvGn831pMvRpISoTO4 1437
flexeval/preset_configs/EvalSetup/en_multiple_choice/piqa.jsonnet sha256=RjdtYd1kBWhHzdmiX4Z8noXwwmB8C-W_yl6TXQ2aI9E 1167
flexeval/preset_configs/EvalSetup/en_multiple_choice/xwinograd_en.jsonnet sha256=UAta9-eS0vbYUZwKcY9ce25f1yUP9s8XfrOpqERmPSI 1024
flexeval/preset_configs/EvalSetup/en_perplexity/tiny_shakespeare.jsonnet sha256=jb64KJ_ESjxRku7_UVJDNzxrlOtHO2MzNyyqlOah7Rw 579
flexeval/preset_configs/EvalSetup/ja_chat/aio_chat.jsonnet sha256=KLINpW_GfeA3U_a0eRCLJhnz5BCou6_rTGIQd2x44fs 1540
flexeval/preset_configs/EvalSetup/ja_chat/elyza_tasks_100.jsonnet sha256=RHTSNFYjJtJqmCozEqd-0_GngwlgStofId_vTnM8rRM 708
flexeval/preset_configs/EvalSetup/ja_chat/mgsm_ja_chat.jsonnet sha256=yoZyffSjf6YnRm6VckwAJVfeElGzqjrWTAJhAZ-xt-s 1146
flexeval/preset_configs/EvalSetup/ja_chat/mt-ja.jsonnet sha256=RF9y5cNMdm2R1GFlOtUdzfn2UlNsvtOdxzY2WovRnHM 516
flexeval/preset_configs/EvalSetup/ja_chat/rakuda-v2-ja.jsonnet sha256=we4wILxubJVZW-Hj7cuIm-f6x13KKSoJ9A3fp3h4hfA 644
flexeval/preset_configs/EvalSetup/ja_chat/vicuna-ja.jsonnet sha256=Xhdiwwzn353aaZh_HnXTkQlnXaD0yu8wBtDeiptskU4 494
flexeval/preset_configs/EvalSetup/ja_generation/aio.jsonnet sha256=GkKAqKHXA1vqKwez4ma8LtC484RkimGJZp_EfF9Lzgw 1321
flexeval/preset_configs/EvalSetup/ja_generation/jcommonsenseqa.jsonnet sha256=DOmWaZrPQiie9eCIqefTWUwvBNZPoplKDMhIyZf54gE 2581
flexeval/preset_configs/EvalSetup/ja_generation/jnli.jsonnet sha256=xNoKD0Sn5St3Dlv5HXLgkheahoXdPy1wvg527GasqcE 1697
flexeval/preset_configs/EvalSetup/ja_generation/jsquad.jsonnet sha256=bNuJzVmIbsawkEelZ4AFqEoiUn7hah5JAIr4-PV7iyA 4606
flexeval/preset_configs/EvalSetup/ja_generation/mgsm_ja.jsonnet sha256=GqeMiWoMH8_idMB87IPgD_v98xLwjJUfiHblDBywj54 1271
flexeval/preset_configs/EvalSetup/ja_generation/wrime_pos_neg.jsonnet sha256=AAbSE8Jk75p_Q1aUQjz7dVNAvelUs19shA5THKrUd9E 1791
flexeval/preset_configs/EvalSetup/ja_generation/xlsum_ja.jsonnet sha256=phtEUvzt-rxQEVumvqCXi1kIe0CIPAstf6BGiqCmaCU 1609
flexeval/preset_configs/EvalSetup/ja_multiple_choice/jcommonsenseqa_mc.jsonnet sha256=Um5XpjCVFINwhvKvzJ6VHMgbY8_JyQ0umogWmzlwqfU 1674
flexeval/preset_configs/EvalSetup/ja_multiple_choice/xwinograd_ja.jsonnet sha256=k-vTcADbzmdmEjJScqHGSTqva-TPrW1hrl_4N7av7hQ 1025
flexeval/preset_configs/EvalSetup/translation/wmt20_en_ja.jsonnet sha256=lvKll56ddY1ppUozKYb-17HNK4jEoA2tw5qoDrAVAe4 1148
flexeval/preset_configs/EvalSetup/translation/wmt20_ja_en.jsonnet sha256=A1ZCDwqAkCtbC1pUjhH9H92haDJD70elXQ8VAF10jiw 1144
flexeval/preset_configs/EvalSetup/translation_chat/wmt20_en_ja_chat.jsonnet sha256=MyoXU7Nl5HPrgOSnJcl8nRudmAGdjHrjngcQLBY725A 1003
flexeval/preset_configs/EvalSetup/translation_chat/wmt20_ja_en_chat.jsonnet sha256=9pBSjizqCtf5LnTaj9Fk7YxYwQG0Fx60PsRvtdonMx0 999
flexeval/preset_configs/Metric/assistant_eval_en_single_turn.jsonnet sha256=Bq-2S0p5_-8jDxhvGNAY2qMJos_IE50dK-foWK_7erU 2298
flexeval/preset_configs/Metric/assistant_eval_ja_single_turn.jsonnet sha256=u6inoLUzDljhmAl7lD7MgJxsboaAY_YKkcp6Iguuv0k 2732
flexeval/preset_configs/Metric/elyza_tasks_100_eval.jsonnet sha256=iIQJjoAKE4ue02oCwsE-l_lqD31g1HK-mUx83rHvnR4 1804
flexeval/preset_configs/PairwiseJudge/assistant_judge_en_single_turn.jsonnet sha256=DPvlolhD83jloUiwkFOMB0R0xy2DUULW1YbRRv8dY-M 3514
flexeval/preset_configs/PairwiseJudge/assistant_judge_ja_single_turn.jsonnet sha256=dl3Pf1EigfXvA8dG1aJmsouGOU29YCGk3eUveKVhjus 4185
flexeval/scripts/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
flexeval/scripts/common.py sha256=hfoqRDydRsQ44fXEoBMntH5aqLfexyTMCuCUj-Ej29g 1721
flexeval/scripts/flexeval_file.py sha256=CZx8trcubgMTIckHkL1GTWJvJ8U8xsRT1Bv4qbn0bd4 6439
flexeval/scripts/flexeval_lm.py sha256=KQsmUnLlSQ-R2ZtG-eqAIkNZvq8IRgV1c71-wFOQjtU 7793
flexeval/scripts/flexeval_pairwise.py sha256=7XAxO_OPpBvV5J-6OrITKWZFH83ZUya7S-UFBiZdS3Y 4569
flexeval/scripts/flexeval_presets.py sha256=PPnfj3hvtV5gO-Fwp_JnZJub1MlUd4LCgWi0tV-O88M 2365
flexeval/scripts/flexeval_reward.py sha256=ZErbQqRSNdENERIzo3c9XlYlhpq9FQRG_gZqywEY75M 3592
flexeval/utils/__init__.py sha256=cnBJPktPQiueI6xrBq_Vr-Ul3quaRAOzD7cJaebdvXU 50
flexeval/utils/hf_utils.py sha256=R3oogVOUIYtmBbvdB2eqEgYcp7LVO7lT0hnZUTCW48A 1485
flexeval/utils/module_utils.py sha256=ti97oYi8tVFMu2XBq6JmRgri30G5y4WZkmEPCEIAZEo 2616
flexeval-0.9.1.dist-info/LICENSE sha256=WNHhf_5RCaeuKWyq_K39vmp9F28LxKsB4SpomwSZ2L0 11357
flexeval-0.9.1.dist-info/METADATA sha256=hYqDbFyjdJXajPJ0jqxeidP02ZNHI-g6jNOuyE8x-IE 4284
flexeval-0.9.1.dist-info/WHEEL sha256=IYZQI976HJqqOpQU6PHkJ8fb3tMNBFjg-Cn-pwAbaFM 88
flexeval-0.9.1.dist-info/entry_points.txt sha256=GzBNfGKSLbpsEIx83Ndlud1nu0MVNHKICx08zVQC95g 283
flexeval-0.9.1.dist-info/RECORD — —

entry_points.txt

[console_scripts]
flexeval_file = flexeval.scripts.flexeval_file:main
flexeval_lm = flexeval.scripts.flexeval_lm:main
flexeval_pairwise = flexeval.scripts.flexeval_pairwise:main
flexeval_presets = flexeval.scripts.flexeval_presets:main
flexeval_reward = flexeval.scripts.flexeval_reward:main