Wheelodex » Projects » fmbench

fmbench

View on PyPI — Reverse Dependencies (0)

2.1.3 fmbench-2.1.3-py3-none-any.whl

Wheel Details

Project: fmbench
Version: 2.1.3
Filename: fmbench-2.1.3-py3-none-any.whl
Download: [link]
Size: 1549703
MD5: 3995c1d2469f06c38f84e3a868e900eb
SHA256: 964eb741b7fd0cc5167343d3ec1170f71a86c4a97079e5b0a738ba801d5b11f9
Uploaded: 2025-02-26 00:05:51 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.2
Name: fmbench
Version: 2.1.3
Summary: Benchmark performance of **any Foundation Model (FM)** deployed on **any AWS Generative AI service**, be it **Amazon SageMaker**, **Amazon Bedrock**, **Amazon EKS**, or **Amazon EC2**. The FMs could be deployed on these platforms either directly through `FMbench`, or, if they are already deployed then also they could be benchmarked through the **Bring your own endpoint** mode supported by `FMBench`.
Author-Email: Amit Arora <aroraai[at]amazon.com>, Madhur Prashant <Madhurpt[at]amazon.com>
License: MIT
Keywords: benchmarking,sagemaker,bedrock,bring your own endpoint,generative-ai,foundation-models,llama3,ec2,eks
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: <3.13,>=3.12
Requires-Dist: boto3 (>=1.36.6)
Requires-Dist: datasets (>=3.2.0)
Requires-Dist: ec2-metadata (>=2.14.0)
Requires-Dist: ipykernel (>=6.29.5)
Requires-Dist: ipywidgets (>=8.1.5)
Requires-Dist: jinja2 (>=3.1.5)
Requires-Dist: jupyter (>=1.1.1)
Requires-Dist: jupyter-client (>=8.6.3)
Requires-Dist: kaleido (==0.2.1)
Requires-Dist: litellm (>=1.59.8)
Requires-Dist: mkdocs (>=1.6.1)
Requires-Dist: mkdocs-material (>=9.5.50)
Requires-Dist: mknotebooks (>=0.8.0)
Requires-Dist: nvitop (>=1.4.1)
Requires-Dist: pandas (>=2.2.3)
Requires-Dist: papermill (>=2.6.0)
Requires-Dist: pip (>=24.3.1)
Requires-Dist: plotly (>=5.24.1)
Requires-Dist: psutil (>=6.1.1)
Requires-Dist: pydantic (>=2.10.6)
Requires-Dist: pyyaml (>=6.0.2)
Requires-Dist: ray (>=2.41.0)
Requires-Dist: requests (>=2.32.3)
Requires-Dist: sagemaker (>=2.237.3)
Requires-Dist: seaborn (>=0.13.2)
Requires-Dist: sentence-transformers (>=3.4.0)
Requires-Dist: tomark (>=0.1.4)
Requires-Dist: torch (>=2.5.1)
Requires-Dist: tqdm (>=4.67.1)
Requires-Dist: transformers (>=4.48.1)
Requires-Dist: twine (>=6.1.0)
Requires-Dist: typing-extensions (>=4.12.2)
Requires-Dist: vllm (>=0.6.6.post1)
Requires-Dist: zmq (>=0.0.0)
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 20450 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.8.1)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
fmbench/0_setup.ipynb sha256=6Ro-vPKV4aJ_KYi7Zpdjm-1lVc1v9aa6Obpc8zBMRHc 24833
fmbench/1_generate_data.ipynb sha256=ba9JQJFGgtEfi6WxWsC2MRJqUXbaXn2Uaj4nDCPo9xc 36822
fmbench/2_deploy_model.ipynb sha256=7w5UiUVr-fiQK8AiRX87oPQt8Ewe37tmwS28Rs5t2UM 24970
fmbench/3_run_inference.ipynb sha256=UPcs3tvoEkZ3JxBSFeUQLD6lKHB51TP0Au9kd19IN0Y 77150
fmbench/4_get_evaluations.ipynb sha256=MPYkngkSgjrZaNcGHVwT9_gIyOp7aO4wmNAkEDvVC4s 125486
fmbench/5_model_metric_analysis.ipynb sha256=1WboHEEkJqVczs2xhoT2xOoWTHQ2IDv7gkoyQrhzaoM 118114
fmbench/6_cleanup.ipynb sha256=Um2HWDrjMdJgzkCGhfpuJXPyDeHl14787OObaDuI-2w 7053
fmbench/__init__.py sha256=ID7e6XEauii7sRH1fxHSvZzAaap0GLw5VGTZsIRP98w 223
fmbench/bring_your_own_dataset.ipynb sha256=yJWWuQpuW1fdOIiaHoe1w2fhdSO3rOXWYOwH32J0cec 27369
fmbench/config_filepath.txt sha256=COeCMHWiO9q_kIz0so1-IRr9HYiEJmBm8rKUbfNWzAw 77
fmbench/defaults.py sha256=VdhING8L-r3us_i4QnFS--x-19_l5LsdAfrLeegjjuU 234
fmbench/globals.py sha256=swly4TB1coxdkOWdY-VrgnhjlW4yfvJH12mP6fbn5QY 18820
fmbench/main.py sha256=Y4Ax9ZZxDDYCmDsnoFBJ_CX0EVzrxbdH5hGlUeEpuvo 9856
fmbench/requirements.txt sha256=M4TQcnZg28mrS6mAy_3RcuXHLBTBwnRl2R4lXxgeBoo 151
fmbench/utils.py sha256=hwclMc3pjK8DCsMgWcvZZquaqftaeD1e3GrmNd612nI 23974
fmbench/configs/model_eval_all_info.yml sha256=WGBWMmVEwkaJAWgilOcK6D4Obojlwlt3FEExenMjOMs 5591
fmbench/configs/pricing.yml sha256=-C2weiM1OakfnSbpHqhZfM6ymfIDv5QRUys0qdc9pDQ 4019
fmbench/configs/pricing_fallback.yml sha256=w6wy7nMKuo8ZHdu4BiNC1Z8vYLDvaBnvVebUEndZv50 6061
fmbench/configs/NousResearchHermes70B/config-Nous-Hermes3-1-70b-g5.48xl-tp-8-mc-max-djl.yml sha256=kagrj5ub3DEJe_fI-qWu6CCgW_B22U126BCBwWceh8s 9395
fmbench/configs/NousResearchHermes70B/config-Nous-Hermes3-1-70b-inf2.48xl-triton-tp24.yml sha256=32QzFxG8o8oJkcQPJl72P2ds2nZf9n4NMWR3DaPhoiQ 10439
fmbench/configs/NousResearchHermes70B/config-Nous-Hermes3-1-70b-trn1.32xl-deploy-ec2-triton.yml sha256=kLZJdl1mpN8pDauNCnYpLDfOWUgOr9doXoqqR3c7J_g 10426
fmbench/configs/bedrock/config-bedrock-all-anthropic-models-longbench-data.yml sha256=YKuqi_4-32_DgrmnjbZlHNECgmvrhski4rwm4QqEXvA 7578
fmbench/configs/bedrock/config-bedrock-anthropic-models-OpenOrca.yml sha256=EQMAxxBPXTwYI6mhzhfldYf8OWnpn3L-Z49yc4UGv6g 5764
fmbench/configs/bedrock/config-bedrock-claude.yml sha256=nrzc2GH-2hW4ydP3b0eibuGEpzoMIOot8ENOpYYXGY0 5217
fmbench/configs/bedrock/config-bedrock-evals-only-conc-1.yml sha256=mM_uJ2qedB80C17PahHOURijeW4guZkI8eOWdDrmMl4 15809
fmbench/configs/bedrock/config-bedrock-haiku-sonnet-majority-voting.yml sha256=4DlfNnnetce71BvKs0zu_1uGRQqFL6XNsSwcDkFBQQM 5762
fmbench/configs/bedrock/config-bedrock-llama3-1-70b-streaming.yml sha256=xt8DfCsnZUTMGdQqVTP_pSAwe74JJbGiza2RKY1JaII 8804
fmbench/configs/bedrock/config-bedrock-llama3-1-8b-streaming.yml sha256=h15PItVaBw4rkswxEgUUvVvulMSjE2LMN3wHemryGl8 9824
fmbench/configs/bedrock/config-bedrock-llama3-1-no-streaming.yml sha256=nbxI5pVzivSguKH34UDD4dv5B-V6FegxXVxJJCuEOiI 11055
fmbench/configs/bedrock/config-bedrock-llama3-1.yml sha256=1hEfMxHMBInDRP9U-P47qv4sB4pzA1cCZeKMLwnBakI 11202
fmbench/configs/bedrock/config-bedrock-llama3-streaming.yml sha256=M9fybPmv2SgPFJIeK-Acif4RhT_Lr1sQCYO22Ep5HYc 11132
fmbench/configs/bedrock/config-bedrock-models-OpenOrca.yml sha256=At2odJpySZr8J33rN5l6fer2SsB89IwfXbxrZRHJaHY 11111
fmbench/configs/bedrock/config-bedrock-titan-text-express.yml sha256=y_-XCtDPCYLW1sN3wqFJM4R93CV2CoyJjxg5KvkaJEQ 4493
fmbench/configs/bedrock/config-bedrock.yml sha256=NtJOWqsqdMOg9OBYoxys283zLGn8JTWpa6C9dngO7rA 16757
fmbench/configs/bedrock/config-claude-3-5-sonnet-v2.yml sha256=Z9VGhQe0CPMJSrPIDFSYs3f5YPRUYMErbNmC6tJAi0c 4809
fmbench/configs/bedrock/config-claude-dolly-dataset.yml sha256=jbs3kGl3fMRvas1I2dMnfroZ60R8rqBuE3MujeyhBCQ 4479
fmbench/configs/bedrock/config-llama-3-2-11b-databricks-dolly-15k.yml sha256=vn-SGhWz121cC7Q7IEPhoBn-CxrCHY8xPKqWpcKrUic 9043
fmbench/configs/bedrock/config-llama-3-2-1b-3b-no-evals.yml sha256=fSzNVqdRtiqdduUfUudmTJ7cDYpZ9lIeTVbtFcYVP_U 11310
fmbench/configs/bedrock/config-llama-3-2-1b-3b.yml sha256=DLTUwaiQqxjX0UAWuhJGvU5vzbf4fQwCp296P9MTep8 11295
fmbench/configs/bedrock/config-llama-3-2-all-models-longbench-hf-version.yml sha256=fwMGs9Q9HO7REqsUK8QOq4aeTspdp2KVpGAji0dVCpU 16479
fmbench/configs/bedrock/config-llama-3-2-all-models.yml sha256=yp_ujZsHBdjRY1pbaOXIk1e6JCQpfjTpB3vxKuPBi90 16256
fmbench/configs/bedrock/config-llama-3-3-all-models-open-orca.yml sha256=Pz7a3Wq4V5mKRif-vsh7-XWfUySBjCf5F2lVVgwStEA 8843
fmbench/configs/bedrock/config-llama-3-3-all-models.yml sha256=mXmDiUKwenEnoEJ3t172Cb3ZXRi_cBeOtyIPf7zhhfc 8832
fmbench/configs/bedrock/config-nova-all-models-convfinqa.yml sha256=m2mCfaIpMpSee-rICBEU-mmvrz5tNg5sGmsdYUQWwUo 5707
fmbench/configs/bedrock/config-nova-all-models-dolly-dataset.yml sha256=rPSm5VBXvj0T62-3CF7H2uENEgPv7Q3sNjT5jpo-tCQ 5258
fmbench/configs/bedrock/config-nova-all-models-openarca.yml sha256=E0Myv2koupz0F4x6r_2qqe5iT1xi2BMiL2Th_QVMCF4 6331
fmbench/configs/bedrock/config-nova-all-models.yml sha256=Qc6FBZNEEp1q-YB68YViLXf4-ayQKM4ZJBSe1O56pgc 5798
fmbench/configs/bert/config-distilbert-base-uncased.yml sha256=VQrMatd1gV8zRrVDLjPrQ_Tr9LitZnCI5CDVCb8pSgE 5624
fmbench/configs/byoe/config-byo-custom-rest-predictor-tinyllama.yml sha256=S8W1xC2plgv1_2aUWIiJK49sovlcReR8G8NS8n8E9mQ 9624
fmbench/configs/byoe/config-byo-custom-rest-predictor.yml sha256=EEX22P1J0oKbMSyGpZ7Md-pSED3MZ1KjZNgXZz7nvxw 12218
fmbench/configs/byoe/config-model-byo-sagemaker-endpoint.yml sha256=8iko1pobuhl5UiNWTrFhR4MhR0zpZHZZY_yGBYc8IxE 5430
fmbench/configs/deepseek/config-deepseek-r1-ollama.yml sha256=4FOKCDjYq1Hs9DCTtUsQyGU8R62B57QiNiVFw9sEiZw 9463
fmbench/configs/deepseek/config-deepseek-r1-quant1.58-longbench-byoe.yml sha256=wGgMExjJWKv97ed20HfQJ8FRrTnG1ws574RP4eybjdk 9137
fmbench/configs/deepseek/config-deepseek-r1-sglang.yml sha256=dbASZS6KCds5jKHBt5VJ--oCtEg5HjVpxglooCsuP7A 9491
fmbench/configs/deepseek/config-deepseek-r1-vllm-convfinqa.yml sha256=h9aP2-plLjf2FIvcI1ojeEfSGW0kTcn8oydhbdyRGMk 9227
fmbench/configs/deepseek/config-deepseek-r1-vllm-longbench.yml sha256=zCMgaVn3zZ06FTcLuUM1vS3f70lRutvrztQp9gtlBuk 9162
fmbench/configs/deepseek/config-deepseek-r1-vllm-openorca.yml sha256=jmOcGfWeNuab3wKs1c91aZslJcvqRNYtDZmCBn8gAhM 9024
fmbench/configs/eks_manifests/llama3-ray-service.yaml sha256=dr-Zn-q0C3zBkxR5qXQj_NkLLk0JPeq8jiL97xtCuOU 3951
fmbench/configs/eks_manifests/mistral-ray-service.yaml sha256=h0BoBT_U5ttVCYKIE5GU1B2M5T0SzkyfbUrhB_gnInA 4954
fmbench/configs/embeddings/bge-base-en-v1-5-c5-embeddings.yml sha256=G7z9Iju_FdLDzbbvno6Seaj-OWqcrxBeQn_XMc2sGWU 5786
fmbench/configs/embeddings/bge-base-en-v1-5-g5-embeddings.yml sha256=QQKlULEYudWwFOQsdBSpM8wam7KK8vjuPTq8dPSAz_s 4918
fmbench/configs/embeddings/bge-base-en-v1-5-g5-g4dn-c7-embeddings.yml sha256=nxXEqElQjxNmj4SqMZDsvXsyVTHsQAm4qctC2wLZ0VQ 5829
fmbench/configs/gemma/config-gemma-2b-g5.yml sha256=s4jmrV1jjeMdwQldv2cUWCIIQBVxvZKEba6Xh89LHwQ 9187
fmbench/configs/generic/ec2/Qwen2.5_djl.yml sha256=C-5fTN0EU8Ogrh4Wjwwir_k6vJJppiaZvqyWDI5-Kyk 9796
fmbench/configs/generic/ec2/djl.yml sha256=GjEyGnmMJF87NgwWxeYHAU6TDZJqxVsA-TokbCzfni4 9692
fmbench/configs/generic/ec2/llama3.1_djl.yml sha256=hSL-lrejpIvw-O3q57KFztEmWCniuj0j0ai_Q-1ReuM 9451
fmbench/configs/llama2/13b/config-bedrock-sagemaker-llama2.yml sha256=5D2UBg8DvdVjfKx90IzgjpevrewprQl1HdYfoKt_GeM 5812
fmbench/configs/llama2/13b/config-byo-rest-ep-llama2-13b.yml sha256=9Xr5pebydSEl_edokzSv1x1KVuTo1ozo1yZziDPn9j8 8827
fmbench/configs/llama2/13b/config-llama2-13b-inf2-g5-p4d.yml sha256=IQ_Z-iCgKPdEKasDUT1VJlReE2BRtWDB7_P4oLXlqMQ 10446
fmbench/configs/llama2/13b/config-llama2-13b-inf2-g5.yml sha256=y42guKgFCqubfedqjKlKu9RTpwAN9zoyyZtdxj3JvIw 7035
fmbench/configs/llama2/70b/config-ec2-llama2-70b.yml sha256=izeeR72eCg207vINkdNZaRkEe0HbauniUIVF7grmxiw 9540
fmbench/configs/llama2/70b/config-llama2-70b-g5-p4d-tgi.yml sha256=RVfZud6pNU34iFXtaqNg5atrdai0BQHWrZovsuD20W0 5621
fmbench/configs/llama2/70b/config-llama2-70b-g5-p4d-trt.yml sha256=_qGgYLMeifokopSKtqgV4ilccwGRu_5EpPSMmOtyeMA 6253
fmbench/configs/llama2/70b/config-llama2-70b-inf2-g5.yml sha256=QXlIWYzb1vblFdQy5VEsEnOTkijmsB0ZKSfunCkfjuk 5708
fmbench/configs/llama2/7b/config-llama2-7b-byo-sagemaker-endpoint.yml sha256=tHomObF4Mg8i9NAHsGsSbmIVCSUICIznISSR-kXA2Bs 5635
fmbench/configs/llama2/7b/config-llama2-7b-g4dn-g5-trt.yml sha256=qC5-ftBRLK-BuIHwpe2YISkewub9dlbEf_emwPEqNMg 4704
fmbench/configs/llama2/7b/config-llama2-7b-g5-no-s3-quick.yml sha256=XfhtKZAeADZmwzH-QCIrP5F3-E2PGjQ0p9aXiHTRRwg 12149
fmbench/configs/llama2/7b/config-llama2-7b-g5-quick.yml sha256=evNh-knNx0APfl13XM6bSkOLlV4wvShLG9eFv0JynhY 12535
fmbench/configs/llama2/7b/config-llama2-7b-inf2-g5.yml sha256=ejoMsB-IGB6FfDtvbhO7f8kXmGdUnQqvdAiNTSm4xDA 7982
fmbench/configs/llama3/70b/config-bedrock.yml sha256=NtJOWqsqdMOg9OBYoxys283zLGn8JTWpa6C9dngO7rA 16757
fmbench/configs/llama3/70b/config-ec2-llama3-70b-instruct.yml sha256=Ze1vrFofkzuBrb3ZjstmfjzFtYdP3F589gVKXSRh_aY 9862
fmbench/configs/llama3/70b/config-ec2-neuron-llama3-70b-inf2-48xl-deploy-sm.yml sha256=95Cf_Yb4P701E4cLKO-GUO6h6OFt_YImBJjRVOYcFTY 9397
fmbench/configs/llama3/70b/config-llama3-70b-instruct-g5-48xl.yml sha256=p_sEZrmyBsNpIDcqydWpNnbSgg9KwFx3MDj8teYiXrQ 5119
fmbench/configs/llama3/70b/config-llama3-70b-instruct-g5-p4d.yml sha256=Klqi2KOoUPmLgrY29pa5DsUJ-q49tPmxD2RMKCP5a8Q 5669
fmbench/configs/llama3/70b/config-llama3-70b-instruct-p4d.yml sha256=63o57r2pIFZ-6ULl5gO4ZG9waO7_ddDekMzY8bie5io 4629
fmbench/configs/llama3/8b/config-bedrock.yml sha256=RpJtmiuKuRt7veCu13BQxJ4knqFjzCdfnfdXNJDs3CU 11912
fmbench/configs/llama3/8b/config-ec2-llama3-8b-c5-18xlarge.yml sha256=WBg6dm5n2C2leN1DyCPdw8nexDzYeTqexSEPoJ6FeBc 9617
fmbench/configs/llama3/8b/config-ec2-llama3-8b-c8g-24xlarge.yml sha256=HXCSudeMgav3H6Gen9qLTB2THx91WwMeB-kw8jHt4ME 9604
fmbench/configs/llama3/8b/config-ec2-llama3-8b-g6e-2xlarge.yml sha256=v0HsqLorFHqw-ilXG_3kgmU4jneUyZu6VZhisVmaFmA 9297
fmbench/configs/llama3/8b/config-ec2-llama3-8b-inf2-48xl.yml sha256=0L8cFq7vGndDXSb5gS8-JHSob9Sgjf7a2zJ0yN8FT0U 10254
fmbench/configs/llama3/8b/config-ec2-llama3-8b-m5-16xlarge.yml sha256=vsFiOGDiCSkrhFUpk7RIz2JXHR4mCrxi0QO4V8C1riU 9635
fmbench/configs/llama3/8b/config-ec2-llama3-8b-m7a-16xlarge.yml sha256=2o_uxgdFI0ybCSFG2HDNvMhUKpvkEED_JgwhOLXWUds 9024
fmbench/configs/llama3/8b/config-ec2-llama3-8b-m7a-24xlarge.yml sha256=uPDdjKjjDTd1jgcYlUyTleg5r1f9UCKv9KZmM3VNNaA 9638
fmbench/configs/llama3/8b/config-ec2-llama3-8b-m7i-12xlarge.yml sha256=HiNjPgCSTYhjEkH-HQTcql7yQ5x-Egge6Ij4iKSv_1w 9584
fmbench/configs/llama3/8b/config-ec2-llama3-8b-m7i-16xlarge.yml sha256=G29H9XhZVxGkYGPzpFchCQrOnFdeon4uLOjWyFmdxCg 9581
fmbench/configs/llama3/8b/config-ec2-llama3-8b-m7i-24xlarge.yml sha256=7ZmSHrI4Jgj7vGNgWl98QYBfu33j16a5upm4pyfAipI 9583
fmbench/configs/llama3/8b/config-ec2-llama3-8b-neuron-trn1-32xl-tp16-sm.yml sha256=y_k6v_R9F9MC7NAy7i4ebZpMRrW9FKTPiMbJNaOnGOo 11682
fmbench/configs/llama3/8b/config-ec2-llama3-8b-p4d-tp-2-mc-max.yml sha256=iVDVb-9sdK56Oda8mM4sVMwr4E5hQnPCe-bZGziQMeE 9723
fmbench/configs/llama3/8b/config-ec2-llama3-8b-p4d-tp-4-mc-max.yml sha256=4nLbQ5_v9vo3jKL8Ll9syqdF6FzO9lcg1Md4Jts4aX0 9723
fmbench/configs/llama3/8b/config-ec2-llama3-8b-p4d-tp-8-mc-max.yml sha256=rNfe3HxiJmEDK4km-RjZMChBAQyRBpqsTJYcDmsKB9k 9723
fmbench/configs/llama3/8b/config-ec2-llama3-8b-p4de-tp-2-mc-max.yml sha256=Z_6AZrXoO8_CVLvwgwmtqh42FLWNyZK2EgaiWvpE-6E 9725
fmbench/configs/llama3/8b/config-ec2-llama3-8b-p4de-tp-4-mc-max.yml sha256=-SuLp4ISxZzsFAVWgsGdLWboj8pbiDPb07qZbM54hKQ 9725
fmbench/configs/llama3/8b/config-ec2-llama3-8b-p4de-tp-8-mc-max.yml sha256=cB7QPrH0O79JPlEivDeYaeqFKOtiNQEBoZ6FTgAGqKM 9725
fmbench/configs/llama3/8b/config-ec2-llama3-8b-p5-tp-2-mc-max.yml sha256=LB5z5a5p8xcjjsNRVDUQf54y_HEOshcZNE4AWIFoRBk 9931
fmbench/configs/llama3/8b/config-ec2-llama3-8b-p5-tp-8-mc-auto.yml sha256=KmZoYAl2qZL5LrkEYKUD60ddn4ptxwqF2haioGJcBGQ 9952
fmbench/configs/llama3/8b/config-ec2-llama3-8b.yml sha256=SXLLZN7qtDN-6NCqb7BZp43P5GKOYp4XQXm7-F8Q8ts 9726
fmbench/configs/llama3/8b/config-ec2-neuron-llama3-8b-inf2-24xl-deploy-sm.yml sha256=pHfgCcXWvWBh83v5pd62VYZMaxSdtvO8s6fq72fmeb4 9384
fmbench/configs/llama3/8b/config-ec2-neuron-llama3-8b-inf2-48xl-deploy-sm.yml sha256=PuzxeDqMuh33zx13KYP1oK4vcQPWxWMiDbCtpVFkedg 9388
fmbench/configs/llama3/8b/config-llama3-8b-eks-inf2.yml sha256=U54NGKGFW6fJDeGmjDU8hm2dgYWD3yOYVmAptSgUyOY 9965
fmbench/configs/llama3/8b/config-llama3-8b-g5-streaming.yml sha256=LSHptpFd3mAwfBiyOpswyy92pjlZwzWGjF8JMbimmUU 10630
fmbench/configs/llama3/8b/config-llama3-8b-g5.12xl-tp-2-mc-max-djl-ec2.yml sha256=3OXZRp8WmgwQpmCFaiWd_VHo2weg1CxscFcGrylUycw 9387
fmbench/configs/llama3/8b/config-llama3-8b-g5.12xl-tp-2-mc-max-triton-ec2.yml sha256=nAxu1pSLXOgW9jT6jfUChZkXczgMhCEkzE1VmPYNvjw 9306
fmbench/configs/llama3/8b/config-llama3-8b-g5.12xl-tp-4-mc-max-djl-ec2.yml sha256=u1-JoDvVqF4QvAQMKlRpbSiJ3ZqGH6DpEytxR7NHRcM 9390
fmbench/configs/llama3/8b/config-llama3-8b-g5.12xl-tp-4-mc-max-triton-ec2.yml sha256=jcckDsu1dIdxov1yimP9uYKHLh1CXWijGLedRAfXfTI 9309
fmbench/configs/llama3/8b/config-llama3-8b-g5.48xl-tp-8-mc-max-triton-ec2.yml sha256=Q0fc-6SowpMysNY1LTxqmZY6xCBrMuy47T3NILWJ6p8 9326
fmbench/configs/llama3/8b/config-llama3-8b-g5.4xl-tp-1-mc-max-triton-ec2.yml sha256=hLaq9Fvv5vtxn_WDvSdXimofI6gtWOgAhBBk4t0bekA 9304
fmbench/configs/llama3/8b/config-llama3-8b-g6e.12xl-tp-2-mc-max-djl-ec2.yml sha256=js9hE22Em8g6FrEM-ycwKNqO9vtXQ_jE5O5tcONYbO0 9397
fmbench/configs/llama3/8b/config-llama3-8b-g6e.12xl-tp-2-mc-max-triton-ec2.yml sha256=wcPf8Yt_YTO5UEu-8GS53wgD5vhBfK7_sQ9900ghl0A 9316
fmbench/configs/llama3/8b/config-llama3-8b-g6e.12xl-tp-4-mc-max-djl-ec2.yml sha256=wC_GPy2u6WttQSO6ywfc8yXIjtQ3VpN48ZysprZ3zuA 9400
fmbench/configs/llama3/8b/config-llama3-8b-g6e.12xl-tp-4-mc-max-triton-ec2.yml sha256=opiDK-hgH9O8VVO0yp_9tR3CAIiYMBVt0IabYypPueY 9319
fmbench/configs/llama3/8b/config-llama3-8b-g6e.24xl-tp-2-mc-max-djl-ec2.yml sha256=DXPOJdN3-rnDSpO2ZNzj_tPsw10i00k4D8JjrNNzD7o 9397
fmbench/configs/llama3/8b/config-llama3-8b-g6e.24xl-tp-2-mc-max-triton-ec2.yml sha256=akcBCoAh1TkrbouyuZz0E8ishN73V90qGF-SUZR3-Xw 9316
fmbench/configs/llama3/8b/config-llama3-8b-g6e.24xl-tp-4-mc-max-djl-ec2.yml sha256=qbNN-uUtHYfFLfERxCnmv_HsEOre-LlMi9Wi9wtXwB8 9400
fmbench/configs/llama3/8b/config-llama3-8b-g6e.24xl-tp-4-mc-max-triton-ec2.yml sha256=SzMhGjM3qRB3GeGtms7n1TC7vr_VwmknEdYU8GusDWM 9328
fmbench/configs/llama3/8b/config-llama3-8b-g6e.2xl-tp-1-mc-max-triton-ec2.yml sha256=d-c1tc6_X3skk7L6CEw_jUDx8gfrAAdLEpsBBzVnkE0 9306
fmbench/configs/llama3/8b/config-llama3-8b-g6e.48xl-tp-2-mc-max-djl-ec2.yml sha256=sIj2Jqwt1q57ul4mMEWZBAR2Pn4roUdvimkOrv0VxLE 9397
fmbench/configs/llama3/8b/config-llama3-8b-g6e.48xl-tp-2-mc-max-triton-ec2.yml sha256=xqnjNrGUnseXBVTKGNxwWcXuwxNhZli6ZDCUN1nL8CQ 9343
fmbench/configs/llama3/8b/config-llama3-8b-g6e.48xl-tp-4-mc-max-djl-ec2.yml sha256=GLyMmi_pL205YPXAwnhToHA1CCO1n_YB3xMNV7JskyU 9400
fmbench/configs/llama3/8b/config-llama3-8b-g6e.48xl-tp-4-mc-max-triton-ec2.yml sha256=6s8ktYd6VNWTtK8q-eMuJbOjw6vJ9C2d0L8r28zzWTc 9328
fmbench/configs/llama3/8b/config-llama3-8b-g6e.48xl-tp-8-mc-max-djl-ec2.yml sha256=GLyMmi_pL205YPXAwnhToHA1CCO1n_YB3xMNV7JskyU 9400
fmbench/configs/llama3/8b/config-llama3-8b-g6e.48xl-tp-8-mc-max-triton-ec2.yml sha256=6s8ktYd6VNWTtK8q-eMuJbOjw6vJ9C2d0L8r28zzWTc 9328
fmbench/configs/llama3/8b/config-llama3-8b-g6e.4xl-tp-1-mc-max-djl-ec2.yml sha256=IHJBOC6c_0vFulCnmceDgZRubs1pgwq9SMTwMgtGdtQ 9320
fmbench/configs/llama3/8b/config-llama3-8b-g6e.4xl-tp-1-mc-max-triton-ec2.yml sha256=OQ4DPWKYe0V9E7psQ0oX8J8W-JuS-IMKenlIf1QbAZg 9306
fmbench/configs/llama3/8b/config-llama3-8b-g6e.xl-tp-1-mc-max-triton-ec2.yml sha256=VlxOOKwvE7YYONi2IDj6r1w0hgFBfRKm02Z5h4d0wZM 9304
fmbench/configs/llama3/8b/config-llama3-8b-inf2-24xl-tp=8-bs=4-byoe.yml sha256=8Ye0LuLj1_d5TfOyI2wL3Ce2h7hBgkmiOO78dKWXYq0 10237
fmbench/configs/llama3/8b/config-llama3-8b-inf2-48xl-tp=8-bs=4-byoe.yml sha256=qrH6mpQ4e_YmmJJFwAG8T4wFhu3aGEFiIcuhe2jGezw 10188
fmbench/configs/llama3/8b/config-llama3-8b-inf2-48xlarge-triton-djl.yml sha256=wur6Vb8K1k5QItyRWRDLFNHD_r2sVxXMjOWPYScMkA4 10559
fmbench/configs/llama3/8b/config-llama3-8b-inf2-g5-byoe-w-openorca.yml sha256=YcmlMYVl12c6eYLlqrsAHsFV1z-g7gTbOk4PtsLJo8g 9561
fmbench/configs/llama3/8b/config-llama3-8b-inf2-g5.yml sha256=kl-WQrlc-j1-uSQj5Ch8ZQ6zZVffhZcqQevxmRjhpPQ 10919
fmbench/configs/llama3/8b/config-llama3-8b-instruct-all.yml sha256=fF2Y4LzD-K7hV4y0v4nBLKkBkucvJuGGOU_DbU5IeAo 23362
fmbench/configs/llama3/8b/config-llama3-8b-instruct-g5-12xl-4-instances.yml sha256=6yFx0NiEISTP9GcFnWIIK8AfzibCs3VpBHyXisMjQ0c 4149
fmbench/configs/llama3/8b/config-llama3-8b-instruct-g5-12xl.yml sha256=NbPpzTQY91sDQVjG1sY_xaYdrdygeIkg69Vw3KiVDsg 4905
fmbench/configs/llama3/8b/config-llama3-8b-instruct-g5-24xl.yml sha256=YquUd-FmWW4fshSQwqo2j0_LY0TfAJE4do1GugJfR2E 4907
fmbench/configs/llama3/8b/config-llama3-8b-instruct-g5-2xl.yml sha256=tjEvGUl-WgDB7C9VBOfBa5zlgFZQZ1NA0GRrmHtgTzc 5429
fmbench/configs/llama3/8b/config-llama3-8b-instruct-g5-48xl.yml sha256=LGKWcEdh-dcGWM9Nx7KYN3AY6C0Rz5yhTBiM3YMCWdE 4903
fmbench/configs/llama3/8b/config-llama3-8b-instruct-g5-p4d.yml sha256=m4taH39szpJVTtO_Fnsf06iVo8qbOizLqpaJDeLWlVc 5792
fmbench/configs/llama3/8b/config-llama3-8b-instruct-g6-12xl.yml sha256=C_JMgckjc8voX1F3O-aCS1fa9IzmRcsJWO6F50JVeXg 5446
fmbench/configs/llama3/8b/config-llama3-8b-instruct-g6-24xl.yml sha256=PU9Ha0mjhxOO60JdPwnMyOe6gYYtIWicozu4js6ZRn0 5446
fmbench/configs/llama3/8b/config-llama3-8b-instruct-g6-48xl.yml sha256=3Zb1AYHc4athDRHpwJJ_HuJg79DR51qmLZzBUKDSV5k 5446
fmbench/configs/llama3/8b/config-llama3-8b-instruct-p4d-djl-lmi-dist.yml sha256=KOgvoxMGmPzSya5XL2H7b5-qYtA_bTe6u4QtKbV2adw 5212
fmbench/configs/llama3/8b/config-llama3-8b-instruct-p4d-djl-vllm.yml sha256=qOcsJxkwiPnh5diU6cl4AahuwIZrW3EXKurdN1MXIUc 4662
fmbench/configs/llama3/8b/config-llama3-8b-instruct-p5-djl-lmi-dist.yml sha256=44w5esNXPb0F_ast7VaNCAtTTFPVQHe1ee40ZTybF3s 5367
fmbench/configs/llama3/8b/config-llama3-8b-trn1-32xl-tp-16-bs-4-byoe.yml sha256=7NGN6o01kEO8qV_D9ZyH7WO_t-qNd67N0pLjOlMyz5A 10239
fmbench/configs/llama3/8b/config-llama3-8b-trn1-32xl-tp-8-bs-4-byoe.yml sha256=OfYmikoqO-jkeMt6zxWoqmThfsjSE5jN5CQJntXkk-A 10207
fmbench/configs/llama3/8b/config-llama3-8b-trn1-32xl-tp16-bs-4-ec2.yml sha256=ysnFWi6uYhZOn52-rnJ1sV4rbvDVC9E0RtTa0q9egE0 10734
fmbench/configs/llama3/8b/config-llama3-8b-trn1-32xlarge-triton-djl.yml sha256=MbpNIapV0-kdUuxKv6hdC82Fw0swly2o0m_OVYnqy2w 10438
fmbench/configs/llama3/8b/config-llama3-8b-trn1-32xlarge-triton-vllm.yml sha256=X-KTfxYJVcCZqMw4mto4l6coSvmJWA6cS8jxU_aXYKE 11604
fmbench/configs/llama3/8b/config-llama3-8b-trn1.yml sha256=7MItZZc6ujXbNZqS4kLNt-Zxo-MoIPAJ4Ku4A0kr1rM 9897
fmbench/configs/llama3/8b/llama3-8b-inf2-24xl-byoe-g5-12xl.yml sha256=8SddMYbXVl46xn6I8VzXZSsMEyF7AUEIt_xreN21hvo 11215
fmbench/configs/llama3/8b/llama3-8b-inf2-48xl-byoe-g5-24xl.yml sha256=13RaViK1d7Zi9yQJJxaWpTdR66umGTDTuri5fIopB04 11219
fmbench/configs/llama3/8b/llama3-8b-trn1-32xl-byoe-g5-24xl.yml sha256=f-ObUHKDU_wgm43EMIEewcyiMPFCz95h4MmFTJ18mRY 11219
fmbench/configs/llama3.1/70b/config-ec2-llama3-1-70b-inf2-48xl-deploy-ec2-djl.yml sha256=ApyxoA4R7qiXN30AhKbpENK-iAtvNzHVpiVGDoQu-HU 9420
fmbench/configs/llama3.1/70b/config-ec2-llama3-1-70b-inf2-deploy-sm.yml sha256=gHwyVQBZdcdYBuiAWiU3lr_3p8L_ONSGM0nS4bbOwAQ 9344
fmbench/configs/llama3.1/70b/config-ec2-llama3-1-70b-p4de.24xl-deploy-ec2-large-prompts.yml sha256=z_VRMjpyqlSVa2Wc1fgiXcO4j4WhfWXg_5edd55lwmE 10991
fmbench/configs/llama3.1/70b/config-ec2-llama3-1-70b-p4de.24xl-deploy-ec2-longbench.yml sha256=n59XrRgiO1f_2g_XuWfgWWe35hQy_RJRV2vewBxnQeo 9447
fmbench/configs/llama3.1/70b/config-ec2-llama3-1-70b-p4de.24xl-deploy-ec2-summarization.yml sha256=JQiR2T9gdUZPnI-s0SDnejb9LQGQJcb88ex6kUR6348 9663
fmbench/configs/llama3.1/70b/config-llama3-1-70b-g5.48xl-tp-8-mc-max-djl.yml sha256=Wdmh5LIOXNgF0cuao-A4X3XFtsYbPXkl80h0k5A5dXw 9403
fmbench/configs/llama3.1/70b/config-llama3-1-70b-g6.48xl-tp-8-mc-max-djl.yml sha256=In-EMxA7fqbB2F8wo4lmjKj3moDDN4xPug_-0IaboGw 9404
fmbench/configs/llama3.1/70b/config-llama3-1-70b-g6e.24xl-tp-4-mc-max-djl.yml sha256=4WLixzAG4nGWlkVvEuEn90iz75YT1PToRjrbvVbVhI4 9443
fmbench/configs/llama3.1/70b/config-llama3-1-70b-g6e.48xl-tp-8-mc-max-djl.yml sha256=mtdXbQCtHuqLn_aFLSpaeSisD8C5bRa1rwvtcRQH-6c 9443
fmbench/configs/llama3.1/70b/config-llama3-1-70b-inf2.48xl-deploy-ec2-triton.yml sha256=Atj_GFpZxrZbSRr9jpdgaTNj5-5vwoGBA1F7-59vjIs 10408
fmbench/configs/llama3.1/70b/config-llama3-1-70b-inf2.48xl-triton-tp24.yml sha256=zC8uiizrt1fqxll7B4oU1chQiBDZA5ZqWChaP5P-oR0 10435
fmbench/configs/llama3.1/70b/config-llama3-1-70b-p5-djl-lmi.yml sha256=GR6DkULiye4ZsbJxQfJbBJTZJTsQ9NEB806xbMpdRbc 9454
fmbench/configs/llama3.1/70b/config-llama3-1-70b-trn1.32xl-deploy-ec2-triton.yml sha256=d-J3N4HUPaxLlOPRFz76Qjnngtf0Scm-Zx5lGVT1pxw 10433
fmbench/configs/llama3.1/70b/config-llama3-1-7b-inf2.48xl-triton-ec2.yml sha256=mg8SvAYVEQEQyK1ZGt9YEHGR5uenpERQ7d8Qd3-mOw4 10401
fmbench/configs/llama3.1/8b/client-config-ec2-llama3-1-8b.yml sha256=OkYcHP_1ASWccrWZNTkkTB0qp8bf35BHMGZZ9U6iYZg 8478
fmbench/configs/llama3.1/8b/config-ec2-llama3-1-8b-g6e-2xlarge-byoe-ollama.yml sha256=W3ElLDO12zZO-gaB1QsvdfaaKcMnonS15HiXGfHRsvk 9120
fmbench/configs/llama3.1/8b/config-ec2-llama3-1-8b-inf2-48xl-deploy-ec2-tp24-bs12.yml sha256=2nCIDZj_bt12i5_P6oofJY6K8jgmlRp6nc_MGjx2RA4 10099
fmbench/configs/llama3.1/8b/config-ec2-llama3-1-8b-inf2-48xl-deploy-ec2.yml sha256=-4BcEaJI8jO_T9i1J1i9GoqEvxK12uJ6BWq8VBtDy8w 10140
fmbench/configs/llama3.1/8b/config-ec2-llama3-1-8b-inf2.yml sha256=_Mb17oYQp24AT0_VNfsyxxz595Kk4rei4zJlQKOPRXk 9458
fmbench/configs/llama3.1/8b/config-ec2-llama3-1-8b-p4-tp-2-mc-max.yml sha256=GHTPi4IwUvgyPoBkgyK3v0AefNJLIqkIKXV78zPaz2w 9797
fmbench/configs/llama3.1/8b/config-ec2-llama3-1-8b-p4-tp-4-mc-max.yml sha256=-lxQ0rJyJrFRxl3uI5OSuWlDjnZC1WuO9p1hKK1N_tU 9797
fmbench/configs/llama3.1/8b/config-ec2-llama3-1-8b-p4-tp-8-mc-max.yml sha256=4mHVK0ZPrn37-RATbYyPLeVLNExch0wKyIVkrEFKueI 9796
fmbench/configs/llama3.1/8b/config-ec2-llama3-1-8b-p5-tp-2-mc-max.yml sha256=JHoLbz1k7-ZhGxeSHMDdbmCyE0N4DoDVU8DaGZxUSY0 10108
fmbench/configs/llama3.1/8b/config-ec2-llama3-1-8b-tp-8-mc-auto-p5.yml sha256=cY9nmlc6V6k9X7FVoWeuuvBA2qyuVHBTvZrdW4wQMcU 10058
fmbench/configs/llama3.1/8b/config-ec2-llama3-1-8b-trn1-32xl-deploy-ec2-tp32-bs8.yml sha256=xCBFFjnCcbzeN6uIlq8LW4UOLgNF5VJVQWOCKpu0alE 10206
fmbench/configs/llama3.1/8b/config-llama3-1-8b-g5.12xlarge-djl-lmi-sm.yml sha256=69E2-ZBjnNFIq3diB7cMT9SbMd1siLyZWid3pwk3Pk0 4766
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5-ec2.yml sha256=t8cw6_QHNGIT_0eyEjngXZE-QjFJHvx_Kx-_ZpPNfys 9930
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.12xl-tp-2-mc-auto-ec2.yml sha256=uAoHap2DeBvLZ4lEm5iluSmsb5WO6ACqnvCBcTULM2g 9915
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.12xl-tp-2-mc-max-ec2.yml sha256=ZDye9GW7kVEjyu5TfqOVi19DlYTWTnbd6yOrGco6tP4 9914
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.12xl-tp-4-mc-max-ec2.yml sha256=i7uQkjE9S5CLPY6WJfnsstInGNEJanH2FkGQJhBdlf4 9914
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.24xl-tp-2-mc-auto-ec2.yml sha256=dWoYop8u_SiHTv0MNfaUOWvukT2dEQKI09U1JdXF0zE 9653
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.24xl-tp-2-mc-max-ec2.yml sha256=hnbtHFhMegcqvx6Qhd0SkcLRAYldXDrDyOcqD30HFZ8 9684
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.24xl-tp-4-mc-max-ec2.yml sha256=FTIsRsdNZGRDRvX2eAa8pdW-oJgOdUVA3hXI-GC6cyQ 9651
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.2xl-g5.4xl-sm.yml sha256=7D5dKDzDE6EL_cow4meSNYA-ZAv69O564RMzIMuEwF8 4913
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.2xl-tp-1-mc-max-ec2-conc-1-2.yml sha256=0AKgDy-Gibg4qvSqPDZAJA-_rRVvnid3sp6Adrltoxs 9622
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.2xl-tp-1-mc-max-ec2.yml sha256=-X_kW44kt1xKRM-ZDL4jDWI-qfNba9AwtHTp04TlESE 9734
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.48xl-tp-2-mc-auto-ec2.yml sha256=5xJTpumdtng5fycl4oD5ZsdSxyuprrG1m9vbJOZWKJg 9685
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.48xl-tp-2-mc-max-ec2.yml sha256=GyY1Ct7xFhrjSdnfq62Z-xK1cB-PZ5Govpazfr_IdUQ 9684
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.48xl-tp-4-mc-max-ec2.yml sha256=YFKLmWse1_lutKUDxUBK2Nep38fu-E410dS7-AMvp3c 9684
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.48xl-tp-8-mc-max-ec2.yml sha256=B6f6uX9xGO6pKLrUxzIWhxvus5-IwnjWYuwOK-N0TdE 9684
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.xl-tp-1-mc-max-ec2-conc-1-2.yml sha256=5eG7FnQUa_2x6kTf9awaiGGahXkIa-a7xmqz9zIynew 9625
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g5.yml sha256=4qLznHKlcrYQ0AZfkSm38hJOLQu0NwXb5IIL8aw-1DM 5992
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g6e.12xl-tp-2-mc-max-djl.yml sha256=KXLeLHhWJz_rgLgFeDrvNTsnHwnj22r1bqeo6mn7dLw 9433
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g6e.12xl-tp-4-mc-max-djl.yml sha256=AVX4grxYrKveUllwmK4xnMR8JSaDu7tRzAAz79pBle0 9418
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g6e.24xl-tp-2-mc-max-djl.yml sha256=jcFczeAM9mKiK_hKTt273tSoevA5oKCDk6fQ83SHQa8 9442
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g6e.24xl-tp-4-mc-max-djl.yml sha256=OCgGtv9iN5xeVOJid1NvczAJO-aIun4cT0GmLQqJ8rA 9418
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g6e.2xl-ollama.yml sha256=gki8FpoaQQ-kAF8jkWnUEZ0qjTh01KF1okaszJz2U2M 8983
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g6e.2xl-tp-1-mc-max-djl.yml sha256=4NlE2f94ZTSnP8_Z36xMEHHfTTDQlk2nGbrZ-lx5FDc 9372
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g6e.48xl-tp-2-mc-max-djl.yml sha256=ISApcxYvoPNGqNA4JAHjIoUiULDcTGHgrLDvRN6hOuk 9442
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g6e.48xl-tp-4-mc-max-djl.yml sha256=MHklqWhPrADQk_wO5Mh8pLgCxC5_nyTvSQthmyudxcA 9436
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g6e.48xl-tp-8-mc-max-djl.yml sha256=TP4W-KIRmWoCKL9GNARvDN6FYSmki61paY9Rt6EqWU4 9436
fmbench/configs/llama3.1/8b/config-llama3.1-8b-g6e.4xl-tp-1-mc-max-djl.yml sha256=EFGuz6_q-UPJ4J6XYFVIzMmse8BL0aslzJrcjW2Ppd0 9357
fmbench/configs/llama3.1/8b/config-llama3.1-8b-inf2-48xl-deploy-tp-24-ec2.yml sha256=AjSCT64zSG07pXk1XWYO5GQ_4MuP8B4Ekph7TM-kFI4 10271
fmbench/configs/llama3.1/8b/config-llama3.1-8b-inf2-48xl-deploy-tp-8-ec2.yml sha256=7y19gZCMpib3Ydhcg5t6gtd4Ru-FMc8hOzmd3LGV1QQ 10163
fmbench/configs/llama3.1/8b/config-llama3.1-8b-trn1-32xl-deploy-tp-8-ec2.yml sha256=GmxvE1Wf-TTnlmuDdNxjcPmc1OugCF6eciYBFiMdq_U 10734
fmbench/configs/llama3.1/8b/config-llama3.1-8b-trn32xl-triton-vllm.yml sha256=BWoi5dUkKqvSN99ndUeh5UYNMeP8V1rFiIKLy5_1NpQ 11036
fmbench/configs/llama3.1/8b/server-config-ec2-llama3-1-8b-inf2-48xl-deploy-ec2.yml sha256=tZ_zYFMGvsioa0AmjoTZDy5WHesQ8kSH60bf04mcbUY 10134
fmbench/configs/llama3.2/11b/config-llama3.2-11b-g6e-2xl-tp-1-mc-max-djl-vllm-ec2.yml sha256=QYkoPqylYh9DYVG1NHx1BPda8wIUWFq36vqC0MiNioM 9829
fmbench/configs/llama3.2/1b/config-llama3.2-1b-g5.2xl-summarization-500-50.yml sha256=hCgEqGrn61vnjYg7Fn5h6g35-uPHztj2mhdP3VcYjNQ 8779
fmbench/configs/llama3.2/1b/config-llama3.2-1b-g5.2xl-tp-1-mc-max-djl-ec2.yml sha256=vrZk-TRXz5lENfPqMLSl-DK367vu0FFMeMQl66fLLgs 9578
fmbench/configs/llama3.2/1b/config-llama3.2-1b-g5.4xl-tp-1-mc-max-djl-ec2.yml sha256=ik0EaiFE6HxLmA7tpO5RH94_42vMfRCU8QS9-qWS-oE 9668
fmbench/configs/llama3.2/1b/config-llama3.2-1b-g6e.2xl-tp-1-mc-max-djl.yml sha256=t-u6RTE6klaAYuFDNoMGIB6Wo3SJsdFL_fTg3GNFnMY 8646
fmbench/configs/llama3.2/1b/config-llama3.2-1b-m5-16xlarge-ec2.yml sha256=l-N4LTu_3zMfd1UynK7AeA75M9mTD2XWWeWCPn_Fan8 9661
fmbench/configs/llama3.2/1b/config-llama3.2-1b-m7a-16xlarge-ec2.yml sha256=AWTRoq1Mui1_pqim2LY9Uomklm55tZhinG1yV7xGG-s 9048
fmbench/configs/llama3.2/1b/config-llama3.2-1b-m7a-24xlarge-ec2-summarization.yml sha256=17V6ySyV_hlChx7gOaxHEbL7ZwwQcTyAatdB8RxxQHQ 9436
fmbench/configs/llama3.2/1b/config-llama3.2-1b-m7a-24xlarge-ec2.yml sha256=wum4jjmxc4ccGxgoQB5NGpNkOfqan9aEmbfJo2P8zzk 9657
fmbench/configs/llama3.2/1b/config-llama3.2-1b-m7i-12xlarge-ec2.yml sha256=DXyXWlS4iRTtfUJHNyXSvewrw2NvYFxpm1RRFqoz_yw 9605
fmbench/configs/llama3.2/3b/config-llama3.2-3b-g5.4xl-tp-1-mc-max-djl-ec2.yml sha256=EJDLbLgXjk-_eUegDq2JCIk1unv6pFiTxf3eCjbUGVc 9669
fmbench/configs/mistral/config-mistral-7b-eks-inf2.yml sha256=F5YJmJ4k2mYCJ1gCKM8MdwGs3xcd_z-2YxOd_lEWaR0 9917
fmbench/configs/mistral/config-mistral-7b-tgi-g5.yml sha256=czXkhGXjzUeD3AnYih3jC21DB37Nb9tg9Q6f6MPxSnE 4802
fmbench/configs/mistral/config-mistral-7b-trn1-32xl-triton.yml sha256=HoMY1IiVf9QDJUo_ZWMQdkEJs-30h5482NHgZ7UrxcU 10634
fmbench/configs/mistral/config-mistral-instruct-AWQ-p4d.yml sha256=4_C26oIYDv-ISDI53aND0XXSnuQremji1ZOwxIHZCz8 4853
fmbench/configs/mistral/config-mistral-instruct-AWQ-p5-byo-ep.yml sha256=rCwifEUXJB0_3tyzhOsCNN4gKOjOqmJsI4wxhzBXm84 4537
fmbench/configs/mistral/config-mistral-instruct-AWQ-p5.yml sha256=DhDh3vnqpB3rn_Jm2-4FrkxUAajqKhr0n9RHLtt-9og 4722
fmbench/configs/mistral/config-mistral-instruct-p4d.yml sha256=5h5PG7MYjewnjEg-AJFr9ogcT4SPwAcn7-t3MsZBcVY 3792
fmbench/configs/mistral/config-mistral-instruct-v1-p5-trtllm.yml sha256=58j8-deN5ggM7xSz7qrZMl1_GWGzGdqIg9lYnAl2w_M 4883
fmbench/configs/mistral/config-mistral-instruct-v2-p4d-lmi-dist.yml sha256=pKsgnzdCcCn_KrrY8xq2V9MZQPfQnCwlUMit67Ahe-8 4646
fmbench/configs/mistral/config-mistral-instruct-v2-p4d-trtllm.yml sha256=yi0-rygdGqZ_JyZGUUqaEDBiJkMJNR5FsOh7wjxK_04 4868
fmbench/configs/mistral/config-mistral-instruct-v2-p5-lmi-dist.yml sha256=EU_uzNVsfrfL_zGythluFg2MjfJi8l51MzoClDCYyxk 4628
fmbench/configs/mistral/config-mistral-instruct-v2-p5-trtllm.yml sha256=Hf-Buau1vPkg6z_p6fo8iCY4y6jehdcSFWRmTJz4mGw 4876
fmbench/configs/mistral/config-mistral-trn1-32xl-deploy-ec2-tp32.yml sha256=77GXd6jJ8OKFNpqaP6xw2ef-1tdsPoQdLsF1PpPl1_M 10155
fmbench/configs/mistral/config-mistral-v3-inf2-48xl-deploy-ec2-tp24.yml sha256=w7Y6JH8fqCcEjRjO1XoXKSk0oUqHzHgDvIbar_Y2c1w 10119
fmbench/configs/mixtral/config-mixtral-8x7b-g6e.48xl-ec2.yml sha256=yQxV1Lofi6RVlwp7zOC2aiwiADvtzE5T-7NwpV8q02U 9515
fmbench/configs/multimodal/bedrock/config-claude-scienceqa.yml sha256=1FvCtyKMaDXNXPoeT4FMCjVPg79U5uZw6sOg0fBn3qA 12470
fmbench/configs/multimodal/bedrock/config-llama-3-2-11b-vision-instruct-marqo-GS-10M.yml sha256=9TWyFDOiybamOdV9z-jY-RKKBuaHRkNWBQs-lHFlT0Q 9616
fmbench/configs/multimodal/bedrock/config-llama-3-2-11b-vision-instruct-scienceqa.yml sha256=Xq8kAOPjZf3iqbVlmJBHp2TAqk02eXTsbqgaDXIEG3Y 10239
fmbench/configs/multimodal/bedrock/config-llama-3-2-claude-models-scienceqa.yml sha256=s9fDeqrokbq26BZCtkkEn2aymYf8ldMLj4cyeQ8bBjU 14758
fmbench/configs/phi/config-phi-3-g5.yml sha256=-EKMGYtIzsrs5_iPtWdvVv__vU7Xvm7b2apvJhzaehg 9197
fmbench/img/llm_eval_flowchart.png sha256=mBeLmorlBvq74kXdwJIOKXsl2VrZLVXMKeu5ZAmHrVk 86543
fmbench/prompt_template/prompt_template_bert.txt sha256=4ZpVzP-zyp0bNosvV-f2GYb0yXaf3svyXgKary8k9tA 7
fmbench/prompt_template/prompt_template_claude.txt sha256=XglvBLriIS9pLAUy4aqKXONdI_ZR9UynqlVevDXSTLw 586
fmbench/prompt_template/prompt_template_claude_OpenOrca.txt sha256=gXppmhNjwjwEE-0PPKPQMRGzH2CbULTKy7z8px-3tKI 421
fmbench/prompt_template/prompt_template_claude_dolly_dataset.txt sha256=aNCezF43Vm3hCYZz5bNziZkW6X8erJXsZXk6ThGKVaw 536
fmbench/prompt_template/prompt_template_claude_images_ScienceQA.txt sha256=CIU8lmMKTY1qgGTDZsRFk3fL3xzcXsGmoiXRgLokqDY 604
fmbench/prompt_template/prompt_template_convfinqa.txt sha256=rkMosFHJLcmtVPUDQlvl7nGFiygGwjtcVM7aWnYgnG4 8
fmbench/prompt_template/prompt_template_deepseek_longbench.txt sha256=y1JwvWxNPnSJ-dl1DVoE3Dr7YWY2RjTNgEzzXRqucx8 716
fmbench/prompt_template/prompt_template_gemma.txt sha256=rHHskpPGK-lsCln_0tavo18sz2TZCXAFwu5pGO_0rj8 303
fmbench/prompt_template/prompt_template_llama2.txt sha256=eWgeq2VenJZ4ExjjuSAA93XHBQCciAnIcoqX9w2_FDs 611
fmbench/prompt_template/prompt_template_llama2_Mistral_OpenOrca.txt sha256=hWwBBG9bm8gRVxTRoadymK9z4BAt5DAgOHCeHaqR678 80
fmbench/prompt_template/prompt_template_llama3.2_vision.txt sha256=gXI70gfRFxKbNAq8a8plM_ATKmDpK_5hQc7zc5YlPdg 566
fmbench/prompt_template/prompt_template_llama3.txt sha256=yyuJkUACJXXrtjWId5jq8hPvYiuj6_2wWVda0yQGtL8 572
fmbench/prompt_template/prompt_template_llama3_OpenOrca.txt sha256=cwFRmZlgpHsd-P-4tVK5Iy6QTXc7f8QalW36ima7DJo 159
fmbench/prompt_template/prompt_template_llama3_OpenOrca_accuracy.txt sha256=I8enevanLL3CBZHYEh-r8IY4qUbxC18ro5qACkQDXGg 476
fmbench/prompt_template/prompt_template_llama3_databricks-dolly-15k.txt sha256=YVJYchs7gjDw28A1d1GVQvXod_k3wV96PCZxehmybEk 504
fmbench/prompt_template/prompt_template_llama3_images_ScienceQA.txt sha256=mZgQRw_Nhp2YWJPt9UGukwzvuodxNoGEQD9NN0f4008 616
fmbench/prompt_template/prompt_template_llama3_images_marqo-GS-10M.txt sha256=M0pLpf0-EncVo7TW2YFoMHOjaNbwOQE1LmDLc_r2utM 371
fmbench/prompt_template/prompt_template_llama3_summarization.txt sha256=ugnjJ6D1QkRGLlk_Uvy9v_RVLpiSgQQBEVCdliw-wAk 416
fmbench/prompt_template/prompt_template_mistral.txt sha256=61fDPZweCjWv4e5gV28Es3lcNP5ZTpRtclBe7F2e7Fg 594
fmbench/prompt_template/prompt_template_nova.txt sha256=01fmrwOXhdAP8w_tYT8eniz2v658v-cJ0lVXkYEaiYk 715
fmbench/prompt_template/prompt_template_nova_convfinqa.txt sha256=hsoqW8m_Z7cawZOITqBNyzCncRVI2mY-Z1fapXSCXyw 198
fmbench/prompt_template/prompt_template_nova_dolly_dataset.txt sha256=9kTp7EdLbsJld0AetmPMdAyzo5UgyCYsuuEA30rI5JI 13
fmbench/prompt_template/prompt_template_nova_open_orca.txt sha256=sMSUJVYps_mTeDyufJJOOD4ohla_yKDX99D-WINZ7QE 359
fmbench/prompt_template/prompt_template_open_orca.txt sha256=arg23QSP-ZZl0k-r1N41HIo5OmArrAfliJuxCikDflc 11
fmbench/prompt_template/prompt_template_qwen.txt sha256=eghzhOToXkP3E8c8z3w2Ad-vNXIPfc859y4Qr1WWMBE 571
fmbench/prompt_template/prompt_template_titan_text.txt sha256=l3Lcp238cUf-CHW3MH6aGsJU_WidE3AX6NeVT6xCSBA 566
fmbench/prompt_template/eval_criteria/evaluation_instructions_majority_vote.txt sha256=sIeM46JEm78Xm6SpqbA9DbVGp5tKw-TZfF03kSXy8uQ 1700
fmbench/prompt_template/eval_criteria/claude_eval_prompt_templates/claude_eval_majority_vote.txt sha256=hXF_YNMJI4_i1J8abgXhs9L7_XOSav_F0PLRX97lc4Q 1450
fmbench/prompt_template/eval_criteria/cohere_eval_prompt_templates/cohere_eval_majority_vote.txt sha256=1G8jwg3Ky5yBxqYPlfG-Yaeknq0D9qNga9395OpFoFE 1123
fmbench/prompt_template/eval_criteria/llama3_eval_prompt_templates/llama3_eval_majority_vote.txt sha256=j_3OVTyPiIPOpgjHv7MEBtgDHf85H9lepER5iZEoS2w 1146
fmbench/prompt_template/eval_criteria/mistral_eval_prompt_templates/mistral_eval_majority_vote.txt sha256=KPJs2u05k4YBMmHh7OQ2rK70PanUvldIWn6VPWt8xX4 1519
fmbench/scripts/bedrock_predictor.py sha256=Ujw10MAFVUqLUCpaaXQUHTjBnOCVzzbXfKQ-87s1UIU 20193
fmbench/scripts/bedrock_predictor_converseAPI.py sha256=U1LneBtC3vo7NdNUo_8HE3-JiJwxjDMhnUaE7TLxf_c 1361
fmbench/scripts/constants.py sha256=N-l1lzWjUBlbNt6tuvW_XQsLZ-woQRyayjYTv4cqudQ 1611
fmbench/scripts/custom_rest_predictor.py sha256=gguHsE1Z6tdRUV4Y3Wp2mNKE3ZB8b_6mfDYef9wDQEo 9351
fmbench/scripts/deploy_w_djl_serving.py sha256=72chtFZTDI-vB-1zUE8s8CQSuEgiDWoF_kBb48gLRzU 10396
fmbench/scripts/deploy_w_hf_tgi.py sha256=eQz08Q5P5xcKy6bV-tIdEM4ULYiDBx5grd7mOvtGzlE 3826
fmbench/scripts/ec2_deploy.py sha256=0wN11N7tUshMhlJcl6XKFlfn72g4tbJSLXSZ9KXKskQ 15257
fmbench/scripts/ec2_metrics.py sha256=cXBTzn0uBdkVweMQsXlsiHvHk1LR-mR8r6IUauu_t1E 6539
fmbench/scripts/ec2_predictor.py sha256=_Gws-ViLrhATnb7rEBJESOEFEIWDAlzWePdXto8mK7Y 17784
fmbench/scripts/eks_deploy.py sha256=sjc2gNxKmgHBwCDKUOghqDMRSEKtoF8gnWCKiW8HoAg 9676
fmbench/scripts/eks_predictor.py sha256=_ACXPtOax_ilz5d0a9BO6QADr9yPhyhDvthCi-Xx3bo 6785
fmbench/scripts/fmbench_predictor.py sha256=muKWX_eEzA_lJon1sXJJ8QdfZXvq7bT0XyIVIB1Fqo0 2098
fmbench/scripts/jumpstart.py sha256=jfzP0lbicgMVMTeByzm_aa676uVy3m2BZGMRevztui8 1710
fmbench/scripts/neuron_deploy.py sha256=BNfjobb3ngvGHEjmDd63MXaLVJS5Jr7PzoyfJGbyB9Q 7170
fmbench/scripts/neuron_metrics.py sha256=gZBYXSQndu6lwjX_iVZdJZ5sgaAmzi__y8QEyDz4Ab0 5906
fmbench/scripts/ollama_predictor.py sha256=hJWzmznpiKR7YKetMpo8rZe8ky-zHLB4IseROHyMnds 6828
fmbench/scripts/prepare_for_multi_model_containers.py sha256=gXlcUVUlHMRprRZTztzCSvjgF3cTpaGklwL08q3v8Eg 16198
fmbench/scripts/pricing.py sha256=55Yik2atDccqEjUcmcjGt2OwwsMobv34PoGf62yGK7E 6898
fmbench/scripts/rest_predictor.py sha256=B6kcwGHAG2Tnc-j7fwiXWBNjA8kJO7YhdsylTnqErOs 7742
fmbench/scripts/sagemaker_deploy.py sha256=G68MbzuACCCADvTl0D3uBkbIMRzEG5xdW9vU6RAnNZo 3468
fmbench/scripts/sagemaker_metrics.py sha256=g_7Y2OyzWdu6SdX8oCkjSIt-ioSkWYLmMtdT0p9zC0A 9747
fmbench/scripts/sagemaker_predictor.py sha256=nLKFqTbnfK9gaid8VDcxuSjeIqwi9Mls4Wi6KDI81TQ 13439
fmbench/scripts/stream_responses.py sha256=bMqKAd62qeS_ntJYIZlVoj1KQauJ7ybfTELSqKhChFo 6699
fmbench/scripts/compile-llm-for-aws-silicon/requirements.txt sha256=w-7gEYNbLO65jA9fk7l1uhObNd4V-ADF1Py6jcVbs-U 303
fmbench/scripts/compile-llm-for-aws-silicon/scripts/compile.py sha256=u6097mYl6QSu5RXFT6P9QlD_t1Hz6JmJeLIAorkb-NE 2819
fmbench/scripts/compile-llm-for-aws-silicon/scripts/download_compile_deploy.sh sha256=UZ6ytG0wHkNrf0A2zIVzSqK7HhKpAoAkPBH6r3Awfm4 3761
fmbench/scripts/compile-llm-for-aws-silicon/scripts/split_and_save.py sha256=4m5tC8cgi1SrRaS8hxgXaEEJpSPkJD7WoFGwvCFmBUQ 2122
fmbench/scripts/compile-llm-for-aws-silicon/smep-with-lmi/deploy.py sha256=Spcg5KFVeIe7gpOvxdKg_XhfkhcRTAWhpJzOs5k66H0 6599
fmbench/scripts/inference_containers/djl.py sha256=rYoQxymFJGWTqRNblh4qAXtcoJuvc5bMefF3Pm2YuWY 4771
fmbench/scripts/inference_containers/ollama.py sha256=IvNh5-C-x10Q_HXC3tcnM0H79h3lARbBwR5dBW-5Wao 2091
fmbench/scripts/inference_containers/sglang.py sha256=McCldGSsuNkWqa8YASSt2euEMsd_1s3DMz6nkL4_u2I 2606
fmbench/scripts/inference_containers/triton.py sha256=9vffLe-IWxTtv9qeGKelUFl0VKpFGNdO9qLcHAZjTLc 19479
fmbench/scripts/inference_containers/triton_serve_model.sh sha256=8kY6L2Jqio8Q1vlZrVPEqvNZDu664u0dPf4IRmrskFY 4574
fmbench/scripts/inference_containers/utils.py sha256=zo2rZ-v67WcRm4jtTfukEFwumBw7meFZ7kAEz7YMFsk 9180
fmbench/scripts/inference_containers/vllm.py sha256=1u_1DO870ik06OHLR161E7yq60O8Ae9HuYACF7Dg-Ls 943
fmbench/scripts/inference_containers/vllm_gpu.py sha256=1pUhF9QxGOpuVMrlJoX6msAoLF657DAm121TzDJtUwA 995
fmbench/scripts/triton/Dockerfile_triton sha256=h7yl4lBpod4VoIDX9zBmIlqvJD7fLI_wlay8SRNxqkQ 3521
fmbench/scripts/triton/build_and_push_triton.sh sha256=_h3mRzSPah0DaGTvoZQ_TwiHt2IwSwSYFDFWO9yO8WU 563
fmbench/scripts/triton/djl/config.pbtxt sha256=nAJejfs3rFLzlwzvx7TxTnhUkU30O6L6usUIahby1Hg 461
fmbench/scripts/triton/djl/model.py sha256=HSy2IL6xZ5Y1yQe5LBQsJ_LRcQYA_rGpsEA5eoMZq6Y 10138
fmbench/scripts/triton/djl/triton-djl-python-neuronx.sh sha256=yqYb4V0yHE1mbSxtOouoK5xg91mOhKllSvsGEUY8iUM 1817
fmbench/scripts/triton/vllm/config.pbtxt sha256=ycQv-E3XO39hsXCeJ62R-wpXPrShl8B7E8qCJIsBoQY 626
fmbench/scripts/triton/vllm/triton-vllm-neuronx.sh sha256=pfRY0p-ngBAnULySAb_yL-0_IT8mnp5YuWz-Sx89_2g 1825
fmbench/scripts/triton/vllm/vllm-neuron-issue-1.patch sha256=v9sSsiB2tQzU8LQ9WelBV3uR4BPOfnCrV7JrDf9peR8 1129
fmbench/tokenizer/.keep sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fmbench/tokenizer/config.json sha256=zyXN9HGfGB0dHTcZcyhdmv6a_eDQxqb9SN6FdVXOHg0 571
fmbench/tokenizer/tokenizer.json sha256=_E8L1ws3CTEtnR2eW6Z0eUtrxavBdCmJelQPk4gvJfw 1795303
fmbench-2.1.3.dist-info/LICENSE sha256=UCXHu-28jahottziq2iSJbPzPEOz8DNosKMxgJtq2iY 946
fmbench-2.1.3.dist-info/METADATA sha256=572NLfif-xMJ4JM7F1GTBGttp1fvrs5ZPYPA0lCvZp4 22474
fmbench-2.1.3.dist-info/WHEEL sha256=nn6H5-ilmfVryoAQl3ZQ2l8SH5imPWFpm1A5FgEuFV4 91
fmbench-2.1.3.dist-info/entry_points.txt sha256=5aLV0FXqFvzHpUMaIJUgCQgKtRnM8jKgsLLK0iEUk0k 46
fmbench-2.1.3.dist-info/top_level.txt sha256=rjrCKhwkrRvQIOIRwDg5tJQVSkioDY11fF-BY6XuE2Y 8
fmbench-2.1.3.dist-info/RECORD — —

top_level.txt

fmbench

entry_points.txt

[console_scripts]
fmbench = fmbench.main:main