llmeter

View on PyPIReverse Dependencies (0)

0.1.4 llmeter-0.1.4-py3-none-any.whl

Wheel Details

Project: llmeter
Version: 0.1.4
Filename: llmeter-0.1.4-py3-none-any.whl
Download: [link]
Size: 58084
MD5: fd1f10f495f8245aaf1c1d8b73f1ec5e
SHA256: 4968e630dae775fcb4140587ef4980029136a86c2f0bc25655f8f4eb9bbfd471
Uploaded: 2024-12-19 04:42:23 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: llmeter
Version: 0.1.4
Summary: A lightweight, cross-platform latency and throughput profiler for LLMs
Author: Amazon Web Services
Maintainer: llmeter-maintainers
Maintainer-Email: llmeter-maintainers[at]amazon.com
Home-Page: https://github.com/awslabs/llmeter
Project-Url: Repository, https://github.com/awslabs/llmeter
License: Apache-2.0
Keywords: llm,genai,testing,performance
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.10,<3.13
Requires-Dist: boto3 (>=1.34.129)
Requires-Dist: fsspec[http,s3] (>=2023.6.0)
Requires-Dist: jmespath (<2.0.0,>=0.7.1)
Requires-Dist: litellm (>=1.47.1); extra == "all" or extra == "litellm"
Requires-Dist: mlflow-skinny (>=2.13.0); extra == "all" or extra == "mlflow"
Requires-Dist: openai (>=1.35.1); extra == "all" or extra == "openai"
Requires-Dist: seaborn (>=0.13.2); extra == "all" or extra == "plotting"
Requires-Dist: tqdm (>=4.66.0)
Requires-Dist: universal-pathlib (>=0.2.1)
Provides-Extra: all
Provides-Extra: litellm
Provides-Extra: mlflow
Provides-Extra: openai
Provides-Extra: plotting
Description-Content-Type: text/markdown
[Description omitted; length: 3621 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
llmeter/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmeter/callbacks/__init__.py sha256=-N3QJJC8TggtATVrTUaAHDjgzkbb8MBjaOIQoyGVICs 756
llmeter/callbacks/base.py sha256=TYVaqXUN8xEITlaxWc98NrMnUReZsBP7nHr18PHA1xI 4146
llmeter/callbacks/cost/__init__.py sha256=tIP7o-5DXFNtyb4l5cOs02p35uO69fMafi_45FIPBa4 1191
llmeter/callbacks/cost/dimensions.py sha256=yVKJG1ft2fknO82rDJBalH_IU0iEk-uOrq6PfymsxIU 7669
llmeter/callbacks/cost/model.py sha256=aJ3jZPsgHISm6i1wFdIs8Q7KMRvZXUc6d_q2Ciamoic 9502
llmeter/callbacks/cost/providers/__init__.py sha256=0F4GnYKjO1Dxv0-n_W7w4PqrohqR0Kv08d7VfnwuCGY 698
llmeter/callbacks/cost/providers/sagemaker.py sha256=NrXPncfEXd92Z163mIRcM_PTw068_1QNEi7UnzLjbo8 17709
llmeter/callbacks/cost/results.py sha256=5dE2Wv_WGchabpYQKhZbX62kMU19MMgSIWS7xCR1McM 8268
llmeter/callbacks/cost/serde.py sha256=L3ImkgmSWEwPik7RRN2jwhUFrljDb3wU3zvOoaOXFSo 7978
llmeter/callbacks/mlflow.py sha256=HYQ149YT-ZC7eRJa-j4aqkZN--cVMvIK0X8DBV94dCo 4193
llmeter/endpoints/__init__.py sha256=cCJToI-GJtCZhPtl7xy-69ZRk45H_f4GiZ7BypGMJjk 487
llmeter/endpoints/base.py sha256=IPj3uJWw6R85oQ1GVX0d9vV_2dQ0G9fTW-_GsppvBT4 8025
llmeter/endpoints/bedrock.py sha256=lU963U5TRMKnLxdGV7b7QCgaUK2kohyKNJLmG-dOldA 6942
llmeter/endpoints/litellm.py sha256=ONpIT6EKGyAXmONpXt--q2YkS2NZP8jCCZKP6XHHWtA 5726
llmeter/endpoints/openai.py sha256=LpO1sGwRZ_ay69rTxlZaIRE96YMXFo3sEl8W2LBI84Y 2408
llmeter/endpoints/sagemaker.py sha256=mRfamCCAT6tdvzJVY-d-6bBbvaDQBrC2kTPMQCnSQ3Y 10845
llmeter/experiments.py sha256=8YGgFi8E_oloMZtaE53MnNkGBKV-OL7_rfMZVrOO8Ms 7253
llmeter/plotting.py sha256=e5N5o-f5kyzESSXwM0BH0PFrpw-CLirUTcY06_6WFWg 5489
llmeter/prompt_utils.py sha256=XIhj7f7uQ_Kk5A6D9Md0i61VNJtc0wMkty_sldZ0RJw 6505
llmeter/results.py sha256=5lwCNkrvJiee4ZavvbCkiO20mxgBi7B_foxUY916DI4 9156
llmeter/runner.py sha256=stVjf7AuxAVzQ38J0XuMHbgwyWE46lxjQxvC7UN9YFA 26662
llmeter/tokenizers.py sha256=KaHo6xua7vOF9omBKELIZF468O7FuZxc7Wr-iXeGme0 5082
llmeter/utils.py sha256=GDUS0Zb-PToZ2DJEC9-kucZLdvt2p8LIfqAnsqx8EnA 2859
llmeter-0.1.4.dist-info/LICENSE sha256=CeipvOyAZxBGUsFoaFqwkx54aPnIKEtm9a5u2uXxEws 10142
llmeter-0.1.4.dist-info/METADATA sha256=FvlL7n7QnKCAswS-6mS_ez7RQvvhFHr3EhdnhqQF0yk 4974
llmeter-0.1.4.dist-info/NOTICE sha256=Eg13ogOmcI7JpMjxniFnKG81vwU3X8X7P_IlpvVg5RU 66
llmeter-0.1.4.dist-info/WHEEL sha256=Nq82e9rUAnEjt98J6MlVmMCZb-t9cYE2Ir1kpBmnWfs 88
llmeter-0.1.4.dist-info/RECORD