llmeter

View on PyPIReverse Dependencies (0)

0.1.3 llmeter-0.1.3-py3-none-any.whl

Wheel Details

Project: llmeter
Version: 0.1.3
Filename: llmeter-0.1.3-py3-none-any.whl
Download: [link]
Size: 34275
MD5: c975dd32204d7bffdaf63292094efd95
SHA256: 153f93912eb31b7558c36bc245b3e5f4dd02f7e4e877955358aa027f04f38fe6
Uploaded: 2024-10-09 13:16:45 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: llmeter
Version: 0.1.3
Summary: A lightweight, cross-platform latency and throughput profiler for LLMs
Author: Amazon Web Services
Maintainer: llmeter-maintainers
Maintainer-Email: llmeter-maintainers[at]amazon.com
Home-Page: https://github.com/awslabs/llmeter
Project-Url: Repository, https://github.com/awslabs/llmeter
License: Apache-2.0
Keywords: llm,genai,testing,performance
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.10,<3.13
Requires-Dist: boto3 (>=1.34.129)
Requires-Dist: fsspec[http,s3] (>=2023.6.0)
Requires-Dist: jmespath (<2.0.0,>=0.7.1)
Requires-Dist: litellm (>=1.47.1); extra == "all" or extra == "litellm"
Requires-Dist: openai (>=1.35.1); extra == "all" or extra == "openai"
Requires-Dist: seaborn (>=0.13.2); extra == "all" or extra == "plotting"
Requires-Dist: tqdm (>=4.66.0)
Requires-Dist: universal-pathlib (>=0.2.1)
Provides-Extra: all
Provides-Extra: litellm
Provides-Extra: openai
Provides-Extra: plotting
Description-Content-Type: text/markdown
[Description omitted; length: 3327 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
llmeter/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmeter/endpoints/__init__.py sha256=cCJToI-GJtCZhPtl7xy-69ZRk45H_f4GiZ7BypGMJjk 487
llmeter/endpoints/base.py sha256=hsJcGgj2AUKh5Sdmn4q9IAL2zL6dBxTEwrHuiT7SoVQ 7797
llmeter/endpoints/bedrock.py sha256=lU963U5TRMKnLxdGV7b7QCgaUK2kohyKNJLmG-dOldA 6942
llmeter/endpoints/litellm.py sha256=ONpIT6EKGyAXmONpXt--q2YkS2NZP8jCCZKP6XHHWtA 5726
llmeter/endpoints/openai.py sha256=LpO1sGwRZ_ay69rTxlZaIRE96YMXFo3sEl8W2LBI84Y 2408
llmeter/endpoints/sagemaker.py sha256=_g2WYVkMfxLm_OURKa_B6PIJWDv8jlIybwSec9Au8XE 10814
llmeter/experiments.py sha256=D0DGxzZllLWV_9LSnW3bshi5wviGXk6MlHK556osalM 7106
llmeter/plotting.py sha256=e5N5o-f5kyzESSXwM0BH0PFrpw-CLirUTcY06_6WFWg 5489
llmeter/prompt_utils.py sha256=XIhj7f7uQ_Kk5A6D9Md0i61VNJtc0wMkty_sldZ0RJw 6505
llmeter/results.py sha256=taEJnerQwJJUQQzmJgtO6Z4RfYR3TwfF2wvyQdjS5A8 8177
llmeter/runner.py sha256=M92KDyR5ygwHCMC8CM8ymKEv7r0cKH6akDbWrtQNP3A 19413
llmeter/tokenizers.py sha256=KaHo6xua7vOF9omBKELIZF468O7FuZxc7Wr-iXeGme0 5082
llmeter/utils.py sha256=DMQV1tViYHEAezmf5djWnX0e6kR1xYJ9OfZ8INvOWIo 1079
llmeter-0.1.3.dist-info/LICENSE sha256=CeipvOyAZxBGUsFoaFqwkx54aPnIKEtm9a5u2uXxEws 10142
llmeter-0.1.3.dist-info/METADATA sha256=r_xjufZOPUFbenHPaN9QAZJRsLTEmmgdN6fzHHhSzco 4579
llmeter-0.1.3.dist-info/NOTICE sha256=Eg13ogOmcI7JpMjxniFnKG81vwU3X8X7P_IlpvVg5RU 66
llmeter-0.1.3.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
llmeter-0.1.3.dist-info/RECORD