Wheelodex » Projects » tacc-inf

tacc-inf

View on PyPI — Reverse Dependencies (0)

0.2.2 tacc_inf-0.2.2-py3-none-any.whl

Wheel Details

Project: tacc-inf
Version: 0.2.2
Filename: tacc_inf-0.2.2-py3-none-any.whl
Download: [link]
Size: 19903
MD5: 7aca68e034ebbc52ef2a2f8cb45573ef
SHA256: 5a31a041d345d1b46f6f9bcf5a8ef676e810bf48840a389e3ddf4415c115aab6
Uploaded: 2024-10-17 23:55:53 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: tacc-inf
Version: 0.2.2
Summary: Efficient LLM inference on Slurm clusters using vLLM (for TACC).
Author: Atharva Sehgal
Author-Email: atharvas[at]utexas.edu
License: MIT
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Requires-Python: >=3.10,<4.0
Requires-Dist: click (<9.0.0,>=8.1.0)
Requires-Dist: cupy-cuda12x (==12.1.0); extra == "dev"
Requires-Dist: pandas (<3.0.0,>=2.2.2)
Requires-Dist: ray (<3.0.0,>=2.9.3); extra == "dev"
Requires-Dist: requests (<3.0.0,>=2.31.0)
Requires-Dist: rich (<14.0.0,>=13.7.0)
Requires-Dist: starlette (>=0.40.0)
Requires-Dist: vllm (<0.6.0,>=0.5.0); extra == "dev"
Requires-Dist: vllm-nccl-cu12 (<2.19,>=2.18); extra == "dev"
Provides-Extra: dev
Description-Content-Type: text/markdown
[Description omitted; length: 15408 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
tacc_inf/README.md sha256=ITtiJTBv0XREAYdiW0AyQHzuPpPD9kHe5bBdTje6_Eg 500
tacc_inf/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tacc_inf/cli/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tacc_inf/cli/_cli.py sha256=LYG0JInp0JOVSGjHryUfBJ5t9OUWi5UkHXdpakBZ0fo 9115
tacc_inf/cli/_utils.py sha256=tJkbl2ZF1op1U4Ibq5iWUQIEqpBg0EfHeiuAWJuCiAE 4181
tacc_inf/find_port.sh sha256=bGQ6LYSFVSsfDIGatrSg5YvddbZfaPL0R-Bjo4KYD6I 1088
tacc_inf/launch_server.sh sha256=7ZVrKoLkbj0AUUZe53sYIJ6Ed5hbpFtI_94dfOQ6V-U 4597
tacc_inf/models/README.md sha256=7Vz-AMValcic5Mpi9i5FshhRUV9K8nwSnItN4O1TSvI 8124
tacc_inf/models/models.csv sha256=A8vZRfI8pHbnK6xmAV3BuBQmSGJ1V5w8IwSKvyGPADM 4873
tacc_inf/multinode_vllm.slurm sha256=3yilDo98TPV0QI9nDJj94x1i6LP6GFfm6e4_dyZjvQ4 3860
tacc_inf/vllm.slurm sha256=0-Y1eAh1uGXkJxcCgeSi-TJ_pbsXanMkIlGJYBQRZRQ 1624
tacc_inf-0.2.2.dist-info/LICENSE sha256=P-VVIOnPanlUG0Akc1amtcMEiJ1I9X_CKEAxQHaS7ag 1107
tacc_inf-0.2.2.dist-info/METADATA sha256=i965xqh368WWJKrU2Fa0YNUgQnf8sdlYBTOmifiST9k 17434
tacc_inf-0.2.2.dist-info/WHEEL sha256=Nq82e9rUAnEjt98J6MlVmMCZb-t9cYE2Ir1kpBmnWfs 88
tacc_inf-0.2.2.dist-info/entry_points.txt sha256=UY3I148akxL6takxNmfF8jCez3nmbkjKNGFHAZYiIls 50
tacc_inf-0.2.2.dist-info/RECORD — —

entry_points.txt

[console_scripts]
tacc-inf = tacc_inf.cli._cli:cli