Wheelodex » Projects » vec-inf

vec-inf

View on PyPI — Reverse Dependencies (0)

0.3.3 vec_inf-0.3.3-py3-none-any.whl

Wheel Details

Project: vec-inf
Version: 0.3.3
Filename: vec_inf-0.3.3-py3-none-any.whl
Download: [link]
Size: 15389
MD5: 03c509dbc6dc2082cc45ae09ec834119
SHA256: b26b965b312630549e1f0877dd508aa89369419095e2ffbc3520e491966f7215
Uploaded: 2024-09-03 21:51:26 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: vec-inf
Version: 0.3.3
Summary: Efficient LLM inference on Slurm clusters using vLLM.
Author: Marshall Wang
Author-Email: marshall.wang[at]vectorinstitute.ai
License: MIT
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.10,<4.0
Requires-Dist: click (<9.0.0,>=8.1.0)
Requires-Dist: cupy-cuda12x (==12.1.0); extra == "dev"
Requires-Dist: pandas (<3.0.0,>=2.2.2)
Requires-Dist: ray (<3.0.0,>=2.9.3); extra == "dev"
Requires-Dist: requests (<3.0.0,>=2.31.0)
Requires-Dist: rich (<14.0.0,>=13.7.0)
Requires-Dist: vllm (<0.6.0,>=0.5.0); extra == "dev"
Requires-Dist: vllm-nccl-cu12 (<2.19,>=2.18); extra == "dev"
Provides-Extra: dev
Description-Content-Type: text/markdown
[Description omitted; length: 4830 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
vec_inf/README.md sha256=ny3ffk6FeRwk_nERimK-JQwEuysvBe5eKpNyLk_A-8k 499
vec_inf/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
vec_inf/cli/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
vec_inf/cli/_cli.py sha256=XwCBkwFrN06T_o1CkUKD2nWT6P4bwOfDpVPoM3AUyUA 8984
vec_inf/cli/_utils.py sha256=n37X0AcgXNEi3wOEqQFA4_iHHeGclHew6NyQaML6q7s 4034
vec_inf/find_port.sh sha256=bGQ6LYSFVSsfDIGatrSg5YvddbZfaPL0R-Bjo4KYD6I 1088
vec_inf/launch_server.sh sha256=-efoTEIDKlJD7YhbYMgq4fFRV7H_1okjT5uKhfQAGUg 3998
vec_inf/models/README.md sha256=7Vz-AMValcic5Mpi9i5FshhRUV9K8nwSnItN4O1TSvI 8124
vec_inf/models/models.csv sha256=dOthlc04TyTQTin_fyt-PFDqg-lARScI9i0-tUkIgQ8 4828
vec_inf/multinode_vllm.slurm sha256=KbxsKD9kV8wsB_jCEqh63BHq8h2DLmYMV46z5h2wAe0 3867
vec_inf/vllm.slurm sha256=wRBkDunb0Oc1d8ESl_Dn9wRs_kIKvN_J39pL8dWAbV0 1608
vec_inf-0.3.3.dist-info/METADATA sha256=IefFGb9Gb7bOwI3RjNTbTlTCL6AImzx5XBSJjCp4y8c 5751
vec_inf-0.3.3.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
vec_inf-0.3.3.dist-info/entry_points.txt sha256=JF4uXsj1H4XacxaBw9f0KN0P0qDzmp7K_1zTEBDappo 48
vec_inf-0.3.3.dist-info/RECORD — —

entry_points.txt

[console_scripts]
vec-inf = vec_inf.cli._cli:cli