Wheelodex » Projects » serverless-llm

serverless-llm

View on PyPI — Reverse Dependencies (0)

0.6.0 serverless_llm-0.6.0-py3-none-any.whl

Wheel Details

Project: serverless-llm
Version: 0.6.0
Filename: serverless_llm-0.6.0-py3-none-any.whl
Download: [link]
Size: 63877
MD5: c24fdc063b79f0ecbba25a5ead27a89d
SHA256: 19d0ce574865fdfa2b75ebb3eee101ffe99f3632038e459d2548d99dfaa78f67
Uploaded: 2024-12-17 21:18:03 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: serverless-llm
Version: 0.6.0
Requires-Dist: fastapi (==0.108.0)
Requires-Dist: GPUtil (==1.4.0)
Requires-Dist: grpcio (==1.49.1)
Requires-Dist: grpcio-tools (==1.49.1)
Requires-Dist: openai (==1.35.7)
Requires-Dist: pydantic (==2.6.1)
Requires-Dist: pydantic-core (==2.16.2)
Requires-Dist: ray (==2.9.0)
Requires-Dist: requests (==2.32.2)
Requires-Dist: serverless-llm-store
Requires-Dist: speedtest-cli (==2.1.3)
Requires-Dist: types-requests (==2.31.0.20240125)
Requires-Dist: uvicorn[standard] (==0.23.1)
Requires-Dist: accelerate (==0.29.3); extra == "test"
Requires-Dist: GPUtil (==1.4.0); extra == "test"
Requires-Dist: grpcio (==1.49.1); extra == "test"
Requires-Dist: grpcio-tools (==1.49.1); extra == "test"
Requires-Dist: outlines (==0.0.43); extra == "test"
Requires-Dist: speedtest-cli (==2.1.3); extra == "test"
Requires-Dist: torch (==2.3.0); extra == "test"
Requires-Dist: transformers (==4.42.0); extra == "test"
Requires-Dist: vllm (==0.5.0.post1); extra == "test"
Requires-Dist: pytest; extra == "test"
Requires-Dist: pytest-asyncio; extra == "test"
Requires-Dist: accelerate (==0.29.3); extra == "worker"
Requires-Dist: GPUtil (==1.4.0); extra == "worker"
Requires-Dist: grpcio (==1.49.1); extra == "worker"
Requires-Dist: grpcio-tools (==1.49.1); extra == "worker"
Requires-Dist: outlines (==0.0.43); extra == "worker"
Requires-Dist: speedtest-cli (==2.1.3); extra == "worker"
Requires-Dist: torch (==2.3.0); extra == "worker"
Requires-Dist: transformers (==4.42.0); extra == "worker"
Requires-Dist: vllm (==0.5.0.post1); extra == "worker"
Provides-Extra: test
Provides-Extra: worker
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 6548 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.45.1)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
serverless_llm-0.6.0.data/data/requirements.txt sha256=sWW3dkhPtmhhAzQyujm-s4_B8tpGas0Se1Qj41hamZY 248
sllm/cli/__init__.py sha256=kJtfI1hAM5ivH8P4LylqumZobg1Fo6GiNcOHUeFMkjk 1616
sllm/cli/_cli_utils.py sha256=Y0oQ86xPx5cDxfhGdHgPTUBQDZkOQArRBSmJP2MyNkM 3074
sllm/cli/default_config.json sha256=0VeE6bK_6MXRXMZQDij3pp9k8Wk3q1iUOp7FrDv3vu4 421
sllm/cli/delete.py sha256=DCUOlGSeEJhUEWJSShHHUlkimvmNj8QPiQSezcGB544 2690
sllm/cli/deploy.py sha256=pZ0cHt4pEwJ16u4hHZCh8baSppWRnrP4KKIUkJd1n_0 7413
sllm/cli/encode.py sha256=Z_93jqnJSwAjUvgMaI26F8-kHVJFVfgyH2PwxmDOKmc 4047
sllm/cli/generate.py sha256=S5tm2dEuv7ZoZr0fCkqybVqFclwkOH1csYfW6tD6_ug 3995
sllm/cli/replay.py sha256=zYJOCX690cOqZKrUrDRzb9O6sFsNVXydkBF6dgx8OWE 5818
sllm/cli/sllm_cli.py sha256=HvrXygVpzLLzX0WlYckSTHS_onhZoESO53oYp3Sak0w 2610
sllm/cli/update.py sha256=cu0BmAR_5wQtssVIXk9rV-U2Nrnt6orzAoILueoYO3g 3710
sllm/serve/__init__.py sha256=RDyIUH89cYHKT62P3qY093rEhXjom8z_4PkNvpMv-kA 1377
sllm/serve/app_lib.py sha256=CbAomi919dLSDRatR7cdV2wk2dyyyCwMhay-HIiBU6Q 4996
sllm/serve/controller.py sha256=B-7YheHyi0DTDWCrd4bCi4EM43cxldKrkfqV54h1EGI 7974
sllm/serve/hardware_info_collector.py sha256=LVE7P01nAz00nmF4olGewBHBWDY_6WT5_H4ZqltcPHE 5583
sllm/serve/inference_instance.py sha256=voVvta9cRHCIAtjfOjzQtMlKIt43HILRCEZrhYvmOjo 2330
sllm/serve/logger.py sha256=QN-K1l0BZ95K1GNX7iJKzTt73cotNP7ibGMwDxJwCBU 3163
sllm/serve/model_downloader.py sha256=SEykXPgs2kModj_oFCaA9i5xyX0XJqtwXcWnBeIut2w 6844
sllm/serve/store_manager.py sha256=V60XWOMcE96u_XPCb2qcIdBJ_ZQ_kekGgI8pTfPHZJ4 20333
sllm/serve/utils.py sha256=j1ZonwlyFOHBWzRJcUYauLIQ0fSjVuZwRzLu-FKQLJk 3665
sllm/serve/backends/__init__.py sha256=6pECcuM0dcPz5c-qrStgMeXVBJZiB7oF8Gzx6DT-CV0 1575
sllm/serve/backends/backend_utils.py sha256=CZQIa1axm2nOe6oS0Ru1Ptk9BhuUGeRKihm7_eQvCY0 2368
sllm/serve/backends/dummy_backend.py sha256=hz1KC_xBjiP0SJGOjLMpVALmD62gXnQVDF32HwNMEOI 4297
sllm/serve/backends/transformers_backend.py sha256=XP-MYAgWJc5qNR1udW-kth2o_w1Z8BBT0dNG4Z938WA 16708
sllm/serve/backends/vllm_backend.py sha256=CtXrtVkQOH8kOXqgD3BahRjW1u9ROHMHXGMCm9rnMFs 10973
sllm/serve/commands/serve/__init__.py sha256=RDyIUH89cYHKT62P3qY093rEhXjom8z_4PkNvpMv-kA 1377
sllm/serve/commands/serve/sllm_serve.py sha256=AQvWqQFMF-8fmszuU5Bmz-1p6qY4DvXW7jsbH8tuw-c 3231
sllm/serve/routers/__init__.py sha256=f5cPUUtfaiwHKaEjB0ncybBwPSy3FlrZFgka8LG-4JE 1573
sllm/serve/routers/migration_router.py sha256=36DgIEizD9DoLA1TfUUJW00I7KurjnQtT3vD8qCPNrA 11092
sllm/serve/routers/roundrobin_router.py sha256=KysBxBE--R-R9zNfA0h8p2wm7cDK4Uc4ng4FeTZe2eg 14960
sllm/serve/routers/router_utils.py sha256=AkQDmxJle3y8We275d6RQCwQJW2Wt3JaNjGDKuLtw9E 2187
sllm/serve/schedulers/__init__.py sha256=Wd1CXil9-O-Q4pk8eIAA0fmC_ixP4oYhOMJKyLU6fd8 1592
sllm/serve/schedulers/fcfs_scheduler.py sha256=v0tszS1XzK8R-eZnzRSm22cz4pvKUN6FVs2KER3Gs14 8268
sllm/serve/schedulers/scheduler_utils.py sha256=OOjD_2ZgDJK22evtelc03c8O_qKtQ1CkTQfKAY5dP3M 2095
sllm/serve/schedulers/storage_aware_scheduler.py sha256=s80JiuH9LCBye1mgUhn-EG3M5M-BSf5X8zMYY95AZ3U 22376
serverless_llm-0.6.0.dist-info/LICENSE sha256=Y5D7HD5uw4jrHNutO9MuCBJHSLzgWQKTe4ZE8yiZxg8 11352
serverless_llm-0.6.0.dist-info/METADATA sha256=j7IVrjAPyKjIznCFxnx8TF0txG64SLz3kezpcQXtFxg 8160
serverless_llm-0.6.0.dist-info/WHEEL sha256=tZoeGjtWxWRfdplE7E3d45VPlLNQnvbKiYnx7gwAy8A 92
serverless_llm-0.6.0.dist-info/entry_points.txt sha256=DIISLCrFqNthrjDi-VhWyeDjrNhyeek4qErREhPDF4g 107
serverless_llm-0.6.0.dist-info/top_level.txt sha256=Vbgti778oo5JSze0raYVPxcZEPA7YakZpnTqn7tWd4Y 5
serverless_llm-0.6.0.dist-info/RECORD — —

top_level.txt

sllm

entry_points.txt

[console_scripts]
sllm-cli = sllm.cli.sllm_cli:main
sllm-serve = sllm.serve.commands.serve.sllm_serve:main