Wheelodex » Projects » serverless-llm

serverless-llm

View on PyPI — Reverse Dependencies (0)

0.6.3 serverless_llm-0.6.3-py3-none-any.whl

Wheel Details

Project: serverless-llm
Version: 0.6.3
Filename: serverless_llm-0.6.3-py3-none-any.whl
Download: [link]
Size: 69450
MD5: c39a1f8dfeee3930ecf2cc9e0fa8d30b
SHA256: 131321b657e10db01a5d20e59b0e2cac035d755e4270eabb3cae3107e9f5ad95
Uploaded: 2025-03-30 09:18:05 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: serverless-llm
Version: 0.6.3
Requires-Dist: fastapi (==0.108.0)
Requires-Dist: GPUtil (==1.4.0)
Requires-Dist: grpcio (==1.49.1)
Requires-Dist: grpcio-tools (==1.49.1)
Requires-Dist: openai (==1.52.0)
Requires-Dist: pydantic (==2.9.0)
Requires-Dist: pydantic-core (==2.23.2)
Requires-Dist: ray (==2.9.0)
Requires-Dist: requests (==2.32.2)
Requires-Dist: serverless-llm-store
Requires-Dist: speedtest-cli (==2.1.3)
Requires-Dist: types-requests (==2.31.0.20240125)
Requires-Dist: uvicorn[standard] (==0.23.1)
Requires-Dist: accelerate (==1.2.1); extra == "test"
Requires-Dist: datasets (==2.16.1); extra == "test"
Requires-Dist: GPUtil (==1.4.0); extra == "test"
Requires-Dist: grpcio (==1.49.1); extra == "test"
Requires-Dist: grpcio-tools (==1.49.1); extra == "test"
Requires-Dist: outlines (==0.1.11); extra == "test"
Requires-Dist: peft (==0.8.2); extra == "test"
Requires-Dist: ray (==2.9.0); extra == "test"
Requires-Dist: speedtest-cli (==2.1.3); extra == "test"
Requires-Dist: torch (==2.5.1); extra == "test"
Requires-Dist: transformers (==4.47.1); extra == "test"
Requires-Dist: vllm (==0.6.6); extra == "test"
Requires-Dist: pytest; extra == "test"
Requires-Dist: pytest-asyncio; extra == "test"
Requires-Dist: accelerate (==1.2.1); extra == "worker"
Requires-Dist: datasets (==2.16.1); extra == "worker"
Requires-Dist: GPUtil (==1.4.0); extra == "worker"
Requires-Dist: grpcio (==1.49.1); extra == "worker"
Requires-Dist: grpcio-tools (==1.49.1); extra == "worker"
Requires-Dist: outlines (==0.1.11); extra == "worker"
Requires-Dist: peft (==0.8.2); extra == "worker"
Requires-Dist: ray (==2.9.0); extra == "worker"
Requires-Dist: speedtest-cli (==2.1.3); extra == "worker"
Requires-Dist: torch (==2.5.1); extra == "worker"
Requires-Dist: transformers (==4.47.1); extra == "worker"
Requires-Dist: vllm (==0.6.6); extra == "worker"
Provides-Extra: test
Provides-Extra: worker
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 7056 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.45.1)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
sllm/cli/__init__.py sha256=kJtfI1hAM5ivH8P4LylqumZobg1Fo6GiNcOHUeFMkjk 1616
sllm/cli/_cli_utils.py sha256=Y0oQ86xPx5cDxfhGdHgPTUBQDZkOQArRBSmJP2MyNkM 3074
sllm/cli/default_config.json sha256=0VeE6bK_6MXRXMZQDij3pp9k8Wk3q1iUOp7FrDv3vu4 421
sllm/cli/delete.py sha256=DCUOlGSeEJhUEWJSShHHUlkimvmNj8QPiQSezcGB544 2690
sllm/cli/deploy.py sha256=oMlWABLSZkex7Z3cH9cvTEiPGK8-d5AVWu2KT_6oMPg 7413
sllm/cli/encode.py sha256=Z_93jqnJSwAjUvgMaI26F8-kHVJFVfgyH2PwxmDOKmc 4047
sllm/cli/fine_tuning.py sha256=xzGvrQ1g0h_IDFhHmlrJq8oBFS2paTyoZuoh2oJW7xc 4110
sllm/cli/generate.py sha256=S5tm2dEuv7ZoZr0fCkqybVqFclwkOH1csYfW6tD6_ug 3995
sllm/cli/replay.py sha256=zYJOCX690cOqZKrUrDRzb9O6sFsNVXydkBF6dgx8OWE 5818
sllm/cli/sllm_cli.py sha256=KXaobdY-hJIViHN2zcahnGXns11Nc092E-V-x7TY7k0 2817
sllm/cli/status.py sha256=RiqPlNLo06iC-cvXOieB5RSYhKhEimr_-7i3PEzWMfE 3193
sllm/cli/update.py sha256=cu0BmAR_5wQtssVIXk9rV-U2Nrnt6orzAoILueoYO3g 3710
sllm/serve/__init__.py sha256=RDyIUH89cYHKT62P3qY093rEhXjom8z_4PkNvpMv-kA 1377
sllm/serve/app_lib.py sha256=SFnd5ELcC-cnkTNl02bFWpy37Dp_ysCRFueKLFEEhFY 6498
sllm/serve/controller.py sha256=1rihQpy2OGeyFQvhMlCz4w2NPgaTg1nNuCF2civtouc 11981
sllm/serve/hardware_info_collector.py sha256=LVE7P01nAz00nmF4olGewBHBWDY_6WT5_H4ZqltcPHE 5583
sllm/serve/inference_instance.py sha256=voVvta9cRHCIAtjfOjzQtMlKIt43HILRCEZrhYvmOjo 2330
sllm/serve/logger.py sha256=QN-K1l0BZ95K1GNX7iJKzTt73cotNP7ibGMwDxJwCBU 3163
sllm/serve/model_downloader.py sha256=SEykXPgs2kModj_oFCaA9i5xyX0XJqtwXcWnBeIut2w 6844
sllm/serve/store_manager.py sha256=in6rvcIDngt0vqa2e3X-3hzon7ntEvhiIYzO0tGL89g 20825
sllm/serve/utils.py sha256=4-vYA-4G9mZaqlHlhpEeEEml8sEYthLXUKJd7_fQCPw 3802
sllm/serve/backends/__init__.py sha256=6pECcuM0dcPz5c-qrStgMeXVBJZiB7oF8Gzx6DT-CV0 1575
sllm/serve/backends/backend_utils.py sha256=-2kYRm7VP8rlhwv2HhrsRj5SP5X5_1rbmAq8YtpD6MI 2465
sllm/serve/backends/dummy_backend.py sha256=EfOyRmkLwMroXiMPnsxH3c0PaW4vSIEcMd0s0DrJuX8 4431
sllm/serve/backends/transformers_backend.py sha256=WZylns9wqnKGvzce_I25A9WO6r087txzXLa50n0v6ZU 21596
sllm/serve/backends/vllm_backend.py sha256=wmZ2U_JBWw-4-FutNjWJLFD8N-5YfEny1wwADUL0Um4 13547
sllm/serve/commands/serve/__init__.py sha256=RDyIUH89cYHKT62P3qY093rEhXjom8z_4PkNvpMv-kA 1377
sllm/serve/commands/serve/sllm_serve.py sha256=clSU4RdtmNO6jLkYelK0scMiimxtUha7h1Tux13vlr0 3231
sllm/serve/routers/__init__.py sha256=f5cPUUtfaiwHKaEjB0ncybBwPSy3FlrZFgka8LG-4JE 1573
sllm/serve/routers/migration_router.py sha256=Nejrv6_PNgwxjGa1iVkS7jeolTBkG7Ut_2XlGSoXd-Q 11257
sllm/serve/routers/roundrobin_router.py sha256=7H1j-SFKGV8Qjmqqym9tbgjhchGZmEC6f7IcvA-kAwM 17535
sllm/serve/routers/router_utils.py sha256=OK9gyf6gttI0Q-SQMkbWaCK96M4Rqn57WsiPlkD260I 2274
sllm/serve/schedulers/__init__.py sha256=Wd1CXil9-O-Q4pk8eIAA0fmC_ixP4oYhOMJKyLU6fd8 1592
sllm/serve/schedulers/fcfs_scheduler.py sha256=R3ok7DwwPCySRv6e5wgy9kJyiE3R9j75rjU2dMczMmI 9056
sllm/serve/schedulers/scheduler_utils.py sha256=OOjD_2ZgDJK22evtelc03c8O_qKtQ1CkTQfKAY5dP3M 2095
sllm/serve/schedulers/storage_aware_scheduler.py sha256=s80JiuH9LCBye1mgUhn-EG3M5M-BSf5X8zMYY95AZ3U 22376
serverless_llm-0.6.3.dist-info/LICENSE sha256=Y5D7HD5uw4jrHNutO9MuCBJHSLzgWQKTe4ZE8yiZxg8 11352
serverless_llm-0.6.3.dist-info/METADATA sha256=kruz4mRdO2z-rTDGCZO_Egqkc8jlk5uiY-I167NLrH4 8934
serverless_llm-0.6.3.dist-info/WHEEL sha256=tZoeGjtWxWRfdplE7E3d45VPlLNQnvbKiYnx7gwAy8A 92
serverless_llm-0.6.3.dist-info/entry_points.txt sha256=DIISLCrFqNthrjDi-VhWyeDjrNhyeek4qErREhPDF4g 107
serverless_llm-0.6.3.dist-info/top_level.txt sha256=Vbgti778oo5JSze0raYVPxcZEPA7YakZpnTqn7tWd4Y 5
serverless_llm-0.6.3.dist-info/RECORD — —

top_level.txt

sllm

entry_points.txt

[console_scripts]
sllm-cli = sllm.cli.sllm_cli:main
sllm-serve = sllm.serve.commands.serve.sllm_serve:main