vllm-tgis-adapter

View on PyPIReverse Dependencies (1)

0.6.3 vllm_tgis_adapter-0.6.3-py3-none-any.whl

Wheel Details

Project: vllm-tgis-adapter
Version: 0.6.3
Filename: vllm_tgis_adapter-0.6.3-py3-none-any.whl
Download: [link]
Size: 54699
MD5: 81a0acfa44f9c5a870f74bb1ec3bc665
SHA256: d3215afa2b263b4456ea942b634630dce8bf87a30764061ba13253b66dcac95c
Uploaded: 2025-03-04 09:26:08 +0000

dist-info

METADATA

Metadata-Version: 2.2
Name: vllm-tgis-adapter
Version: 0.6.3
Summary: vLLM adapter for a TGIS-compatible grpc server
Author-Email: Daniele Trifirò <dtrifiro[at]redhat.com>
Project-Url: Issues, https://github.com/opendatahub-io/vllm-tgis-adapter/issues
Project-Url: Source, https://github.com/opendatahub-io/vllm-tgis-adapter
License: Apache 2
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Development Status :: 4 - Beta
Requires-Python: >=3.9
Requires-Dist: vllm (>=0.7.2)
Requires-Dist: prometheus_client (==0.21.1)
Requires-Dist: grpcio (==1.70.0)
Requires-Dist: grpcio-health-checking (==1.70.0)
Requires-Dist: grpcio-reflection (==1.70.0)
Requires-Dist: accelerate (==1.3.0)
Requires-Dist: hf-transfer (==0.1.9)
Requires-Dist: cachetools (~=5.5)
Requires-Dist: opentelemetry-sdk (>=1.30.0)
Requires-Dist: opentelemetry-api (>=1.30.0)
Requires-Dist: opentelemetry-exporter-otlp (>=1.28.0)
Requires-Dist: opentelemetry-semantic-conventions-ai (>=0.4.1)
Requires-Dist: pytest (==8.3.3); extra == "tests"
Requires-Dist: pytest-cov (==6.0.0); extra == "tests"
Requires-Dist: pytest-mock (==3.14.0); extra == "tests"
Requires-Dist: pytest-asyncio (==0.24.0); extra == "tests"
Requires-Dist: requests (==2.32.3); extra == "tests"
Requires-Dist: vllm_tgis_adapter[tests]; extra == "dev"
Requires-Dist: ruff (==0.9.6); extra == "dev"
Requires-Dist: mypy (==1.12.1); extra == "dev"
Requires-Dist: types-protobuf (==5.28.0.20240924); extra == "dev"
Requires-Dist: types-requests (==2.32.0.20241016); extra == "dev"
Requires-Dist: flash-attn (==2.6.3); extra == "flash-attn"
Requires-Dist: packaging; extra == "flash-attn"
Requires-Dist: ninja; extra == "flash-attn"
Provides-Extra: tests
Provides-Extra: dev
Provides-Extra: flash-attn
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 2855 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.8.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
vllm_tgis_adapter/__init__.py sha256=UBSTGUG_yYV_Rt0iqK-AwbXK2GERcyIG3wSgVbjp2nU 111
vllm_tgis_adapter/__main__.py sha256=bZDqQ3Qv9YeB2qEyckrxTBg2IEBKT4mKlzoM_92uc9I 4327
vllm_tgis_adapter/_version.py sha256=EfgKlh1pd_Vgab8-_f96RT0v8zb0fVSsv5INa42Xrbs 511
vllm_tgis_adapter/healthcheck.py sha256=_hyrvClxkSBaJY1d_xSkZ66SEJxFMXIpw5SQZuJyn24 2510
vllm_tgis_adapter/http.py sha256=4ruS9SDrGZxRWn7ddm6fbARlKd5B5jNI1O4x3eRZGYI 2812
vllm_tgis_adapter/logging.py sha256=v5AgZY0sQHN9CbfZDzXmwg9T-GWb0ijJQMG9scuQxVI 643
vllm_tgis_adapter/utils.py sha256=TyJjGlpdgSHl2km7X8hRdsQcuS1iIHLpr99Rujh8tl4 1397
vllm_tgis_adapter/grpc/__init__.py sha256=UeIjtLwvxOv1SWhIfdjOMti1sJjJ8Yq6vCGW8ob6bQk 41
vllm_tgis_adapter/grpc/adapters.py sha256=K-WaoZjsDAWgrnDnS22TCjIbpYUG-6cIOn_uktfyXzY 8524
vllm_tgis_adapter/grpc/grpc_server.py sha256=h_2-ijrts1mmSL8eE2i6G5eeC0drKgx8BFjInmgLp2k 36490
vllm_tgis_adapter/grpc/validation.py sha256=wcspREszah9HPw-NqmVsjZkEhhXdXeJmHtG_Wo7hcTQ 5169
vllm_tgis_adapter/grpc/pb/.gitignore sha256=RO1TuRKOzsHjY0_cyRuyiBtiuaqpMcfDTwXSdf1oni8 63
vllm_tgis_adapter/grpc/pb/__init__.py sha256=2oYxdCXiXV52NWsHREHrg0DIlYUNgUhHnln7lKUGcus 92
vllm_tgis_adapter/grpc/pb/generation.proto sha256=7gUQc65nuyvt6doNwCHiPeEelNj7cxASk5zsvo0FLbI 7587
vllm_tgis_adapter/grpc/pb/generation_pb2.py sha256=OE5K6GExAfMzTxcySQ95j5nebNr9xOGedM9aAAWCFTQ 9705
vllm_tgis_adapter/grpc/pb/generation_pb2.pyi sha256=4lMcZAmLdE4aL1118Doq0NQmTPHMhjMPC4XSpy-i3cI 30999
vllm_tgis_adapter/grpc/pb/generation_pb2_grpc.py sha256=cuS2C9TejZ9ACCznvXHSN8Jc80vm6Y0CFL9UvxY_4u0 8211
vllm_tgis_adapter/tgis_utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
vllm_tgis_adapter/tgis_utils/args.py sha256=e_mj3pq_iMouKKH4jTSG-4O5kCexapePe70tZ1R24_o 9108
vllm_tgis_adapter/tgis_utils/convert_pt_to_prompt.py sha256=AyJa5UWDMmKtxblrfzrn4siQ2bkEKFGSxlVwEMskgXo 2510
vllm_tgis_adapter/tgis_utils/guided_decoding.py sha256=SiY9XDBxiFw2xm90ZEupJJJxPGWIn3bOxqtSIyE8LMI 2732
vllm_tgis_adapter/tgis_utils/hub.py sha256=9DjWauRmyvRACej6wOHKR80ORHo_dJ3X6u4ApXYEGRw 7211
vllm_tgis_adapter/tgis_utils/logits_processors.py sha256=p26lnk5a9-Ac_5fY5Vx3p4gcgw14dElDkdttYp863pg 1440
vllm_tgis_adapter/tgis_utils/logs.py sha256=Ju-J6aoNd7KrBySWF2ogiSbfLyJs4UbUmZwqsaiLyjc 7368
vllm_tgis_adapter/tgis_utils/metrics.py sha256=4d50kJd4EuX89o6umGY114V-7kJVRnlaNI1JWsVBzdM 5874
vllm_tgis_adapter/tgis_utils/scripts.py sha256=JjDDBks83Cv6SR7jCodEOixox-u0mcrQJIgMSQL419A 7665
vllm_tgis_adapter-0.6.3.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
vllm_tgis_adapter-0.6.3.dist-info/METADATA sha256=TegSAupDL3eNIalY3wBEaK-hSosUdR0vN6rGwLSFMBg 4795
vllm_tgis_adapter-0.6.3.dist-info/WHEEL sha256=jB7zZ3N9hIM9adW7qlTAyycLYW9npaWKLRzaoVcLKcM 91
vllm_tgis_adapter-0.6.3.dist-info/entry_points.txt sha256=yFXyLmufbmzweK4a8NntK3vOhtTUTiNa1uwJmajFL3Q 268
vllm_tgis_adapter-0.6.3.dist-info/top_level.txt sha256=YSXj8cGfNa136A7_E38SZ6-YjI7hbctYjYnshNq5ntU 18
vllm_tgis_adapter-0.6.3.dist-info/RECORD

top_level.txt

vllm_tgis_adapter

entry_points.txt

convert_pt_to_prompt = vllm_tgis_adapter.tgis_utils.convert_pt_to_prompt:cli
grpc_healthcheck = vllm_tgis_adapter.healthcheck:cli
model-util = vllm_tgis_adapter.tgis_utils.scripts:cli
text-generation-server = vllm_tgis_adapter.tgis_utils.scripts:cli