Wheelodex » Projects » xinference

xinference

View on PyPI — Reverse Dependencies (2)

1.0.0 xinference-1.0.0-py3-none-any.whl
0.4.0 xinference-0.4.0-py3-none-any.whl

Wheel Details

Project: xinference
Version: 0.4.0
Filename: xinference-0.4.0-py3-none-any.whl
Download: [link]
Size: 1273048
MD5: 163a5d9b09872ba6867939c94a1c34f7
SHA256: 6b7ef79c9f7ca9c8ffd034572342573ff111e3d2acb86a7d6e4cd1712032e27f
Uploaded: 2023-09-06 14:21:35 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: xinference
Version: 0.4.0
Summary: Model Serving Made Easy
Author: Qin Xuye
Author-Email: qinxuye[at]xprobe.io
Maintainer: Qin Xuye
Maintainer-Email: qinxuye[at]xprobe.io
Home-Page: https://github.com/xorbitsai/inference
License: Apache License 2.0
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Topic :: Software Development :: Libraries
Requires-Dist: xoscar
Requires-Dist: xorbits
Requires-Dist: gradio (>=3.39.0)
Requires-Dist: click
Requires-Dist: tqdm (>=4.27)
Requires-Dist: tabulate
Requires-Dist: requests
Requires-Dist: pydantic (<2)
Requires-Dist: fastapi
Requires-Dist: uvicorn
Requires-Dist: sse-starlette
Requires-Dist: huggingface-hub (<1.0,>=0.14.1)
Requires-Dist: typing-extensions
Requires-Dist: fsspec
Requires-Dist: ctransformers; extra == "all"
Requires-Dist: llama-cpp-python (==0.1.77); extra == "all"
Requires-Dist: transformers (>=4.31.0); extra == "all"
Requires-Dist: torch; extra == "all"
Requires-Dist: accelerate (>=0.20.3); extra == "all"
Requires-Dist: sentencepiece; extra == "all"
Requires-Dist: transformers-stream-generator; extra == "all"
Requires-Dist: bitsandbytes; extra == "all"
Requires-Dist: protobuf; extra == "all"
Requires-Dist: einops; extra == "all"
Requires-Dist: tiktoken; extra == "all"
Requires-Dist: sentence-transformers; extra == "all"
Requires-Dist: psutil; extra == "benchmark"
Requires-Dist: pynvml; extra == "benchmark"
Requires-Dist: cython (>=0.29); extra == "dev"
Requires-Dist: pytest (>=3.5.0); extra == "dev"
Requires-Dist: pytest-cov (>=2.5.0); extra == "dev"
Requires-Dist: pytest-timeout (>=1.2.0); extra == "dev"
Requires-Dist: pytest-forked (>=1.0); extra == "dev"
Requires-Dist: pytest-asyncio (>=0.14.0); extra == "dev"
Requires-Dist: pytest-mock (>=3.11.1); extra == "dev"
Requires-Dist: ipython (>=6.5.0); extra == "dev"
Requires-Dist: sphinx (<5.0.0,>=3.0.0); extra == "dev"
Requires-Dist: pydata-sphinx-theme (>=0.3.0); extra == "dev"
Requires-Dist: sphinx-intl (>=0.9.9); extra == "dev"
Requires-Dist: jieba (>=0.42.0); extra == "dev"
Requires-Dist: flake8 (>=3.8.0); extra == "dev"
Requires-Dist: black; extra == "dev"
Requires-Dist: ipython (>=6.5.0); extra == "doc"
Requires-Dist: sphinx (<5.0.0,>=3.0.0); extra == "doc"
Requires-Dist: pydata-sphinx-theme (>=0.3.0); extra == "doc"
Requires-Dist: sphinx-intl (>=0.9.9); extra == "doc"
Requires-Dist: sentence-transformers; extra == "embedding"
Requires-Dist: llama-cpp-python (==0.1.77); extra == "ggml"
Requires-Dist: ctransformers; extra == "ggml"
Requires-Dist: transformers (>=4.31.0); extra == "pytorch"
Requires-Dist: torch; extra == "pytorch"
Requires-Dist: accelerate (>=0.20.3); extra == "pytorch"
Requires-Dist: sentencepiece; extra == "pytorch"
Requires-Dist: transformers-stream-generator; extra == "pytorch"
Requires-Dist: bitsandbytes; extra == "pytorch"
Requires-Dist: protobuf; extra == "pytorch"
Requires-Dist: einops; extra == "pytorch"
Requires-Dist: tiktoken; extra == "pytorch"
Provides-Extra: all
Provides-Extra: benchmark
Provides-Extra: dev
Provides-Extra: doc
Provides-Extra: embedding
Provides-Extra: ggml
Provides-Extra: pytorch
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 10746 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.41.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
xinference/__init__.py sha256=jv7PR7ali6n5TpvGjB3hKugwB9Tq-eSTyc_xl2gFnZ0 910
xinference/_version.py sha256=zxWR3nIIK0q4FZpYfQ_dbGI1_3Q65169nBviQStov4A 497
xinference/client.py sha256=gtUhwvcpFJobpuxtz-mnruVNSgk_NidqcAy-r9qANFM 33513
xinference/conftest.py sha256=qFQx4Urx0q4S6cmze57s3FJenX5vJwUe7Jsg38f1FY4 1381
xinference/constants.py sha256=oVel8sSvnkZURIJvBaRIfCEESoLWL4MFGvDzK_s5oVA 1033
xinference/isolation.py sha256=NstVRcO3dG4umHExICXAHlzVKwH8ch8MBwKwE-KFkE0 1826
xinference/types.py sha256=YVBthdEkcsAFoh7njQuCQGlBmzJcjrHuPQ38OQoXne4 2564
xinference/core/__init__.py sha256=Fe5tYCHDbYJ7PhxJhQ68VbfgKgOsAuslNPr4wPhFMJM 612
xinference/core/api.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
xinference/core/chat_interface.py sha256=hSwfiJIXfe1VtC7bZOkPoBRUGFR3NiyeccfW2YeVzFQ 9453
xinference/core/model.py sha256=SlRJZdDOr3wrFB1-21stzby3MC4I5IS_LK72MXlV-7Q 4415
xinference/core/resource.py sha256=784fXHDc3Qj96b04xS7gPs_b-209yHQdMliiip59RRs 1500
xinference/core/restful_api.py sha256=kNAcXQusicDrKd4qVt1gK3_hNY9ZK2MSnNucq5Sv5OU 27552
xinference/core/supervisor.py sha256=KZfh4kD8Atq_7jIX2SHjYLsYoDm3xRwa-mun8Ck5S_E 12499
xinference/core/utils.py sha256=-G97SDWYNPN4jniiJq3jJSFF_z3FsZraNCfNPyTfKLs 2469
xinference/core/worker.py sha256=baaOMe8hpDi48pxl1R3S0AyYlwwRIoyr8AXfzZ0Ftr0 8141
xinference/deploy/__init__.py sha256=h_JgzSqV5lP6vQ6XX_17kE4IY4BRnvKta_7VLQAL1ms 581
xinference/deploy/cmdline.py sha256=DHtg4Rleqw3iyUIHWya6an5UFEcnR3PqKkt8uJk9JaY 19256
xinference/deploy/local.py sha256=2WYXI4vR8maTERCm6QwZFUBs9ZbBU6BCzfmKJCxZdZY 1728
xinference/deploy/supervisor.py sha256=5RkddMluzI7bfm1_JPDRJdOZgyWl61WMMZQGdNrHl-c 3177
xinference/deploy/utils.py sha256=k0midNX3ab_LFYTQCMuLEKfVyVLwT_Fz6Qnq-kd9D2g 2345
xinference/deploy/worker.py sha256=9AlQs_68zRqY6Ly5Iy137Advf2sHN883yP5ov2WL_KA 2184
xinference/deploy/test/__init__.py sha256=h_JgzSqV5lP6vQ6XX_17kE4IY4BRnvKta_7VLQAL1ms 581
xinference/deploy/test/test_cmdline.py sha256=fq-fx8oyg5UvHJd50l6dFuyu49ZjUwOLzQ7EP4csT2M 5415
xinference/locale/__init__.py sha256=h_JgzSqV5lP6vQ6XX_17kE4IY4BRnvKta_7VLQAL1ms 581
xinference/locale/utils.py sha256=w-G1DAJGw1UUQVVtq6khOZn7ZjobUmTw6qwHMm2eWIs 1312
xinference/locale/zh_CN.json sha256=YA55G9s1p05Bt5RBoDo5SV12dd-CMJI0ABap6RpCp4M 1097
xinference/model/__init__.py sha256=IRC3ojiqYkVLIK_xsIxYeKypEeeTTdrovnVzK_4L4eg 663
xinference/model/core.py sha256=jdA9b0PVuB2bsjM1NWHngYGX-ZsdlfrKO8tKKNUMAxc 1690
xinference/model/embedding/__init__.py sha256=Pp0CWtwKdiiR5d5D6H41WviPgsxe5JekVGlr3irqCcY 924
xinference/model/embedding/core.py sha256=SGSSoisISjlw2o4H6_pepKbJJaVDKsRIsKogFIp7Cts 10957
xinference/model/llm/__init__.py sha256=Po-BLGuTpmEs1KgCt1wMMYGRAohbQD_QYkn0qCxIgBo 2873
xinference/model/llm/core.py sha256=QZfc8aTXx25YhBlX6eZYc0LbseJKWNh2l1-ntcsVxF0 4314
xinference/model/llm/llm_family.json sha256=PdjBURFkW-J5Ma4kwkAgYS6L6wE8fJ3pIvYqPHcP0wc 37746
xinference/model/llm/llm_family.py sha256=9Xov8xbXRfYgAlTdS4DxuDOk_ZxTRsAQQouRAOFhF3w 13861
xinference/model/llm/utils.py sha256=PTHeK0Zwbp_a_6Mncm724LCaCWoFnEoLXDKnpa57cqo 9277
xinference/model/llm/ggml/__init__.py sha256=h_JgzSqV5lP6vQ6XX_17kE4IY4BRnvKta_7VLQAL1ms 581
xinference/model/llm/ggml/chatglm.py sha256=bD3thvxjJgV-lRHsGrtvyewdgVV5t3-HuNUNuHAiX4M 7159
xinference/model/llm/ggml/ctransformers.py sha256=wWlIW6a_rnKSRgjC5tmWsmZM35r7Xw7Clcy3sgiIl9Y 9613
xinference/model/llm/ggml/ctransformers_util.py sha256=WozFJgJZlbuEDPQLhy31YmwGp-oJoUYsnd9HjuGraIE 5271
xinference/model/llm/ggml/llamacpp.py sha256=EMM4AsEXV5cRssePOqlXwMxrhunAWgkXl-d9jiRIGGE 10291
xinference/model/llm/pytorch/__init__.py sha256=h_JgzSqV5lP6vQ6XX_17kE4IY4BRnvKta_7VLQAL1ms 581
xinference/model/llm/pytorch/baichuan.py sha256=rRNZlCM4x388NW7HTPqqKiaPPFfPUxNShz3apFJpuEw 2687
xinference/model/llm/pytorch/chatglm.py sha256=beNR3BQ6YK-PpppqHw0_Ve8Hk-jVl9cJzmqAG-8q-vw 2394
xinference/model/llm/pytorch/compression.py sha256=rN8z0yt2xV9ASLv1muYStyBdvZjGCQL-OYaEga4FwIQ 8081
xinference/model/llm/pytorch/core.py sha256=B4u3zF30rbmLgNkl29pEQ6qk_AdkmtjrY5jmAO41Odw 17947
xinference/model/llm/pytorch/falcon.py sha256=XzXxr-bGEXyjcxAzEahAcBzHEHvswbwtfXT179CZvAc 4194
xinference/model/llm/pytorch/llama_2.py sha256=Bgmp_6DiooGSiuevHl44UHX4i6XXPHZBddxPSmnBfJc 3447
xinference/model/llm/pytorch/utils.py sha256=XO2iy7SA6uc67ulbN8jDxJG4KSAgos0EEsKOolVL4Zo 20380
xinference/model/llm/pytorch/vicuna.py sha256=sCorZHLuiKLgV4681RMjzdy54BgMrdGSnpkhDtarMeY 2184
xinference/web/ui/build/asset-manifest.json sha256=KADWTXLp_WBFZJkrmECUp1K7BtGlTx34dgPQJyy6JME 300
xinference/web/ui/build/favicon.svg sha256=dWR8uaz0Q9GCcl-DjWvQh07e1f3jhJBt-r4aSbmH3A4 1894
xinference/web/ui/build/index.html sha256=2-dDhOA0ivJvm0MEj2j5SMPdMEIkHW4_s4ffPMs0k6o 589
xinference/web/ui/build/static/js/main.c4459721.js sha256=FQOQ80YgTc2Is0mWxFYPY4vFZDXZ-qHCRWw9JNxc-po 803608
xinference/web/ui/build/static/js/main.c4459721.js.LICENSE.txt sha256=3_GW6JEMTMZjF7I4aVtLugxRltvxzwF3tBcRbPXyzA0 2245
xinference/web/ui/build/static/js/main.c4459721.js.map sha256=OshzRFR9Craxfrr8Xvlor4ryWce2Av1ImeLgA-mNXt0 3666437
xinference/web/ui/build/static/media/icon.4603d52c63041e5dfbfd.webp sha256=kM--URMpXs5Vf0iSqQ8hmUalvWgcmRERpv37CriXRAE 16128
xinference-0.4.0.dist-info/LICENSE sha256=QwcOLU5TJoTeUhuIXzhdCEEDDvorGiC6-3YTOl4TecE 11356
xinference-0.4.0.dist-info/METADATA sha256=5uzoCoekluat3yBaJNarpDAAjCQLCp7SMBnBL-yWY6Y 14327
xinference-0.4.0.dist-info/WHEEL sha256=yQN5g4mg4AybRjkgi-9yy4iQEFibGQmlz78Pik5Or-A 92
xinference-0.4.0.dist-info/entry_points.txt sha256=fJEruRdhXyPmHXYOGmoTmWvF0vO-nGdOBeX8xxDy8q8 175
xinference-0.4.0.dist-info/top_level.txt sha256=L1rQt7pl6m8tmKXpWVHzP-GtmzAxp663rXxGE7qnK00 11
xinference-0.4.0.dist-info/RECORD — —

top_level.txt

xinference

entry_points.txt

[console_scripts]
xinference = xinference.deploy.cmdline:cli
xinference-supervisor = xinference.deploy.cmdline:supervisor
xinference-worker = xinference.deploy.cmdline:worker