Wheelodex » Projects » fm-optimized-inference

fm-optimized-inference

View on PyPI — Reverse Dependencies (0)

0.1 fm_optimized_inference-0.1-py3-none-any.whl

Wheel Details

Project: fm-optimized-inference
Version: 0.1
Filename: fm_optimized_inference-0.1-py3-none-any.whl
Download: [link]
Size: 30982
MD5: 372eabf62596b85b7fb6d6ef9a4ddfde
SHA256: 9d8b8d537ab3ae76e7753bc9088e9b585f0840501857b5deafdb4a2103c0474a
Uploaded: 2023-12-05 02:08:45 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: fm-optimized-inference
Version: 0.1
Author: Microsoft
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3.8
Requires-Python: >=3.8
Requires-Dist: deepspeed (==0.12.3)
Requires-Dist: deepspeed-mii (==0.1.1)
Requires-Dist: deepspeed-kernels (==0.0.1.dev1698255861)
Requires-Dist: pandas (~=2.1.3)
Requires-Dist: transformers (~=4.35.0)
Requires-Dist: vllm (==0.2.1.post1)
Requires-Dist: aiolimiter (~=1.1.0)
Requires-Dist: azure-ai-contentsafety (~=1.0.0b1)
Requires-Dist: azure-ai-ml (==1.10.1)
Requires-Dist: azure-identity (==1.14.0)
Requires-Dist: azureml-ai-monitoring (==0.1.0b4)
Requires-Dist: azureml-inference-server-http
Requires-Dist: azureml-mlflow
Requires-Dist: cryptography (~=41.0.5)
Requires-Dist: certifi (==2023.07.22)
Requires-Dist: requests (~=2.31.0)
Requires-Dist: aiohttp (~=3.8.6)
Requires-Dist: pytest; extra == "dev"
Provides-Extra: dev
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 13 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.42.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
src/__init__.py sha256=s3jPgxA-xuraxF_18KgD1Lk7j58N0rdnzY0-vFkZAUQ 527
src/configs.py sha256=cn2JvNuclnT0X7XLUXS1z1QG9Je6CnEnIQw3LL0_G4I 2792
src/constants.py sha256=dyelHFXIg6OtF7zNFtR7S_lP37jPrhMhS_kj9w4lgyE 1010
src/conversation.py sha256=AtsReJo0fUcM9NFEtBs0FHwyseVAfxAzaJMdVI-T74M 3151
src/fm_score.py sha256=7gaYYkNmPg6aZtZxL0oAn019TGlOdmZ6JAaKcYG_Clk 3642
src/logging_config.py sha256=QO2wctldgYvOaHXB-JH7l95WRP6fpgchCXSj8UjLhpg 672
src/managed_inference.py sha256=qK2vKQ25j-wCn9VlXQSo9jNMwEp1mEDCbKpwF6wU9rk 4536
src/prompt_formatter.py sha256=mK3ioo8eoHKdF3TMw9xaclnw_6DO9QqZLoRoVVtaHGk 998
src/replica_manager.py sha256=dG9Rk7pHJ4zCVxJln7VhcrxXPWBmZz_D5AmOvUA7ExU 10878
src/score.py sha256=7JsfHL-sGUpSj0GK4lAbRGhjcFaYj1TXr6J0bL0-9aE 17202
src/utils.py sha256=SsPKvkIyHpOPlbsqIUeyBtK-zONgM7J2CVaEH7-Qzes 2845
src/engine/__init__.py sha256=Ba_MV2Gj7LhlDfOYtqak8OWtg0sPgDzTRxw_OPXT9Wc 240
src/engine/engine.py sha256=Asr2aWgNMhXm8AtZhtSOYSjprgP2RLhG15fdUabbRGw 6088
src/engine/mii_engine.py sha256=sn2Q3MRll9h5Jc5mU4D4QYc2Z0CR-ZJyD1rBBwb7eJM 8639
src/engine/mii_engine_v2.py sha256=lykq7n9zCkbNlyFWCw-HSy4o6oE7VmUcNZ3gFjhaNpU 7221
src/engine/vllm_engine.py sha256=IXr8yRln7MaspTEV5urS-V7OXPJhUw_rKNn5R370yec 13031
fm_optimized_inference-0.1.dist-info/LICENSE sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
fm_optimized_inference-0.1.dist-info/METADATA sha256=3HheHsZhHAUCxlEKlwThl9tlWXMxHWYx8oXJW8eJepA 1099
fm_optimized_inference-0.1.dist-info/WHEEL sha256=oiQVh_5PnQM0E3gPdiz09WCNmwiHDMaGer_elqB3coM 92
fm_optimized_inference-0.1.dist-info/top_level.txt sha256=74rtVfumQlgAPzR5_2CgYN24MB0XARCg0t-gzk6gTrM 4
fm_optimized_inference-0.1.dist-info/RECORD — —

top_level.txt

src