| Metadata-Version: |
2.4 |
| Name: |
openllm |
| Version: |
0.6.19 |
| Summary: |
OpenLLM: Self-hosting LLMs Made Easy. |
| Author-Email: |
BentoML Team <contact[at]bentoml.com> |
| Project-Url: |
Blog, https://modelserving.com |
| Project-Url: |
Documentation, https://github.com/bentoml/OpenLLM#readme |
| Project-Url: |
GitHub, https://github.com/bentoml/OpenLLM |
| Project-Url: |
Homepage, https://bentoml.com |
| Project-Url: |
Tracker, https://github.com/bentoml/OpenLLM/issues |
| Project-Url: |
Twitter, https://twitter.com/bentomlai |
| Keywords: |
AI,Alpaca,BentoML,Falcon,Fine tuning,Generative AI,LLMOps,Large Language Model,Llama 2,MLOps,Mistral,Model Deployment,Model Serving,PyTorch,Serverless,StableLM,Transformers,Vicuna,vLLM |
| Classifier: |
Development Status :: 5 - Production/Stable |
| Classifier: |
Environment :: GPU :: NVIDIA CUDA |
| Classifier: |
Environment :: GPU :: NVIDIA CUDA :: 11.7 |
| Classifier: |
Environment :: GPU :: NVIDIA CUDA :: 11.8 |
| Classifier: |
Environment :: GPU :: NVIDIA CUDA :: 12 |
| Classifier: |
Intended Audience :: Developers |
| Classifier: |
Intended Audience :: Science/Research |
| Classifier: |
Intended Audience :: System Administrators |
| Classifier: |
License :: OSI Approved :: Apache Software License |
| Classifier: |
Operating System :: OS Independent |
| Classifier: |
Programming Language :: Python |
| Classifier: |
Programming Language :: Python :: 3 |
| Classifier: |
Programming Language :: Python :: 3 :: Only |
| Classifier: |
Programming Language :: Python :: 3.8 |
| Classifier: |
Programming Language :: Python :: 3.9 |
| Classifier: |
Programming Language :: Python :: 3.10 |
| Classifier: |
Programming Language :: Python :: 3.11 |
| Classifier: |
Programming Language :: Python :: 3.12 |
| Classifier: |
Programming Language :: Python :: Implementation :: CPython |
| Classifier: |
Programming Language :: Python :: Implementation :: PyPy |
| Classifier: |
Topic :: Scientific/Engineering :: Artificial Intelligence |
| Classifier: |
Topic :: Software Development :: Libraries |
| Classifier: |
Typing :: Typed |
| Requires-Python: |
>=3.9 |
| Requires-Dist: |
bentoml (==1.4.0a2) |
| Requires-Dist: |
dulwich |
| Requires-Dist: |
huggingface-hub |
| Requires-Dist: |
nvidia-ml-py |
| Requires-Dist: |
openai (==1.61.1) |
| Requires-Dist: |
pathlib |
| Requires-Dist: |
pip-requirements-parser |
| Requires-Dist: |
psutil |
| Requires-Dist: |
pyaml |
| Requires-Dist: |
questionary |
| Requires-Dist: |
tabulate |
| Requires-Dist: |
typer |
| Requires-Dist: |
uv |
| Description-Content-Type: |
text/markdown |
| License-Expression: |
Apache-2.0 |
| License-File: |
LICENSE |