Wheelodex » Projects » llm-engines

llm-engines

View on PyPI — Reverse Dependencies (0)

0.0.23 llm_engines-0.0.23-py3-none-any.whl

Wheel Details

Project: llm-engines
Version: 0.0.23
Filename: llm_engines-0.0.23-py3-none-any.whl
Download: [link]
Size: 46363
MD5: 9af67ad520306f28976ac8948cdcfb94
SHA256: 5b662e26d63d1d0c269540738a0fb4fcd849e2dff0073ee5d2e589151bc6f4ec
Uploaded: 2025-03-06 07:32:49 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: llm-engines
Version: 0.0.23
Summary: A unified inference engine for large language models (LLMs) including open-source models (VLLM, SGLang, Together) and commercial models (OpenAI, Mistral, Claude).
Author: Dongfu Jiang
Author-Email: dongfu.jiang[at]uwaterloo.ca
Home-Page: https://github.com/jdf-prog/LLM-Engines
Requires-Dist: fire
Requires-Dist: openai
Requires-Dist: google-generativeai
Requires-Dist: accelerate
Requires-Dist: transformers
Requires-Dist: torch
Requires-Dist: Pillow
Requires-Dist: tqdm
Requires-Dist: numpy
Requires-Dist: requests
Requires-Dist: sentencepiece
Requires-Dist: vllm (>=0.5.5)
Requires-Dist: together
Requires-Dist: icecream
Requires-Dist: prettytable
Requires-Dist: sglang[all]
Requires-Dist: mistralai
Requires-Dist: anthropic (>=0.36.0)
Requires-Dist: fastapi (<=0.112.2)
Requires-Dist: fireworks-ai
Requires-Dist: flash-attn; extra == "flash-attn"
Provides-Extra: flash-attn
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 18666 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (72.1.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
llm_engines/__init__.py sha256=Knqeyzy1yt1tgrADsTUao7Ve6P55RejghqtUJ0ULO6s 28701
llm_engines/claude.py sha256=2cSJgfJzzN_bdDleP-JCltC9Cz54F9f6k8_0SBx6q3s 20518
llm_engines/cli.py sha256=s3SrpK7gIHAudeOSDYTQ5bmej7w0w3RVEAusQayykFw 2898
llm_engines/deepseek.py sha256=pVU1Tt3wiSKo23FXBA2hJ6tFc03k4TbSAzb_ExpM64w 3060
llm_engines/fireworks.py sha256=DC8ir3WjtRnDvgOWei9o_tYfWT7W2lRAX5kzfMFiLDE 3016
llm_engines/gemini.py sha256=mRjjve9f74XF8yTWc5Bp1Gl4fd4jM8klMk7AtsH2-SM 4218
llm_engines/grok.py sha256=9nlHs4WVSILLQqAgNK9lx_igs7nJlRP26Riqp13jHeA 3019
llm_engines/mistral.py sha256=c_XDulcOWEXohkq2jgyyJgy0tTZ9kV_RohmA1TCm0DE 1882
llm_engines/openai_text.py sha256=ncWLQR_rp44jmcL2Et-IGxubSTfAxtC8sCZUKSp66MU 19182
llm_engines/sglang.py sha256=bJxazF6doxwedhpb7K9xXbXZZqhJDU6UnAaASN983aA 8977
llm_engines/together.py sha256=QqXSRokU7o2CT1fhtuKZ5CpNGBpvQI3H_Rm_QWh3TOg 3571
llm_engines/utils.py sha256=g61VIku-bZ6aPq-4ugnRRI6rEO4aVx30iF0gwtl3OzM 11352
llm_engines/vllm.py sha256=Fq-5s-UzFXKgd2IYI5HW7TMn231hCMYpZlOUttkkuL8 11776
llm_engines/cache/__init__.py sha256=7VibjhKkXDYd-cBxrUz8bHRybJe7JuEQkeogBGYjXps 2779
llm_engines/cache/cache_dict.py sha256=_DRS91ddIC7uENB0NlMgg_5jnJ6D7cAm_KRyUYLnVo4 1463
llm_engines/cache/cache_lru.py sha256=_Xr1eBZJU6LxW9QylILmecK08CuAE--33Dj3VP68bbs 2186
llm_engines/cache/cache_sqlite3.py sha256=wsKy_2iBQWI50friB93jZSA1MOR9wdKdNNhiu1v4jxI 9879
llm_engines/cache/cache_utils.py sha256=PApksMgQwGhs_gqNIxOE70EGAV9s4pXDKjeQglYHQx8 4014
llm_engines-0.0.23.dist-info/LICENSE sha256=0UOB5NJl5WrmVZVF2PLIF-iyjwZD5KRwCYYhfzQCpiU 1069
llm_engines-0.0.23.dist-info/METADATA sha256=L4QKsA2jlwNIy_QvgCD_O7_hY8-0yjSqet6JdrChXCU 19664
llm_engines-0.0.23.dist-info/WHEEL sha256=R0nc6qTxuoLk7ShA2_Y-UWkN8ZdfDBG2B6Eqpz2WXbs 91
llm_engines-0.0.23.dist-info/entry_points.txt sha256=ZJeygLWnsykNc7YV_DktnSTc7Afm6vNjG8eAdU7Gmp0 53
llm_engines-0.0.23.dist-info/top_level.txt sha256=8KXk5nQ3j2cKgWWStFJAY7xv9hD-GqDK8V8aH5clJkU 12
llm_engines-0.0.23.dist-info/RECORD — —

top_level.txt

llm_engines

entry_points.txt

[console_scripts]
llm-engines = llm_engines.cli:main