Wheelodex » Projects » llm-engines

llm-engines

View on PyPI — Reverse Dependencies (0)

0.0.12 llm_engines-0.0.12-py3-none-any.whl

Wheel Details

Project: llm-engines
Version: 0.0.12
Filename: llm_engines-0.0.12-py3-none-any.whl
Download: [link]
Size: 29581
MD5: 18f0a0ca5a4f933e46cfafdeaf622111
SHA256: 2d393a11d11c347f682ab9cdfb0e15e269b28c9806d60a790c30b089b90fa917
Uploaded: 2024-09-19 20:50:20 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: llm-engines
Version: 0.0.12
Summary: A unified inference engine for large language models (LLMs) including open-source models (VLLM, SGLang, Together) and commercial models (OpenAI, Mistral, Claude).
Author: Dongfu Jiang
Author-Email: dongfu.jiang[at]uwaterloo.ca
Home-Page: https://github.com/jdf-progLLM-Engines
Requires-Dist: fire
Requires-Dist: openai
Requires-Dist: google-generativeai
Requires-Dist: accelerate
Requires-Dist: transformers
Requires-Dist: torch
Requires-Dist: Pillow
Requires-Dist: tqdm
Requires-Dist: numpy
Requires-Dist: requests
Requires-Dist: sentencepiece
Requires-Dist: vllm (>=0.5.5)
Requires-Dist: together
Requires-Dist: icecream
Requires-Dist: prettytable
Requires-Dist: sglang[all]
Requires-Dist: mistralai
Requires-Dist: anthropic
Requires-Dist: fastapi (<=0.112.2)
Requires-Dist: flash-attn; extra == "flash-attn"
Provides-Extra: flash-attn
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 12911 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (72.1.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
llm_engines/__init__.py sha256=BoZQuDaY3QsFs4HIKEJVzLSPzaNKLVPHAQBn3j6eJfc 17558
llm_engines/claude.py sha256=dnU-ULpkihFsd8gspOPOXETddFvcOFbh23HalVa50xw 1944
llm_engines/cli.py sha256=s3SrpK7gIHAudeOSDYTQ5bmej7w0w3RVEAusQayykFw 2898
llm_engines/gemini.py sha256=jvKLsjReqJWXpe_ZC0RKbsS1CyEfZnaO_z-PUVaNWK0 2531
llm_engines/mistral.py sha256=bWY-kbiDo5jloxHpuS95qbrSnWcoa7PzBwT6nxJXtZg 1893
llm_engines/openai_text.py sha256=PTBD-cCbq9lWyfHNXkU0ckHE4cz1DoYKwVH0OibUbMM 2202
llm_engines/sglang.py sha256=cxxzlPIG3HDdJgWphl3FIGON2VNR9ReKzImntT8H3Io 8674
llm_engines/together.py sha256=RfWXQSgcQ5ohecXPu5vgaJPtAQlcsGaxl_5OoFNkcQw 3228
llm_engines/utils.py sha256=tqipvVBmli72LNi71sMkU9jSVaj6umsfH905VixNTEY 9891
llm_engines/vllm.py sha256=8jvxdHdzYZ5n0Q_3StGzLz2I7Q3xF14EjLfpy55UKWg 11365
llm_engines/cache/__init__.py sha256=ykOuJx1ANYxhSwaDpoJuINNG2I5IbD4BF52KrBv3EP4 255
llm_engines/cache/cache_dict.py sha256=p8pRIzWYAm7orJmvpkMcJVgNyPeXjKqe5sTE_1wgIwY 1001
llm_engines/cache/cache_lru.py sha256=paMdppvnxXxf3zDyP-pO80XW2e5Db8kZyb3yUCKoR5I 1678
llm_engines/cache/cache_sqlite3.py sha256=rsjoY0aT0XPDym-ztTXIMXBM5XK9gzhrreKsRblvdS0 9532
llm_engines/cache/cache_utils.py sha256=5Od9gc9vd0bUDptnwj581PzcoMyDa7jNJ-_Ua6vbhck 925
llm_engines-0.0.12.dist-info/LICENSE sha256=0UOB5NJl5WrmVZVF2PLIF-iyjwZD5KRwCYYhfzQCpiU 1069
llm_engines-0.0.12.dist-info/METADATA sha256=fgAcsix3lqE91HKllvDOT7_sEy6J_4p3bqXdCcY-ggE 13871
llm_engines-0.0.12.dist-info/WHEEL sha256=R0nc6qTxuoLk7ShA2_Y-UWkN8ZdfDBG2B6Eqpz2WXbs 91
llm_engines-0.0.12.dist-info/entry_points.txt sha256=ZJeygLWnsykNc7YV_DktnSTc7Afm6vNjG8eAdU7Gmp0 53
llm_engines-0.0.12.dist-info/top_level.txt sha256=8KXk5nQ3j2cKgWWStFJAY7xv9hD-GqDK8V8aH5clJkU 12
llm_engines-0.0.12.dist-info/RECORD — —

top_level.txt

llm_engines

entry_points.txt

[console_scripts]
llm-engines = llm_engines.cli:main