llmlingua

View on PyPIReverse Dependencies (12)

0.2.2 llmlingua-0.2.2-py3-none-any.whl

Wheel Details

Project: llmlingua
Version: 0.2.2
Filename: llmlingua-0.2.2-py3-none-any.whl
Download: [link]
Size: 30536
MD5: 6c0efb180fc9d7f7cab51d073d419600
SHA256: da55137efe0db78063b3395396efe8a0dcfe4ae5a09aea0d503c34b7bf1d800c
Uploaded: 2024-04-09 08:21:55 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: llmlingua
Version: 0.2.2
Summary: To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
Author: The LLMLingua team
Author-Email: hjiang[at]microsoft.com
Home-Page: https://github.com/microsoft/LLMLingua
License: MIT License
Keywords: Prompt Compression,LLMs,Inference Acceleration,Black-box LLMs,Efficient LLMs
Classifier: Intended Audience :: Science/Research
Classifier: Development Status :: 3 - Alpha
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.8.0
Requires-Dist: transformers (>=4.26.0)
Requires-Dist: accelerate
Requires-Dist: torch
Requires-Dist: tiktoken
Requires-Dist: nltk
Requires-Dist: numpy
Requires-Dist: transformers (>=4.26.0); extra == "dev"
Requires-Dist: accelerate; extra == "dev"
Requires-Dist: torch; extra == "dev"
Requires-Dist: tiktoken; extra == "dev"
Requires-Dist: nltk; extra == "dev"
Requires-Dist: numpy; extra == "dev"
Requires-Dist: black (==21.4b0); extra == "dev"
Requires-Dist: flake8 (>=3.8.3); extra == "dev"
Requires-Dist: isort (>=5.5.4); extra == "dev"
Requires-Dist: pre-commit; extra == "dev"
Requires-Dist: pytest; extra == "dev"
Requires-Dist: pytest-xdist; extra == "dev"
Requires-Dist: black (==21.4b0); extra == "quality"
Requires-Dist: flake8 (>=3.8.3); extra == "quality"
Requires-Dist: isort (>=5.5.4); extra == "quality"
Requires-Dist: pre-commit; extra == "quality"
Requires-Dist: pytest; extra == "quality"
Requires-Dist: pytest-xdist; extra == "quality"
Provides-Extra: dev
Provides-Extra: quality
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 16085 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
llmlingua/__init__.py sha256=aDJ5I7lzCcf4yhykFQWSshx_2tvcOFNq5OQ1fei5DUc 230
llmlingua/prompt_compressor.py sha256=Ry_ej29V8nP-lO7kDCXHNQjx7Tp_XWF4hjbCD8S-UGg 109840
llmlingua/utils.py sha256=HtPrBzQ1TqATag2YqTZiM6hy0i_zUPqxB-U95FyVTjM 7685
llmlingua/version.py sha256=NIOlT91eMkvipElPsDr7IAuhfudoA23l47a5H8JnkiQ 500
llmlingua-0.2.2.dist-info/LICENSE sha256=ws_MuBL-SCEBqPBFl9_FqZkaaydIJmxHrJG2parhU4M 1141
llmlingua-0.2.2.dist-info/METADATA sha256=nP1I8PLyM0AR-hKg6-fv3ulVGkR3uxi8emWAMV-6xM0 17902
llmlingua-0.2.2.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
llmlingua-0.2.2.dist-info/top_level.txt sha256=OAvGqA5PDTwYcGICaJu-XAAGa-XAxfUdyOFT4Ov16A8 10
llmlingua-0.2.2.dist-info/RECORD

top_level.txt

llmlingua