Wheelodex » Projects » kvpress

kvpress

0.0.2

kvpress-0.0.2-py3-none-any.whl

Wheel Details

Project:	kvpress
Version:	0.0.2
Filename:	kvpress-0.0.2-py3-none-any.whl
Download:	[link]
Size:	22352
MD5:	`b5d20843ef6bb45a7bf93891822044d7`
SHA256:	`3de96076ddb78f1efc26164cd9458fd4ee01b1dcb6e027ae2e54d87650900ca8`
Uploaded:	2024-11-21 15:54:53 +0000

Metadata-Version:	2.1
Name:	kvpress
Version:	0.0.2
Summary:	Efficiently compress the KV cache of any pretrained transformer
Author:	Simon Jegou
Classifier:	Programming Language :: Python :: 3
Classifier:	Programming Language :: Python :: 3.10
Classifier:	Programming Language :: Python :: 3.11
Classifier:	Programming Language :: Python :: 3.12
Classifier:	Programming Language :: Python :: 3.13
Requires-Python:	>=3.10
Requires-Dist:	accelerate (<2.0.0,>=1.0.0)
Requires-Dist:	bert-score (<0.4.0,>=0.3.13)
Requires-Dist:	bs4 (<0.0.3,>=0.0.2)
Requires-Dist:	datasets (<3.0.0,>=2.21.0)
Requires-Dist:	fire (<0.7.0,>=0.6.0)
Requires-Dist:	ipykernel (<7.0.0,>=6.29.4)
Requires-Dist:	matplotlib (<4.0.0,>=3.9.0)
Requires-Dist:	nltk (<4.0.0,>=3.9.1)
Requires-Dist:	numpy (<3.0.0,>=2.0.0)
Requires-Dist:	nvitop (<2.0.0,>=1.3.2)
Requires-Dist:	pandas (<3.0.0,>=2.2.2)
Requires-Dist:	protobuf (<6.0.0,>=5.27.2)
Requires-Dist:	rouge (<2.0.0,>=1.0.1)
Requires-Dist:	scipy (<2.0.0,>=1.13.1)
Requires-Dist:	sentencepiece (<0.3.0,>=0.2.0)
Requires-Dist:	torch (<3.0.0,>=2.3.1)
Requires-Dist:	tqdm (<5.0.0,>=4.66.4)
Requires-Dist:	transformers (<5.0.0,>=4.45.1)
Description-Content-Type:	text/markdown

[Description omitted; length: 9042 characters]

Path	Digest	Size
kvpress/__init__.py	sha256=7FXlVemOxIzs4vOoElDOMdCbzwkva_G4FG0Lh-9jFZQ	950
kvpress/per_layer_compression_wrapper.py	sha256=eCLtdvvfBz9O92IxIW3YWY-sVmOMs60M9WB16IAOzvw	1594
kvpress/pipeline.py	sha256=G1sdV6HS_N0WQXMLPiPyAIldPoKZhw1FwgCqxslIp3E	10307
kvpress/presses/__init__.py	sha256=taPTnnfqd_hzqR254qtcrQJ2lzV-nSPEwlPHmKzfgDw	142
kvpress/presses/base_press.py	sha256=Y-8pnx63A0Ngr7YpGbceMsQdqTi8GtpmFfNxuU9EF4Y	5463
kvpress/presses/expected_attention_press.py	sha256=PXxhDfKZLygMGj2gVz6xpN3Mfz2GeNffAVXBin_9IeQ	5454
kvpress/presses/knorm_press.py	sha256=QOtZwXWAXSNqBHuh3fEe9RU3YpHjF23GXXTbBxohMBg	607
kvpress/presses/observed_attention_press.py	sha256=VcRsNaDyBR166qHDXCazGSE2azQUMQO98JfDNH1NM7U	2173
kvpress/presses/random_press.py	sha256=foeKt7wWdq2BHnaDqbNxFpfgdwo0juvPpBjtbSIjhjk	591
kvpress/presses/snapkv_press.py	sha256=dVEV2a8wQ8kA0hQiGWC5XurzzM87OWAkpIdFhhUFuEg	4016
kvpress/presses/streaming_llm_press.py	sha256=2Wkzj-fz2JysLyLDSq_Rqo1JrenEKjGh_ZjfeAoyzls	1180
kvpress-0.0.2.dist-info/LICENSE	sha256=MSQpzXs-8lxSuGp8Hrfe83pOEWawqJQyiVPo-j_s5PA	11348
kvpress-0.0.2.dist-info/METADATA	sha256=MDeXdl6jR01_bty_GL-g7IuviIH6qvfHIocDTmcC5_c	10234
kvpress-0.0.2.dist-info/WHEEL	sha256=Nq82e9rUAnEjt98J6MlVmMCZb-t9cYE2Ir1kpBmnWfs	88
kvpress-0.0.2.dist-info/RECORD	—	—