llm-quantkit

View on PyPIReverse Dependencies (0)

0.29 llm_quantkit-0.29-py3-none-any.whl

Wheel Details

Project: llm-quantkit
Version: 0.29
Filename: llm_quantkit-0.29-py3-none-any.whl
Download: [link]
Size: 54677
MD5: fa17b7c1b5eae9546ab93332ad6760ad
SHA256: dfea6833c9cb77ac3da37002e9848fcdd149f585ec6cf559fe26cf4edc76d5b6
Uploaded: 2024-07-04 15:59:50 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: llm-quantkit
Version: 0.29
Summary: cli tool for downloading and quantizing LLMs
Author-Email: xhedit <jevd[at]protonmail.com>
Project-Url: repository, https://github.com/xhedit/quantkit
License: MIT License
Requires-Dist: click
Requires-Dist: torch (>=2.0.0)
Requires-Dist: einops
Requires-Dist: tqdm
Requires-Dist: transformers
Requires-Dist: huggingface-hub
Requires-Dist: safetensors
Requires-Dist: exllamav2
Requires-Dist: llama-cpp-conv
Requires-Dist: sentencepiece
Requires-Dist: hqq
Requires-Dist: auto-gptq; extra == "cuda"
Requires-Dist: autoawq; extra == "cuda"
Provides-Extra: cuda
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 4341 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (70.2.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
quantkit/cli.py sha256=1Q-OM3ySk_gT3N1M3iCuan3XNTImPRbzSlmU_rREjRo 7728
quantkit/convert.py sha256=8ieuPjD2jRBoYra7YbhtPgqLk7EC30tSg3CNdtuJgjI 71261
quantkit/convert_exl2.py sha256=uG6a1aJYi6j0Vv_hX_pIIn7IlGUn28wsa9iz3xS89To 9276
quantkit/convert_hf.py sha256=977kj94KfGhFVcElBX8zuqEhR0wUOhAQS7FPwFn7IK4 113763
quantkit/quantkit.py sha256=7Tm_AgVfmniME8oP_7Tr6aFQYdiBqxxdXbjNmZYt-No 16116
quantkit/safetensor.py sha256=xJYgpYc59AbL2muh7ZPZ5HSOy5Ch_939CChbEM4qoEs 3638
llm_quantkit-0.29.dist-info/LICENSE sha256=RY36Q350i9pkRbHCtvKo0JrS0Kh2DdDSPYKDBMAQO_8 1063
llm_quantkit-0.29.dist-info/METADATA sha256=fAoFxUVBcyZQiWJ_mwSdyTawoIDnrePA-DP4XbQl7ds 5047
llm_quantkit-0.29.dist-info/WHEEL sha256=y4mX-SOX4fYIkonsAGA5N0Oy-8_gI4FXw5HNI1xqvWg 91
llm_quantkit-0.29.dist-info/entry_points.txt sha256=C3LOs4SQbOaSmCdmy4yvqvJ8-knQFyFeUkXQPytuM9Q 47
llm_quantkit-0.29.dist-info/top_level.txt sha256=Pp3NVhpQMawexp8U-gOHaXXRxjkdT1mrNTVa6bNJL88 9
llm_quantkit-0.29.dist-info/RECORD

top_level.txt

quantkit

entry_points.txt

quantkit = quantkit.cli:main