Wheelodex » Projects » autoawq » autoawq-0.2.6-cp310-cp310-manylinux2014_x86_64.whl

autoawq

View on PyPI — Reverse Dependencies (17)

0.2.6 autoawq-0.2.6-cp39-cp39-manylinux2014_x86_64.whl
autoawq-0.2.6-cp39-cp39-win_amd64.whl
autoawq-0.2.6-cp38-cp38-manylinux2014_x86_64.whl
autoawq-0.2.6-cp38-cp38-win_amd64.whl
autoawq-0.2.6-cp311-cp311-manylinux2014_x86_64.whl
autoawq-0.2.6-cp311-cp311-win_amd64.whl
autoawq-0.2.6-cp310-cp310-manylinux2014_x86_64.whl
autoawq-0.2.6-cp310-cp310-win_amd64.whl

Wheel Details

Project: autoawq
Version: 0.2.6
Filename: autoawq-0.2.6-cp310-cp310-manylinux2014_x86_64.whl
Download: [link]
Size: 94913
MD5: cf40e6d6b0f755657742e6694534f1e6
SHA256: 0d7f8a4d5d6cdafd0262dcea0e532262da4be9af030991f037a5b6b8150b1a2f
Uploaded: 2024-07-23 18:20:27 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: autoawq
Version: 0.2.6
Summary: AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.
Author: Casper Hansen
Home-Page: https://github.com/casper-hansen/AutoAWQ
License: MIT
Keywords: awq,autoawq,quantization,transformers
Classifier: Environment :: GPU :: NVIDIA CUDA :: 11.8
Classifier: Environment :: GPU :: NVIDIA CUDA :: 12
Classifier: License :: OSI Approved :: MIT License
Classifier: Natural Language :: English
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: C++
Platform: linux
Platform: windows
Requires-Python: >=3.8.0
Requires-Dist: torch (==2.3.1)
Requires-Dist: transformers (>=4.35.0)
Requires-Dist: tokenizers (>=0.12.1)
Requires-Dist: typing-extensions (>=4.8.0)
Requires-Dist: accelerate
Requires-Dist: datasets
Requires-Dist: zstandard
Requires-Dist: autoawq-kernels
Requires-Dist: black; extra == "dev"
Requires-Dist: mkdocstrings-python; extra == "dev"
Requires-Dist: mkdocs-material; extra == "dev"
Requires-Dist: griffe-typingdoc; extra == "dev"
Requires-Dist: lm-eval (==0.4.1); extra == "eval"
Requires-Dist: tabulate; extra == "eval"
Requires-Dist: protobuf; extra == "eval"
Requires-Dist: evaluate; extra == "eval"
Requires-Dist: scipy; extra == "eval"
Provides-Extra: dev
Provides-Extra: eval
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 17331 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (71.0.4)
Root-Is-Purelib: false
Tag: cp310-cp310-linux_x86_64

RECORD

Path Digest Size
awq/__init__.py sha256=9wuZhDPMBuFaVnAJ5Hv8EtXtVUnkxipEGjY6CQQ_By0 69
awq/evaluation/__init__.py sha256=VRBd_xx2ELd6a76g1o3wGlhZ599WoZKpQ21r8bec-18 222
awq/evaluation/eval_utils.py sha256=6-wQ1WKsto5163aImvScvgWWC7ChFZvDlTPZ3cMrjqA 5383
awq/evaluation/humaneval_utils.py sha256=6vbJnRXBnfVI8XNYLkORBllcD1QzmyxhImkLKsXWmXM 12562
awq/evaluation/kl_divergence.py sha256=2mD4947RGWdC2SjoUJhgbtGMEKwzCOn9S3kGPUczmis 5559
awq/models/__init__.py sha256=n6aNyzQZ1yfjBRHRPPTNsdF4ir4RzXQHTwTXZjGC8RU 992
awq/models/_config.py sha256=fWOpYdarf6Q2F9GX6Igl9YKRbIVOptsNy520QVaBxeM 3781
awq/models/aquila.py sha256=EHuLB9osyTL0YS0RXcYe-oXe2Ljrlo4UJ0Cagi2kAy8 4643
awq/models/auto.py sha256=5sUTRxCu4hmfhGQbJFuJ5dKGnGuFJWHghbB-hjsUbPU 3965
awq/models/baichuan.py sha256=lN6fYh7zzQH2kQU2LfJIv57v493SLy85808TGNeSRa8 4692
awq/models/base.py sha256=2DdmcER-sDUmUPHVZBozgJ7orzpI3KM_hfblZkp2cIs 25319
awq/models/bloom.py sha256=jz8STOh0eS0fZDyqkVaQRfUQ6gEPW9_knKAity3ODPY 2286
awq/models/cohere.py sha256=H9h9zNE6aoYJdes7duMl5UN6bMxxmUzkylcgWMxJwxQ 4362
awq/models/deepseek_v2.py sha256=2UbTYjKXv_Eh1Kufu_tO3juzp_S-TWQ8URhMDPuq3OU 4105
awq/models/falcon.py sha256=nS97rP1aXhRTU0dbRh5IfxGj5JkdlJ4d-ZV8vOBEQkA 4350
awq/models/gemma.py sha256=Hbcjn0tOgoVbXiJt3feoAtQIengPJCDQrfXw6_KJG-o 5197
awq/models/gpt_bigcode.py sha256=uHqirtUUe2AbFJRORqz6j1CD_j1UWjE8l0D_TdptzSE 1868
awq/models/gpt_neox.py sha256=Tm59JKua1lrzaCu3j36QAmNkYSKa_94Pi1HD3Gg4et4 2015
awq/models/gptj.py sha256=wt_b-I2YG64UXQNCKCDAfTk8c-E90bQgLZHI_hnyU4I 1781
awq/models/llama.py sha256=oxAZCi7rfEzaHkWekd5zWCJJE2UsbVdHI48Yi8uawjk 4673
awq/models/llava.py sha256=7emADYSuc2pj5ZxGSl67QWTXmTOTngsrKY1mFX7tc7k 5008
awq/models/llava_next.py sha256=v74I1YSTaWnF-ho0fETBnTco9fVSacdd68jebdhizc8 4938
awq/models/minicpm.py sha256=AjsZv8JhU1k1nuNk6v_tJCiVzviKCeiN8JXST73N2go 1568
awq/models/mistral.py sha256=nUHes9BSv7ydSBBgUiCmJHk0-pCM0Biy8vcfeX_Nb_k 4666
awq/models/mixtral.py sha256=oY1UmDa6IIPfkmxm5bAH1FrEBhMWiKzsEgFQWnFElwI 6222
awq/models/mpt.py sha256=PQCrUDLQB6towyLyfQJTDzng7YoU__9VNCacVRM66mg 3593
awq/models/opt.py sha256=DDbSPflGDHR3ZNMRzpVxbeFi1fvajTiwkrPk_tF6vJs 2008
awq/models/phi3.py sha256=Q8AVQGcT4sWDi4Cr8KnL7VCGxJJOYIjXIfRKJjXUO9o 4244
awq/models/qwen.py sha256=PKTsaYoafMD0iZRdb7dFIl8LKi-vAom8HDQgyK_AnSQ 1431
awq/models/qwen2.py sha256=Bx5AA0mAsGDFEqhY17WE5CxXoJko_if1fJUwVj2y-mw 4612
awq/models/stablelm.py sha256=Mtf1e2zbunv8U8KhxObbA9wfu53lgT0lfqOKK1DluvI 4631
awq/models/starcoder2.py sha256=g4DHWfBeJpTNNgXi-uLa40kuUacacs4gzxg2a-wOaBQ 4571
awq/models/yi.py sha256=sjw3o_aqUeGyswBvXCfdzzPIS_AQgLFeIz5cLEtb9IU 4211
awq/modules/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
awq/modules/act.py sha256=aZ94be2OHIskt_9ug4UTRZyskx1IBxSRDac5Kdk4NYo 296
awq/modules/fused/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
awq/modules/fused/attn.py sha256=pQiXj2ytnn-5mNU01c5s6LJjOxkxDE-vvh_tLPavK1U 12655
awq/modules/fused/block.py sha256=VF_tF2XugUlh9JuzqjqaMon3ApHUa6huEmB0v6Y7QUk 11892
awq/modules/fused/cache.py sha256=m6wFn9qT0SnxPMfTmZ1uIuk6YWr1z1KACWzRZhGwplU 2463
awq/modules/fused/mlp.py sha256=nic2dxPgsqhtAIEssosLea4fgt-dqkybtVp5Zs72Dq4 2474
awq/modules/fused/model.py sha256=y1inMPz7OCjRY-HG-a9E6HhCztjmJM4OL_rR5NAN6qs 10166
awq/modules/fused/moe.py sha256=MZH04VvU6KsiAEx01xWrXRzCyWE5N40QwCKFXQlP9e8 5901
awq/modules/fused/norm.py sha256=x95x5CWRY-U7OD19prFkeXkTsvshGAJTz4oSlvyAF9Q 671
awq/modules/linear/__init__.py sha256=7R_Zt9lM-gOHh4K-Py_2_vhb5eSSmGFqOMU4wfyWXSA 342
awq/modules/linear/exllama.py sha256=k_eyUbiVPbCaKUeN9Qpp0r9ms1Qw7F9rvUfcQYCfS4U 4529
awq/modules/linear/exllamav2.py sha256=F4bSBbwPy7eXWq-0vaB3ZLd7xGMbuL4hnyRkIuXXUWw 6771
awq/modules/linear/gemm.py sha256=Cup6iclHM67RFTdVJcdKQlSEFrcre2Iz1s-jfxjadwY 8773
awq/modules/linear/gemm_qbits.py sha256=BdA_2in4yCSyISSKe2JcnlHL4EvJHLK653FFW245pJ4 5829
awq/modules/linear/gemv.py sha256=QFH4VHN13pzATOhi81Ob9g7ps2ddUyznUKh1jqYMwRk 6747
awq/modules/linear/gemv_fast.py sha256=2tESBezzps9sGkD37rT7ocuHlSiOOkCztqpLFr8-94Y 6906
awq/modules/linear/marlin.py sha256=WW0OExGwUXC9FnERYmFRBamPPY3uksVL8K7ja4eqrcA 7166
awq/quantize/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
awq/quantize/quantizer.py sha256=DOaf6zBltPMUALm3UFiJPiIMt9DldRVJ-JOCxJSQ8qM 24009
awq/quantize/scale.py sha256=StEQVGK6t3KCvUvRIoiFnqk8dsTKTqMSc7KFMJow7MY 5270
awq/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
awq/utils/calib_data.py sha256=jyMoLTzMI4X9S6iN1nMsrMofYy90GIp8FAaaOQS3Wd8 2134
awq/utils/fused_utils.py sha256=w_dIjgi7WIiUKfJcXLVgmki8QwuZW-izfXxxhaxNPGc 9019
awq/utils/module.py sha256=TotkGJ_jZGvRpmxfSkzEmWdYaLqO-rJuol3eblptDFI 1714
awq/utils/packing_utils.py sha256=Zeqz6r4_VeMA_7q1_qxZxJMi2YX0Lc2k4iiIWfuaSr4 3283
awq/utils/parallel.py sha256=QykJ7wIy7VYUSQdNa10TLZR_P2lyS4BH4ncoFMyMt1c 834
awq/utils/quant_utils.py sha256=-0PY_c0GAcA1HdRDJwtmwoqo5tDHKqQAOiBfGGgFWSg 4904
awq/utils/utils.py sha256=k5w_kf-vrrm4aRyl7IAfRZ0sOzn4ww8M3BEf-IBBBGQ 3183
autoawq-0.2.6.dist-info/LICENSE sha256=KvSF0mkHG1g8YsICUKYzSfgxMxLMnfC9kAfKOcbVe9k 1068
autoawq-0.2.6.dist-info/METADATA sha256=R3zdlP3ytU_q_hoqaTAwmLWsq00A84yhn4LqS_WQ6iA 18987
autoawq-0.2.6.dist-info/WHEEL sha256=_n72mUudtUKFV8ymmCSxMMWdfubt8dJDmQQyc6bJWMo 104
autoawq-0.2.6.dist-info/top_level.txt sha256=1ac2EWKyAP529fvezQOHpI34L36XqaymH-db8ncpOvY 16
autoawq-0.2.6.dist-info/RECORD — —

top_level.txt

awq
test_kernel