Wheelodex » Projects » autoawq » autoawq-0.2.6-cp310-cp310-win_amd64.whl

autoawq

View on PyPI — Reverse Dependencies (17)

0.2.6 autoawq-0.2.6-cp39-cp39-manylinux2014_x86_64.whl
autoawq-0.2.6-cp39-cp39-win_amd64.whl
autoawq-0.2.6-cp38-cp38-manylinux2014_x86_64.whl
autoawq-0.2.6-cp38-cp38-win_amd64.whl
autoawq-0.2.6-cp311-cp311-manylinux2014_x86_64.whl
autoawq-0.2.6-cp311-cp311-win_amd64.whl
autoawq-0.2.6-cp310-cp310-manylinux2014_x86_64.whl
autoawq-0.2.6-cp310-cp310-win_amd64.whl

Wheel Details

Project: autoawq
Version: 0.2.6
Filename: autoawq-0.2.6-cp310-cp310-win_amd64.whl
Download: [link]
Size: 95675
MD5: 43de7a368a2b7aa6b639848525f91c3e
SHA256: fc2c72ae513b382adc3e3f17be71ae19b8d0dc309b865c8a9454888d55886ba5
Uploaded: 2024-07-23 18:20:28 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: autoawq
Version: 0.2.6
Summary: AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.
Author: Casper Hansen
Home-Page: https://github.com/casper-hansen/AutoAWQ
License: MIT
Keywords: awq,autoawq,quantization,transformers
Classifier: Environment :: GPU :: NVIDIA CUDA :: 11.8
Classifier: Environment :: GPU :: NVIDIA CUDA :: 12
Classifier: License :: OSI Approved :: MIT License
Classifier: Natural Language :: English
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: C++
Platform: linux
Platform: windows
Requires-Python: >=3.8.0
Requires-Dist: torch (==2.3.1)
Requires-Dist: transformers (>=4.35.0)
Requires-Dist: tokenizers (>=0.12.1)
Requires-Dist: typing-extensions (>=4.8.0)
Requires-Dist: accelerate
Requires-Dist: datasets
Requires-Dist: zstandard
Requires-Dist: autoawq-kernels
Requires-Dist: black; extra == "dev"
Requires-Dist: mkdocstrings-python; extra == "dev"
Requires-Dist: mkdocs-material; extra == "dev"
Requires-Dist: griffe-typingdoc; extra == "dev"
Requires-Dist: lm-eval (==0.4.1); extra == "eval"
Requires-Dist: tabulate; extra == "eval"
Requires-Dist: protobuf; extra == "eval"
Requires-Dist: evaluate; extra == "eval"
Requires-Dist: scipy; extra == "eval"
Provides-Extra: dev
Provides-Extra: eval
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 17331 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (71.0.4)
Root-Is-Purelib: false
Tag: cp310-cp310-win_amd64

RECORD

Path Digest Size
awq/__init__.py sha256=5KFISXwijcgOw-5KJzzZY1NBpA9IQXYaS0grsF87NwE 71
awq/evaluation/__init__.py sha256=MlXavaJhTpTDVTrp71Urawj84McmPgNXA9ltXLto43k 229
awq/evaluation/eval_utils.py sha256=50Dyo117P7LYsN6_2FbaWA9l-UBWI_AtmBsKS5JTOyE 5560
awq/evaluation/humaneval_utils.py sha256=VtxlHmObpURQaBSVyJBWgZZQ6dHbfrHzkySNa8T0isk 13026
awq/evaluation/kl_divergence.py sha256=Dc1WVSCLjSEmSPL773-JOJOF-Lna3ZjPLeYxhSRYhGI 5718
awq/models/__init__.py sha256=W0a-dIYVhzMGXXNDVFPT33lAL-kJ5U_lWWsVGAg6PYI 1016
awq/models/_config.py sha256=Fm5BYlKL9J9glbqMUynZxXALuHS1lbR-gjClIYW4noc 3883
awq/models/aquila.py sha256=Mp2Jnlrzw9YhfGY-bLTa120O2FQbvrEIijKKEFahiYY 4783
awq/models/auto.py sha256=mdVfHS7h9d6SRicf_KBSzqZDiCLXSYrfpW0BiJilMyM 4089
awq/models/baichuan.py sha256=HhNwdWAJfRSnO4YULSOZt98Sh4a4AHbchYr2SIgwFuk 4834
awq/models/base.py sha256=uTzEnlWXc8igkEl_WglZCZu037Ne9rng3bCsHYRPkOc 26020
awq/models/bloom.py sha256=aD5s-GPrGeXCWu38sdM01uRtV-BidU6MKNzkKaEIkMQ 2356
awq/models/cohere.py sha256=DGSPpddiwxh_yZuc_G5aZtjg_jTXVgkAEYMABBwSwa0 4490
awq/models/deepseek_v2.py sha256=zY5qlHJUvp1OW_K6hZovZrgmqChVZQA13bWFUOWpuZ4 4233
awq/models/falcon.py sha256=-gr_QlqzhzrXvtm7juKBfx7NOS_wKkPvQUrq_gEkFjQ 4483
awq/models/gemma.py sha256=T_n_6cIZnRRWBKrEUJhWYjOI7zXNtb-uTLx9RN5yZIU 5346
awq/models/gpt_bigcode.py sha256=8n7NkFZ5jWOTrNeJqymOk1fF_nFA2xDHJZq9sUOtQQI 1933
awq/models/gpt_neox.py sha256=B0vCkldMnkxMIe3FRcpa2RSHEN2ycn-Hu2WgDoqDTXA 2085
awq/models/gptj.py sha256=qdtBr6FuqD3l92o8UrZYP2Ox7EWOqQYDXa4Myu1S7r4 1845
awq/models/llama.py sha256=ksx1Tq2gq14yag_SCcQeR6dQWF5e9MHsozjKdcqcKTo 4811
awq/models/llava.py sha256=vOg0XKkhg4T5tx6gkVjOXnbtlXAgza563ll-WY8f-Bs 5153
awq/models/llava_next.py sha256=T248MpxjaIQh8m25YjeqUVZPH6o_7xVc_trKCaQHDa8 5083
awq/models/minicpm.py sha256=CwZBBIDvxvVpWUApjkyYKqORb4O47ByVjA6-RVik93I 1630
awq/models/mistral.py sha256=-sJYD733S7ngs_uLHbIvp1PG1TDQgQfv5OBFYQVvdqw 4805
awq/models/mixtral.py sha256=lM7P6I1MjPW8AbREm6gFBvRqlMYm1SUUdxmxruRd-As 6409
awq/models/mpt.py sha256=rxWdxAIoiRYaNFzgz2_uqB5cb0feRvOPzWR_wOxdv8o 3716
awq/models/opt.py sha256=EzjapS0z0IakTNzAz3gDUZggkYi6dGT5hL1kdOad8PQ 2078
awq/models/phi3.py sha256=t0j-rYJkXtEdPXW-JSWsUMz6LwTCnAF9MUErw3dnY0A 4371
awq/models/qwen.py sha256=HnfA79SC9MlvkmUEQ1vTgDW3nC9r0Extf6bEL-wIVyQ 1486
awq/models/qwen2.py sha256=GgBiUpcPG2DzPpynSNRD-xvF2ilJRdkxkx8x8LEQWbs 4749
awq/models/stablelm.py sha256=Jh3Fy6XXZOWqrufWEAO4iivn_eR3UMpJiTeKvU9Z5qE 4767
awq/models/starcoder2.py sha256=XliUg26W07DEHtwMGfur6gLPDohL2wwCBwvN67J_29E 4707
awq/models/yi.py sha256=WD_OUoxuOyvL6hn--GiTpwSxsJ3cA66HZamvCe1IpGg 4343
awq/modules/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
awq/modules/act.py sha256=mjD6bTt8MMo5cSGSncFBEt7kmPGbOMN0EfJ6SKXy__0 307
awq/modules/fused/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
awq/modules/fused/attn.py sha256=pQiXj2ytnn-5mNU01c5s6LJjOxkxDE-vvh_tLPavK1U 12655
awq/modules/fused/block.py sha256=JcDKp7FzvIEly4-0WNBMMR_tWqS7pupquwFBcSsjrZM 12336
awq/modules/fused/cache.py sha256=HZY6L7skuwSapzjn4CKXE8epBnONCzZrcUzHUuN3QEs 2533
awq/modules/fused/mlp.py sha256=nic2dxPgsqhtAIEssosLea4fgt-dqkybtVp5Zs72Dq4 2474
awq/modules/fused/model.py sha256=v5DGBed1DTs8FuLiUgBRkqpzl67iDHxk8Lvo8fJq23M 10541
awq/modules/fused/moe.py sha256=jIUSZAeM4AbDF_twHnCfYmWAfxLPEyZpoCCyX0GeD9s 6073
awq/modules/fused/norm.py sha256=zxHiBtLAqL0yJEEX4lRkpuRhhLlFPSgmAfhhdtF-m8g 698
awq/modules/linear/__init__.py sha256=7R_Zt9lM-gOHh4K-Py_2_vhb5eSSmGFqOMU4wfyWXSA 342
awq/modules/linear/exllama.py sha256=k1tamPvkA7LesIXLairDLP5BRRA_eftClN8iX01SIFw 4677
awq/modules/linear/exllamav2.py sha256=FdWqDZK6kDCaLTRregx45XIrpsKDeADhvrlWR86VCjg 6977
awq/modules/linear/gemm.py sha256=n3Kd7voCgy3_lqr6LCuYI088yVd9X4f_4Rq1h3cutzI 9041
awq/modules/linear/gemm_qbits.py sha256=Tcyz_a7S75_NDwd3S2slbKaytF9cUHhswt-P1g_ke2Y 5984
awq/modules/linear/gemv.py sha256=9xy9f7jb32aeZMwa5rF007ZvMXioAvjcnCfPQ4SOEzA 6951
awq/modules/linear/gemv_fast.py sha256=eRUzQSn7hFgTiudu1Xt3ewXhFG45UHLCv7w5WGtmIuA 7117
awq/modules/linear/marlin.py sha256=VAv0r5jtX9Ix449fFnMgtjCyIUo7tYsN0OPUYpVJYW8 7403
awq/quantize/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
awq/quantize/quantizer.py sha256=sqOz9cYN3Srjh8bAQ8dfrX5fZObsl8YyUaSeghGt_EA 24667
awq/quantize/scale.py sha256=rBXi4XPTytV1Goa4rfhV3NIK_1yGEl91rJ43eBHKVK8 5433
awq/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
awq/utils/calib_data.py sha256=gN0UIovajtuRZHTmWR9Hrc0w_kr-4G5MZSbtbkvq2Ng 2199
awq/utils/fused_utils.py sha256=26yh4y6QY9bU5KJX3TxTlMMldaqf4lxiGz-yqjwsoTk 9279
awq/utils/module.py sha256=B-DjhmGbIhYrgmf4aVjhZR8-Ffh3hPqAPASf-8iJnZY 1771
awq/utils/packing_utils.py sha256=51m9Cyork_MFuhJZRst94ROjaFJKMGbzljPT6S-mirM 3385
awq/utils/parallel.py sha256=Thrf08I6yHwloy7uA4d6waflLeROOEx3wiWcy0hGHTM 863
awq/utils/quant_utils.py sha256=2_N3Wz3Gjr8Ud0aphi41suqzSEIJ1BS3BtEzyMAsGQI 5064
awq/utils/utils.py sha256=OtLZs3FFlT28QXOxlvCAsTn04yL4MFjb0hIKG0oNMBg 3290
autoawq-0.2.6.dist-info/LICENSE sha256=ZyOvqdsKHuBAn6udPNK7KM5WYk5prBydnkJKuC1iD4E 1089
autoawq-0.2.6.dist-info/METADATA sha256=m54lMGwLIW7NA6exq8tez6QQDWlirM_FLM39cNMLoK4 19310
autoawq-0.2.6.dist-info/WHEEL sha256=qstK73Skvod5OGfpi-XSHWFWLnM1nDKJYXj3Nxo6mKY 101
autoawq-0.2.6.dist-info/top_level.txt sha256=1ac2EWKyAP529fvezQOHpI34L36XqaymH-db8ncpOvY 16
autoawq-0.2.6.dist-info/RECORD — —

top_level.txt

awq
test_kernel