Wheelodex » Projects » auto-gptq

auto-gptq

View on PyPI — Reverse Dependencies (35)

0.7.1 auto_gptq-0.7.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
auto_gptq-0.7.1-cp39-cp39-win_amd64.whl
auto_gptq-0.7.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
auto_gptq-0.7.1-cp38-cp38-win_amd64.whl
auto_gptq-0.7.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
auto_gptq-0.7.1-cp311-cp311-win_amd64.whl
auto_gptq-0.7.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
auto_gptq-0.7.1-cp310-cp310-win_amd64.whl

Wheel Details

Project: auto-gptq
Version: 0.7.1
Filename: auto_gptq-0.7.1-cp39-cp39-win_amd64.whl
Download: [link]
Size: 4635953
MD5: a29d4389debe2920f2f6c179b1b843a0
SHA256: 57b4b284ca4ff4e060088252cbfb18a6f7332477fe57cf2b7ef9af158cce9730
Uploaded: 2024-03-01 13:09:28 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: auto_gptq
Version: 0.7.1
Summary: An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Author: PanQiWei
Home-Page: https://github.com/PanQiWei/AutoGPTQ
Keywords: gptq,quantization,large-language-models,transformers
Classifier: Environment :: GPU :: NVIDIA CUDA :: 11.7
Classifier: Environment :: GPU :: NVIDIA CUDA :: 11.8
Classifier: Environment :: GPU :: NVIDIA CUDA :: 12
Classifier: License :: OSI Approved :: MIT License
Classifier: Natural Language :: Chinese (Simplified)
Classifier: Natural Language :: English
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: C++
Platform: windows
Platform: linux
Requires-Python: >=3.8.0
Requires-Dist: accelerate (>=0.26.0)
Requires-Dist: datasets
Requires-Dist: sentencepiece
Requires-Dist: numpy
Requires-Dist: rouge
Requires-Dist: gekko
Requires-Dist: torch (>=1.13.0)
Requires-Dist: safetensors
Requires-Dist: transformers (>=4.31.0)
Requires-Dist: peft (>=0.5.0)
Requires-Dist: tqdm
Requires-Dist: ruff (==0.1.5); extra == "quality"
Requires-Dist: pytest; extra == "test"
Requires-Dist: parameterized; extra == "test"
Requires-Dist: triton (==2.0.0); extra == "triton"
Provides-Extra: quality
Provides-Extra: test
Provides-Extra: triton
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 16701 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.42.0)
Root-Is-Purelib: false
Tag: cp39-cp39-win_amd64

RECORD

Path Digest Size
autogptq_cuda_256.cp39-win_amd64.pyd sha256=g9AbiXRmdDe0h6Z38dDYH28G4k1XB4LrGfKMLF_KPqE 2610688
autogptq_cuda_64.cp39-win_amd64.pyd sha256=Ps8FmCdNwO2f1oiltFJB2YfIQ7nA66PBqmG5SN7qTSc 2339328
exllama_kernels.cp39-win_amd64.pyd sha256=gjttdu2s_ZYhu9FAFaZOhS79uQtohLjbe3M2KKXE3Y4 845824
exllamav2_kernels.cp39-win_amd64.pyd sha256=tgSBuze5ji2wzgmpxhItDR7OxG0s5lhJguxQT4B9u6w 8074752
auto_gptq/__init__.py sha256=dxqUpuEOnM3-PxccLN3wczszWTrH-IEAQZOITXJOhCE 204
auto_gptq/eval_tasks/__init__.py sha256=_Jfg6PjSFxTAtt6ahMZHnkrwvtZwXIHOjoTr7mlrIYM 205
auto_gptq/eval_tasks/_base.py sha256=v7E-d7S4Iv1eA7cXkFhhF0l_0SwZSboHpYDUYpooryM 2261
auto_gptq/eval_tasks/language_modeling_task.py sha256=9OqOXeRZnzSDvcugmPLzYJcODY0Ah0FkqD7hpsffxfU 1264
auto_gptq/eval_tasks/sequence_classification_task.py sha256=qmHTiBi8v5Y3v9lWpcQHtl8uqdEySzeNYiWxCBertnE 3701
auto_gptq/eval_tasks/text_summarization_task.py sha256=i8AfSFBaDIuSDxp_tqn8h_8TcFLtoZiSEx4-3ByFt2o 2598
auto_gptq/eval_tasks/_utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
auto_gptq/eval_tasks/_utils/classification_utils.py sha256=JNrERv9wZiE_C0BP4zIBpq6N9IEFCBvzsVo2-Tho9ZM 1327
auto_gptq/eval_tasks/_utils/generation_utils.py sha256=hKVm0SJnDUeOybXl_A9FcOtVak4xRNtTPMgRYjjCfc0 1480
auto_gptq/modeling/__init__.py sha256=JRZ-b4wxnOKE-PB1UDXKvzKXAbsj-ozUbPETtLS1RrM 1071
auto_gptq/modeling/_base.py sha256=nyQnrr7auJIeHVxggnr4WwEvjTnxmJMvupsRykfacFs 64213
auto_gptq/modeling/_const.py sha256=BSffY5Mzo2AzVj8tz-5w4-6U0jdy3lYRS58HrRzRwbw 1249
auto_gptq/modeling/_utils.py sha256=x71LS1r1Ym8G23UfEbOw8LQEIwADBHAiFOB8H3frfwo 28126
auto_gptq/modeling/auto.py sha256=dlEWrcbf0ZgGw_lqMnuzWas61f3Dwq4LZxl07kRUzRw 6151
auto_gptq/modeling/baichuan.py sha256=QEUzzMctRWKy5w9Bf5TgW8Sf-fj6AFgbMEW86Uh0-Mc 449
auto_gptq/modeling/bloom.py sha256=-5TBoiaOu2j3RSk_tSXjHtNbNQi6mde7RlZzXySwLWo 544
auto_gptq/modeling/codegen.py sha256=bYRnSZ0B7OhaYy98W0cUH8cWBi3yWuu2ZIuFkuHVD_k 423
auto_gptq/modeling/decilm.py sha256=OjKi8kD-NDl0TSAZalBSUcReHGBAH-V99CgcARQAU1k 1066
auto_gptq/modeling/gemma.py sha256=fgy7TYmsGqG5zjqRfhlZpKYwEwkXzcSZdlWnpjVaEAA 555
auto_gptq/modeling/gpt2.py sha256=gqqgDDt6B88aJtGJn7UzeHzmbgwchvbUTKDZE2Q4tbg 428
auto_gptq/modeling/gpt_bigcode.py sha256=UfKtyc7PwBhyEDmwEogJXKtLAvJ_9ikXUWQjPeFmKS8 446
auto_gptq/modeling/gpt_neox.py sha256=2_CYoGF7MLrdMgbZ0ufJgNF3O_7fuybnOSUOFflIvbM 497
auto_gptq/modeling/gptj.py sha256=y9zktnqZ3CemkRKrkVj0JTh1n5DMPOZCZxx6ojK4N5w 588
auto_gptq/modeling/internlm.py sha256=E_AsG4Vk1DXhr78F7-axh5m6qcGZ2NfzG8Si4sW9meo 497
auto_gptq/modeling/llama.py sha256=9li3NWwlrzXYbn2N9W7ct50B4Prv-Q0oD4oIsqqmEpk 1063
auto_gptq/modeling/longllama.py sha256=dY1qwQlzHjyn1ngqCuLf4z9sKEwGGLgfnCv4MRllfcQ 1075
auto_gptq/modeling/mistral.py sha256=f0FuBrNmk4-A9tEzDr3zPb09NP3IXBFibYkgcEm2Mjc 494
auto_gptq/modeling/mixtral.py sha256=_lQhGyNFhxHm9XW8fvqN-gqXyn1QbFPVfTftflysygc 1573
auto_gptq/modeling/moss.py sha256=6n-FZR4-PVW9Sp4FNxfi3gqmS7799u7RshFFY1RrhQ8 414
auto_gptq/modeling/opt.py sha256=vFgzeTDJPl13NvcxKSNhYve9as9355XwaiZwIBDjqGs 628
auto_gptq/modeling/qwen.py sha256=kt_0Ju1fe2DhbXlS86FTR5TJgSk8apIjCyiajsmTc5g 502
auto_gptq/modeling/qwen2.py sha256=-bVQwnKuF1UqqwdvIN1yHNzn4-pEOGRXKkd7CcqAx7E 488
auto_gptq/modeling/rw.py sha256=3yWZvDvqOXJiiANvGFuAJ8pa4d3wQ_hRd-HA8dUwOpo 464
auto_gptq/modeling/stablelmepoch.py sha256=6T5qbKDV4Sc532grSfssxlYp-j6AMTMOie4txTz6s9c 1074
auto_gptq/modeling/xverse.py sha256=hQlg2WlPjEakXol4c_wAorXahLS6safA_5UczQqGkp8 1066
auto_gptq/modeling/yi.py sha256=yw35eTHCbv7MwKA6Vc3iG0XqwINzPm4lqm2whM1YX9g 1054
auto_gptq/nn_modules/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
auto_gptq/nn_modules/_fused_base.py sha256=8HxcV-7thz_fMg5UJGmMWZA8o31OGCJgHhXOLfix1kw 920
auto_gptq/nn_modules/fused_gptj_attn.py sha256=BHTegPBn2LpHmRQJDiP5G-faZcMRj9P03fyQuGnQzs8 12143
auto_gptq/nn_modules/fused_llama_attn.py sha256=NSCHBLNhtGkgLaO9hnc_eTmbuSZMW4L0341hw_Ocvrk 9297
auto_gptq/nn_modules/fused_llama_mlp.py sha256=ObNAeQIUm6apRs33V9Hp8dY-aoNIzfm6IQGPrVOF2PY 12741
auto_gptq/nn_modules/qlinear/__init__.py sha256=xbcOSzwDa925GSGRI8Tael9IsYc1qhg0opHejBiK6II 2199
auto_gptq/nn_modules/qlinear/qlinear_cuda.py sha256=zxdkjzisGyNHSMMTp_F9ctlnlMffBUBN0vsxyYACh7c 12443
auto_gptq/nn_modules/qlinear/qlinear_cuda_old.py sha256=mNvkIMAhLpgN4D6tUlf2MdjzMF2VMRd6wBtmPMC4dAg 14451
auto_gptq/nn_modules/qlinear/qlinear_exllama.py sha256=VcHMco8gTZMBDDdLk0HLmnBsOvGKiedSUa7976jjzQA 6771
auto_gptq/nn_modules/qlinear/qlinear_exllamav2.py sha256=gvQ_WF-nP2zR6zotA1udLS12sSzNoBRRUH4VQrGHuMY 7816
auto_gptq/nn_modules/qlinear/qlinear_marlin.py sha256=pNn-Kfh8fF8axlQmIEeJZMXwSdDLgD0XGUWzoBZWQts 10227
auto_gptq/nn_modules/qlinear/qlinear_qigen.py sha256=pP3tkngGDugXbnLZ-k5K9VyJR0Suzwt-YmUnRh_V6iw 11953
auto_gptq/nn_modules/qlinear/qlinear_triton.py sha256=8dQ8tW_NkgVsd-V3CQ3dZfhwf3PPCLE160C0gCHZl2o 7694
auto_gptq/nn_modules/triton_utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
auto_gptq/nn_modules/triton_utils/custom_autotune.py sha256=iIxKjAdHt9JrlMdxdogMJDUnGipY_BSeaVDRHjIAa2E 7777
auto_gptq/nn_modules/triton_utils/kernels.py sha256=gw7ud3oDNd7uJTeBYcKe0kuHK0FTAw6wZVf8-zv0SSE 14924
auto_gptq/nn_modules/triton_utils/mixin.py sha256=14nbINgahWHDDnhqA2l1QQ0d0oV8XiiLIJYvGZg8tPo 117
auto_gptq/quantization/__init__.py sha256=UotG0wTK34-n9rRmliU1a8yEKagXqdVyFF1Oaxtbf14 68
auto_gptq/quantization/gptq.py sha256=1CqR9zDGUB_GOc5G9hsX-Mpaxi0IvFINDKnxFAgflrg 6913
auto_gptq/quantization/quantizer.py sha256=BtvAmd71GllnsU87-1lBYQSw_LvXUfW819HzsB7CGTw 4449
auto_gptq/utils/__init__.py sha256=vJsHiEXku9j9lLQkjmwZCgMEbzEb7In8lH92TrVScHk 42
auto_gptq/utils/data_utils.py sha256=IK4OkTEEytFAvjvHoEIQAJjoPZNtRZ72vRtFLYANfHA 11341
auto_gptq/utils/exllama_utils.py sha256=FBCFQ6cCA0dplAAYnH_4SzN1YKA61fgovfB_yJHq7o8 3413
auto_gptq/utils/import_utils.py sha256=KWvbzOOKgUELIh2_2wdNY37epqug3CTeKBaCz2ciqnc 3586
auto_gptq/utils/marlin_utils.py sha256=q0Edd3zqDJqJBRRk05PAYCYPHu4jNwh47b6PN0S3qSk 8815
auto_gptq/utils/modeling_utils.py sha256=dyqG0cR_z2Skh8VjKu7xzAJHkTVBjvmWs_e1Pom3t9g 710
auto_gptq/utils/peft_utils.py sha256=sCFugKUafWPW9gxl7HL4JnO5uIRybFg2ArMnqFgOT2M 16894
auto_gptq/utils/perplexity_utils.py sha256=IVrRNpRkKH0JmqF0-gN1wwecVKMx0br8j7yIwW6LJuk 7297
tests/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tests/bench_autoawq_autogptq.py sha256=SaElR912-I5HODyKs6k6wEmTtHAAxDlsByaU4W7926I 4595
tests/test_awq_compatibility_generation.py sha256=zEOMNcpr0PpXnERue1NuxSiIBAFCPoJG-ttP8yaZOdw 9544
tests/test_peft_conversion.py sha256=XECAbmuBvTsz5jKC2vabSGbHu1zopGVOdkDk3zbkm18 3846
tests/test_q4.py sha256=tSQhVQgwNobHQLwV4mo5xyZQD2pfkk5I0V1AxN12MmY 50006
tests/test_quantization.py sha256=cSZbNy-Y5RKvjToKBTSSO6g01FDbdjwcys4BxeTFb0E 1025
tests/test_repacking.py sha256=tqhbzpIDD3IbCRFMqJeAIZAtfAvvf4ZVnEjrFdlPqD4 3917
tests/test_serialization.py sha256=WVvwV3go7Qnms4gJvv5c2jlfCLorxd1A6ltxVDSG-sM 2631
tests/test_sharded_loading.py sha256=iF2RjYQBBX2cZ2qslk5i54v4N3FcHerMSLdaox_ocMo 1181
auto_gptq-0.7.1.dist-info/LICENSE sha256=dJJgcb988-868XBPud5CjUpeyxlm9dwFvc9ERTWiEkM 1096
auto_gptq-0.7.1.dist-info/METADATA sha256=tQzA6Y4pV0vV97s4MiyBMS6uzcoD5P3Q7hfbt5D85vY 18664
auto_gptq-0.7.1.dist-info/WHEEL sha256=GZFS91_ufm4WrNPBaFVPB9MvOXR6bMZQhPcZRRTN5YM 100
auto_gptq-0.7.1.dist-info/top_level.txt sha256=1P2okr-5n6_XqndhFOTKd72CMuF_yLe3NNPFEEvTyLE 85
auto_gptq-0.7.1.dist-info/RECORD — —

top_level.txt

auto_gptq
autogptq_cuda_256
autogptq_cuda_64
exllama_kernels
exllamav2_kernels
tests