airllm

View on PyPIReverse Dependencies (0)

2.11.0 airllm-2.11.0-py3-none-any.whl

Wheel Details

Project: airllm
Version: 2.11.0
Filename: airllm-2.11.0-py3-none-any.whl
Download: [link]
Size: 36963
MD5: a25d0e81d8b4a56840b1c751bebb901e
SHA256: 668c8424c8f72151cfbecc0892a9cd3c8bd792dceb977683c93a318240a248a2
Uploaded: 2024-09-21 02:52:22 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: airllm
Version: 2.11.0
Summary: AirLLM allows single 4GB GPU card to run 70B large language models without quantization, distillation or pruning. 8GB vmem to run 405B Llama3.1.
Author: Gavin Li
Author-Email: gavinli[at]animaai.cloud
Home-Page: https://github.com/lyogavin/airllm
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Dist: tqdm
Requires-Dist: torch
Requires-Dist: transformers
Requires-Dist: accelerate
Requires-Dist: safetensors
Requires-Dist: optimum
Requires-Dist: huggingface-hub
Requires-Dist: scipy
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 12217 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.37.1)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
airllm/__init__.py sha256=2FvlzDCT9PIiCyxsb2-B3a93cdxCTzx8WUkmVZRzRas 737
airllm/airllm.py sha256=lOghi5WZGs_289_M5UvWq56qFbmmY-SvS5XGgotLR6c 185
airllm/airllm_baichuan.py sha256=2R4_1buR1zOnywlAM71vSEDh6Adfk1iOaeXoDYLsHjw 697
airllm/airllm_base.py sha256=BifNFV1TWlBcia_M68XGWd6LioD12QaxkBjkt6o4oBk 27195
airllm/airllm_chatglm.py sha256=dRGat-jvb0vatuJe-AR_1X95v4KjSJZu4pLj8qYhfvM 1630
airllm/airllm_internlm.py sha256=UsfBeapQ4wjzOkCgFV_ggrOn8KjqhTRNQgSGZHIDPNk 371
airllm/airllm_llama_mlx.py sha256=GO_G4S91cCD1ohxeLBaSWsLLyhaBtNxGk-5nNjqykGI 16729
airllm/airllm_mistral.py sha256=7tT-sz4nVBfJrATm_hU1Mb5zwSo7lCMqj23pjZtSP9o 369
airllm/airllm_mixtral.py sha256=QdjBGkzwFvX9WQ16trWFQ6fCCm5xFMNbD-GQHiMp1D8 370
airllm/airllm_qwen.py sha256=BXGMJkyoSZdl_6tQtD9zlQxoVFfdksnrZqaG7ZP9Aas 1833
airllm/airllm_qwen2.py sha256=k2dOMVeYTHE3N5cPPweWvbsqDVainlvsHL2c4t3CNrk 295
airllm/auto_model.py sha256=axXZGaRInaQaAbXLbxqFIXha49lyc5X19fRArELZGhY 2240
airllm/profiler.py sha256=QFaFPBwA6yGHKFouJ2Jm6tROWzvLT7riEF_jtUvlrdw 996
airllm/tokenization_baichuan.py sha256=aEcxhbpwJbER9os8nJbuhO7Dn1qTNWAg2Q7DlUxOCLA 9613
airllm/utils.py sha256=vxdISmB6YFXiwsd_CZHjEt1Ta9Et8bel5bd-afH5sGY 17794
airllm/persist/__init__.py sha256=h0sbHhGInv9eluUUGCxLAdQ7_Q76yGfXVKqwSmIP0V4 44
airllm/persist/mlx_model_persister.py sha256=2cPH22s9wINZWM3KZKcqGIP8rJWFAtX9Q4gb2bdxNew 3669
airllm/persist/model_persister.py sha256=Jl6-Vlx16caA5QBNmyzHliwE3tS0r4dC-I7vylaBKSQ 897
airllm/persist/safetensor_model_persister.py sha256=-W48wPbVuHUofjoqCPNhDbSWfyKNg2TFR0fQY2_Rkwc 1091
tests/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tests/test_automodel.py sha256=FFrg7hRypzLq88w6IilbkYFulXdbcpFuzFIjTvLrYBs 871
tests/test_compression.py sha256=m-PUm5eUwXVkIsMWNk_tagqiLmMWjf6sh0hCUdBZkNI 1344
airllm-2.11.0.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
airllm-2.11.0.dist-info/METADATA sha256=dT8fWjEM0gh8TqBgS7QbOQR6qEa87_sa-nQ0HnRQ4go 12932
airllm-2.11.0.dist-info/WHEEL sha256=G16H4A3IeoQmnOrYV4ueZGKSjhipXx8zc8nu9FGlvMA 92
airllm-2.11.0.dist-info/top_level.txt sha256=oPMKGeTR_qbUPPqoD7MMrJIHQe1OJnV2DPHkiEYJRhU 13
airllm-2.11.0.dist-info/RECORD

top_level.txt

airllm
tests