transformer_nuggets

View on PyPIReverse Dependencies (0)

0.0.1 transformer_nuggets-0.0.1-py3-none-any.whl

Wheel Details

Project: transformer_nuggets
Version: 0.0.1
Filename: transformer_nuggets-0.0.1-py3-none-any.whl
Download: [link]
Size: 45939
MD5: f2640683443f979bfb0c9126c258cf32
SHA256: 006bfb92808cedcaeda6c1bcb6f83d5faf4cc57fb7e2e851dbb37c62b9f70879
Uploaded: 2024-08-07 21:01:12 +0000

dist-info

METADATA

Metadata-Version: 2.3
Name: transformer_nuggets
Version: 0.0.1
Summary: A place to store reusable transformer components found around the interwebs
Author-Email: Driss Guessous <drisspguessous[at]gmail.com>
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Requires-Python: >=3.9
Requires-Dist: matplotlib
Requires-Dist: rich (==13.7.1)
Requires-Dist: scipy (>=1.9.1)
Requires-Dist: tabulate (>=0.8)
Requires-Dist: torch (>=2.3.1)
Requires-Dist: tqdm (>=4.66)
Requires-Dist: bumpver; extra == "dev"
Requires-Dist: docstring-parser; extra == "dev"
Requires-Dist: jsonargparse; extra == "dev"
Requires-Dist: pip-tools; extra == "dev"
Requires-Dist: pre-commit (==3.6.0); extra == "dev"
Requires-Dist: pytest; extra == "dev"
Requires-Dist: ruff; extra == "dev"
Requires-Dist: triton; extra == "flash"
Requires-Dist: datasets (==2.15.0); extra == "llama"
Requires-Dist: fire (==0.5.0); extra == "llama"
Requires-Dist: float8-experimental; extra == "llama"
Requires-Dist: sentencepiece (==0.1.99); extra == "llama"
Requires-Dist: bitsandbytes; extra == "qlora"
Provides-Extra: dev
Provides-Extra: flash
Provides-Extra: llama
Provides-Extra: qlora
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 1860 characters]

WHEEL

Wheel-Version: 1.0
Generator: hatchling 1.25.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
transformer_nuggets/__init__.py sha256=dYmgQFhUYgGQxe0hgDXja1MSUn5F1CwaR6miP0fi2Fc 63
transformer_nuggets/flash/__init__.py sha256=Eu3ffUajgNuxyAR05aCInCXlY0LxIajSyuXFWJXWEOM 102
transformer_nuggets/flash/flash_attention.py sha256=PdLiX6XfYfxm8jNiG8m9Rj3be8-wIFQgzVhkwC7v3Hs 14132
transformer_nuggets/flash/masks.py sha256=x0uuUlY8sjLrjcRpJq_IxoYQmXzu5G5Dx5-Sxkmx4wY 3547
transformer_nuggets/flex/__init__.py sha256=KdPvnNrkDodrnybbJ4r1f9vRWOCk0ltJJ0Nozq6XJcA 70
transformer_nuggets/flex/utils.py sha256=l4RCbG_0EhermiV83jF1sDMFYIE8nL8moT_PI22EmCc 5289
transformer_nuggets/fp8/__init__.py sha256=ljYonJGD9VK9tu1PaaoGuKvBBAJJ36e2RDV-jCE-90U 49
transformer_nuggets/fp8/scaled_quant.py sha256=AVwaZpBznRWE1ktytOBSVRgmWcK71KrpbPyEP0Q8VLE 6130
transformer_nuggets/llama/README.md sha256=qVsLpmMbiiIdwQDOzp25yRxQHVQ7Q3DVP4jhaOr1YmM 2498
transformer_nuggets/llama/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
transformer_nuggets/llama/finetune.py sha256=KyRnwpAgsBLgYI8ZlE9Geggjf41BFVstOhGA-sRBp8A 15612
transformer_nuggets/llama/model.py sha256=XW-41k4GQfpAiCrtcrgR2v-fCDPsJiRw_H5sTN_za0Y 9345
transformer_nuggets/llama/prepare_data.py sha256=PRNlCMyeQCJBKAhAtGWP52KDafBILGxk1hbDm0G4Saw 2661
transformer_nuggets/llama/tokenizer.py sha256=YN6A3RALwyz24ddqFRMDrM5qbIIJeLrNyIgfHkSAQdQ 2129
transformer_nuggets/llama/train.py sha256=T4FnKbBc5zibedrzsUHtOPwcyFoLre3N4QNpEsliX2A 14541
transformer_nuggets/quant/__init__.py sha256=HQXXDczWen2yMmgKVMCRqcNyN4Cll9GDgfjny1O8yKw 197
transformer_nuggets/quant/dequant_kernel.py sha256=TdQFkDp6dcbSStH9wUgf2kv6TYRZl1wNNIuO-3MCwUI 3517
transformer_nuggets/quant/nf4_tensor.py sha256=xkOymi-WXDJOvZEfFk7iKpvhVR-jVNumA5_B3MGLbvE 18054
transformer_nuggets/quant/qlora.py sha256=E4qU2ieNpU5ky_0c7WAivQoZxY2kJx3OJRYo6M7ipnw 8379
transformer_nuggets/quant/qlora_debug.py sha256=F9J0x6xfPCgEelRYaQQsxk7XoCbjwX5SnWV-tMkOfTs 5600
transformer_nuggets/utils/__init__.py sha256=x1oPsQ7UjdFCda3Fq7rwXZXOWoscNFlZpuBZMYyO8U0 378
transformer_nuggets/utils/benchmark.py sha256=Vyo5oBFKxAeFw19bOegiYtKOQgMGMM4TwIqeqkFf0Kw 8975
transformer_nuggets/utils/shape_trace.py sha256=tPzcShH5bx_ZQHIYwUPMeTjCFquHROXW9eRFojB2xxU 5318
transformer_nuggets/utils/tracing.py sha256=dc7FBjreQdvxxuzfjNg-U_UwZogXvo3R3ISrgJ_De_k 4652
transformer_nuggets-0.0.1.dist-info/METADATA sha256=3DmUsuXMlo508QdZ-kDQXCRRxj9HCVjx3WPDhMQj_S4 3131
transformer_nuggets-0.0.1.dist-info/WHEEL sha256=1yFddiXMmvYK7QYTqtRNtX66WJ0Mz8PYEiEUoOUUxRY 87
transformer_nuggets-0.0.1.dist-info/licenses/LICENSE sha256=zxEbkIPIQLB5X1Fmmc209oHgBh2TxbdupicAi0GVK2I 1501
transformer_nuggets-0.0.1.dist-info/RECORD