liger-kernel

View on PyPIReverse Dependencies (5)

0.5.2 liger_kernel-0.5.2-py3-none-any.whl

Wheel Details

Project: liger-kernel
Version: 0.5.2
Filename: liger_kernel-0.5.2-py3-none-any.whl
Download: [link]
Size: 104184
MD5: 70433d5cc79caf7dbed70e51d23657dd
SHA256: 31a7409ac9db20fc77e7caf8ab146f56d37d4a1d22e3cefd08661560a99d0c46
Uploaded: 2024-12-11 05:58:36 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: liger_kernel
Version: 0.5.2
Summary: Efficient Triton kernels for LLM Training
Project-Url: Homepage, https://github.com/linkedin/Liger-Kernel
License: BSD 2-CLAUSE LICENSE Copyright 2024 LinkedIn Corporation All Rights Reserved. Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met: 1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer. 2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
Requires-Dist: torch (>=2.1.2)
Requires-Dist: triton (>=2.3.1)
Requires-Dist: transformers (~=4.0); extra == "transformers"
Requires-Dist: trl (>=0.11.0); extra == "trl"
Requires-Dist: transformers (>=4.44.2); extra == "dev"
Requires-Dist: matplotlib (>=3.7.2); extra == "dev"
Requires-Dist: flake8 (>=4.0.1.1); extra == "dev"
Requires-Dist: black (>=24.4.2); extra == "dev"
Requires-Dist: isort (>=5.13.2); extra == "dev"
Requires-Dist: pytest (>=7.1.2); extra == "dev"
Requires-Dist: pytest-xdist; extra == "dev"
Requires-Dist: pytest-rerunfailures; extra == "dev"
Requires-Dist: datasets (>=2.19.2); extra == "dev"
Requires-Dist: torchvision (>=0.16.2); extra == "dev"
Requires-Dist: seaborn; extra == "dev"
Requires-Dist: torch (>=2.6.0.dev); extra == "amd"
Requires-Dist: setuptools-scm (>=8); extra == "amd"
Requires-Dist: torchvision (>=0.20.0.dev); extra == "amd"
Requires-Dist: triton (>=3.0.0); extra == "amd"
Provides-Extra: transformers
Provides-Extra: trl
Provides-Extra: dev
Provides-Extra: amd
Description-Content-Type: text/markdown
License-File: LICENSE
License-File: NOTICE
[Description omitted; length: 17962 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.6.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
liger_kernel/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
liger_kernel/env_report.py sha256=FViyPju795lB6z4k2TZldvBSmQdcS0A2hcnDxepJrDo 1822
liger_kernel/utils.py sha256=HJa-xVKOohDn6pLVIx-Fv0V9h0QAL3qZGQNRICI-OpI 249
liger_kernel/chunked_loss/__init__.py sha256=R2wCcz4Y0kTAve926DH3k182XKezpXeACMHj05g9Mm8 346
liger_kernel/chunked_loss/cpo_loss.py sha256=Qu1Ul2A12sp6CqIT-atPbHWFb_LLtINEA9mOpIRx_0g 3097
liger_kernel/chunked_loss/dpo_loss.py sha256=H9_RRhclckHYM2sd75tgbnf8IxC_PU2JCALbgtPQvwc 4222
liger_kernel/chunked_loss/functional.py sha256=9Gr-YXIuEzEJkBUhDx3G2fuQayckLor7cC7svhmPML4 549
liger_kernel/chunked_loss/fused_linear_distillation.py sha256=2BH6DCPjsR2zS6zcwFPcIIZRhLF8SohjGdKsAJ_301o 10222
liger_kernel/chunked_loss/fused_linear_preference.py sha256=vlWfaaIECWvCQhY9PM7zRI0vKThIrydMf6P44bXn1EE 15114
liger_kernel/chunked_loss/orpo_loss.py sha256=ZuKGjbkIYzV4UzvupNdq6vyxCp7-BztQkUt8ZnFvKos 3531
liger_kernel/chunked_loss/simpo_loss.py sha256=Wa4LOlDG9PbJkOOkKg8hbKvnKgg7OTBz6-qIkwPK1yw 3275
liger_kernel/ops/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
liger_kernel/ops/cross_entropy.py sha256=oG5hfrlmnlF5lOoZRhHRglObxgH4B0KadjWMJj9EWPM 15860
liger_kernel/ops/fused_linear_cross_entropy.py sha256=Tnw4gyAYVVdnCOqhOuLEzbUQ3goOTnoAfk3pqSIM5ac 9301
liger_kernel/ops/fused_linear_jsd.py sha256=nOv4zwfxHqqepKEmMsQuz-B3H-gRjyo8uClpmqSGLYA 9693
liger_kernel/ops/geglu.py sha256=MQL4zyzneZqZYUGPvb1QjI_EYT9_pKfSDgR25WD9jrI 4127
liger_kernel/ops/group_norm.py sha256=VaRErVJGR4JqgXXvuIjNGTn3E2egjLtU1y3ymwIf4d8 10961
liger_kernel/ops/jsd.py sha256=Ap2b0_geCl6fqBXLI1IS6Yn6GlO-8LgPmnOW3y47dus 6151
liger_kernel/ops/kl_div.py sha256=03FNXfvCb6M-56hhFepAFV9p6brArPR6KOKkdGD34mw 8374
liger_kernel/ops/layer_norm.py sha256=_CZggw3GNEIUx5weDzadFit5I-Lzosoo8prgeJzcViY 7589
liger_kernel/ops/qwen2vl_mrope.py sha256=GvP4Cg-2ClYyiqbe7bB_OMvnlZooBmqP2-9V8RMPde4 8598
liger_kernel/ops/rms_norm.py sha256=g7OXwuYI8-LXudDwvXuiupVjjOsbu8c4wwv83VaHa54 11750
liger_kernel/ops/rope.py sha256=jrzaA9-6Orn44y_IIam9_YNPQxOFK2FrIRNfFea4EtU 8513
liger_kernel/ops/swiglu.py sha256=Fwxtd76rhHKT9ShQAGca9RsnASplAVxtYKHmiT73_yA 2994
liger_kernel/ops/utils.py sha256=_VQvd1PX5JXm5xaiBrk2gANp3qr4kM7qYG3ypkBwkMs 3850
liger_kernel/ops/experimental/embedding.py sha256=LYR66dB-jhvhtUjeV4PnNro-n77J1mdlmpSLSxB3Y6U 4186
liger_kernel/ops/experimental/mm_int8int2.py sha256=JpGVZCgRC6T8XMUJ_QbZRS2XU1bh0urIZphs5DTc1mY 13358
liger_kernel/transformers/__init__.py sha256=gia-eBxr7TLxU0GdDf8AfCY4WgDlFLqIGSt7EoQGsBA 1336
liger_kernel/transformers/auto_model.py sha256=RMIwQHSiXoksXFTIqFZ4PLBgoqkxJJAT3q1Qh47bGN8 1552
liger_kernel/transformers/cross_entropy.py sha256=yEm_YQ7oa3_BzT3hdW6KrAslduhSqWcJQVNZZDcWCg4 1758
liger_kernel/transformers/functional.py sha256=sUBoU8Vb4pLpr9G6IdkRsToYgh-rCXL4OLYat7Tv_GU 4450
liger_kernel/transformers/fused_linear_cross_entropy.py sha256=_i0PXSp5iZ9pKXdEeZ4lvHCENJYjV4y74yz3ZRG5XQg 1484
liger_kernel/transformers/fused_linear_jsd.py sha256=bZ4otCvWBuOnA5XdQL-FzZVItJlDt-ht9e_pG7PG93E 3999
liger_kernel/transformers/geglu.py sha256=QcrME_8ooIn0xa59LaC0aoOdRrBIFd11Y0bAyF0NfCw 1130
liger_kernel/transformers/group_norm.py sha256=FJ9R7mS9G1wO-GRIQ6QKSmIhnZ6nQ6GIkE4NnX_hnn0 2241
liger_kernel/transformers/jsd.py sha256=sbr8DnKSYZJH9pv2rpmboNijYGpZKbhb2-WSGp5_v6g 3001
liger_kernel/transformers/kl_div.py sha256=qVhjBg6tjRyue5iZ3NFxo8uySY4JuIFJyv0IM_50F24 431
liger_kernel/transformers/layer_norm.py sha256=fd6o4kSHJWolQMWxh-l1qObfgL08ruNbUoBiANKX1ow 972
liger_kernel/transformers/monkey_patch.py sha256=Fk2v4GZQDJzfh3Cpc6BHNJbs_tungDyWmqS9nuG9Lc4 38406
liger_kernel/transformers/qwen2vl_mrope.py sha256=5EwSqrMdsL9MYspeBMXBsNJKvH0MOmRrtJXAJlnnlOI 1047
liger_kernel/transformers/rms_norm.py sha256=AHstklNIO1PLHjjCBU-TPuUD-Fl_pycJUTLlJNojbV8 1189
liger_kernel/transformers/rope.py sha256=m-ah8vZBYW8tfplTXCiAPMHJWlB1tdp_JPXJeWE-Boo 943
liger_kernel/transformers/swiglu.py sha256=0-tVJ8xEYfhxnduc16PflXFj8sZPxdx9sHUn3hfwCI4 2468
liger_kernel/transformers/trainer_integration.py sha256=W3ON51O5GkyzNJsItz0y5rKx-uy2f2cFfveZpqbUdhw 123
liger_kernel/transformers/experimental/embedding.py sha256=HpckiAMKM8-SRxKDcGTqortVxnjhwpZsfsp9lfjqfeM 895
liger_kernel/transformers/model/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
liger_kernel/transformers/model/gemma.py sha256=R4huxuR48gkLrdT8KqV7As2v9dZtEmcGVz6YG1ZmuJE 9692
liger_kernel/transformers/model/gemma2.py sha256=zxQsxCRqkoxCES3GJPVI7soUuF3J5HZDlvJgaBos1zM 10836
liger_kernel/transformers/model/llama.py sha256=RinsgC_eR-YNvZd2SHPQxZ4eyR3uViaTFCM3SvI5nks 10426
liger_kernel/transformers/model/mistral.py sha256=XpL1rlWg_llvW3z_Hf_d8WQs7uQaH4ds7EZ2SxjQHsU 5144
liger_kernel/transformers/model/mixtral.py sha256=nyDS1dBpsOXYC2DuW59Hgu7ZrGftrHuWPfNqjcNPIxs 11503
liger_kernel/transformers/model/mllama.py sha256=mesNCgj0Ea1O-fqRD4LVxDJ1CR2abY_zAzK_bfVzkiU 11222
liger_kernel/transformers/model/phi3.py sha256=xUZPlaPKwknLjHc3uUW3EPodm1h0vD3G7Qnhh51v-Io 10332
liger_kernel/transformers/model/qwen2.py sha256=EyhSSzQOskGjSnCsKMZpd1s5IAIlHd5PBO3q0MoCs00 9619
liger_kernel/transformers/model/qwen2_vl.py sha256=bIQe2bWiY--G84FhCD29Gdi64_qHP6vbcGsK6vKysQE 8547
liger_kernel/transformers/trainer/__init__.py sha256=c4OQVJmhNOloj0JYSEc0j_cQuBbzGWILfaowUR1hmRw 210
liger_kernel/transformers/trainer/orpo_trainer.py sha256=jko6oq_XQdBSmXubp05E-_YXOyhtB5Bj75dg5YNwOsE 7517
liger_kernel/triton/__init__.py sha256=yfRe0zMb47QnqjecZWG7LnanfCTzeku7SgWRAwNVmzU 101
liger_kernel/triton/monkey_patch.py sha256=5BcGKTtdqeYchypBIBopGIWPx1-cFALz7sOKoEsqXJ0 1584
liger_kernel-0.5.2.dist-info/LICENSE sha256=OhzLDHJ0to4a8sodVLELZiCFylZ1NAAYLs-HrjPy0ag 1312
liger_kernel-0.5.2.dist-info/METADATA sha256=olSIT-Jd2Mowu2ja4QLwyPYBhCnY22znBq9pV7stkKI 20695
liger_kernel-0.5.2.dist-info/NOTICE sha256=njwnoPZLh9AN8SJQzxvCGLHi-8X__AvWRze6joNXIY8 2066
liger_kernel-0.5.2.dist-info/WHEEL sha256=PZUExdf71Ui_so67QXpySuHtCi3-J3wvF4ORK6k_S8U 91
liger_kernel-0.5.2.dist-info/top_level.txt sha256=2eghu4hA3LnkM7ElW92tQ8zegWKgSbeo-k-aGe1YnvY 13
liger_kernel-0.5.2.dist-info/RECORD

top_level.txt

liger_kernel