mergekit

View on PyPIReverse Dependencies (1)

0.0.5.1 mergekit-0.0.5.1-py3-none-any.whl

Wheel Details

Project: mergekit
Version: 0.0.5.1
Filename: mergekit-0.0.5.1-py3-none-any.whl
Download: [link]
Size: 150829
MD5: c9dcb109636e5834bb88f2c2ff45c9b8
SHA256: dbea39b542fc5f1da49bfb34fa7ea80814a98f9fcc89634a161b98a974588550
Uploaded: 2024-10-30 19:42:59 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: mergekit
Version: 0.0.5.1
Summary: Tools for merging pre-trained large language models
Author-Email: Charles Goddard <chargoddard[at]gmail.com>
Project-Url: repository, https://github.com/cg123/mergekit
License: LGPL-3.0-or-later
Requires-Dist: torch (>=2.0.0)
Requires-Dist: tqdm (==4.66.5)
Requires-Dist: click (==8.1.7)
Requires-Dist: safetensors (~=0.4.3)
Requires-Dist: accelerate (~=1.0.1)
Requires-Dist: pydantic (~=2.9.2)
Requires-Dist: immutables (==0.20)
Requires-Dist: transformers (>=4.45.2)
Requires-Dist: tokenizers (>=0.20.1)
Requires-Dist: huggingface-hub
Requires-Dist: peft
Requires-Dist: typing-extensions
Requires-Dist: sentencepiece
Requires-Dist: protobuf
Requires-Dist: scipy
Requires-Dist: datasets
Requires-Dist: black (~=24.10.0); extra == "dev"
Requires-Dist: isort (~=5.13.2); extra == "dev"
Requires-Dist: pre-commit (~=4.0.1); extra == "dev"
Requires-Dist: ray; extra == "evolve"
Requires-Dist: cma; extra == "evolve"
Requires-Dist: lm-eval; extra == "evolve"
Requires-Dist: wandb; extra == "evolve"
Requires-Dist: pytest (~=8.3.3); extra == "test"
Requires-Dist: vllm (==0.3.2); extra == "vllm"
Requires-Dist: lm-eval[vllm]; extra == "vllm"
Provides-Extra: dev
Provides-Extra: evolve
Provides-Extra: test
Provides-Extra: vllm
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 14361 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.3.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
mergekit/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
mergekit/architecture.py sha256=t6VNmrTQFRCeu66jpiHflZwAP7YZpTPs1AwT6c2xN1k 12919
mergekit/card.py sha256=dLz8XJEI3JNulBr6bc13xnYTayBQezVbEPEDLJ7JWuE 7118
mergekit/common.py sha256=AKUaAwtRj_Q88H_ezp7VpMaH5H_3krD5viHSsJ6Gkag 9087
mergekit/config.py sha256=4on6ePYl1I5iruof80ABWnGUE4uAoUxkvJICLjTZ_i8 7457
mergekit/graph.py sha256=Ftp2NiNwzALGxR248S2yO6F_voqMxrP2oFU0WyVtnRU 9536
mergekit/merge.py sha256=y2wxCmJk00c-xmGujtOXiVa4_cNWjrDqTsKPjCluJWc 9265
mergekit/options.py sha256=1dmkTGFaEzrKXCvzxmAbK_-l_jq65KH9boh21S39URk 4055
mergekit/plan.py sha256=LtjKnvJHN1VnSopjLVFW9LiZePzIJm_KTep1mtUKqqI 11472
mergekit/sparsify.py sha256=POdWgurNL0FuZVrSPRnjrVxjB3_xjvlsEV-7_Hu4he4 6043
mergekit/_data/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
mergekit/_data/architectures/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
mergekit/_data/architectures/baichuan.json sha256=ogxpyN1hXQx21JEp0FKJnZ8q5Sl2SGH9reC3XuWxxBc 1253
mergekit/_data/architectures/bert-masked-lm.json sha256=R9EEA64y3YGfRmaTrKrfNXK_rS_c6DqC9Ef682G_LzY 3770
mergekit/_data/architectures/bert-sequence-classification.json sha256=z7DC1997zr3BIUx5x53SgYow8unLhy1g18Qs7U7T92Q 3770
mergekit/_data/architectures/bert.json sha256=Vtgc8ybPFysZK0BnDdIODldq6_CE3V3HPwSOIjNobEI 6386
mergekit/_data/architectures/chatglm.json sha256=r7egoBGwDI3NhhFzodSABmNNtz7rUojB7W3yD8LaQqo 1526
mergekit/_data/architectures/cohere.json sha256=agQX_Do2eITiGsJbArQvu0b3HNIr9lV6jZ1MWvO1Vwo 1378
mergekit/_data/architectures/distilbert-masked-lm.json sha256=7_Lw44diWt60oNd77nwEBZk4xMlLbv80l6GxHPYA_zc 3264
mergekit/_data/architectures/distilbert-sequence-classification.json sha256=sUv_78OzKFSrrsO2LA1oZa4O3AXHJLfLONhW5dCNeR4 3001
mergekit/_data/architectures/distilbert-token-classification.json sha256=IuMHyl3F24ftaNZV1SZERQAYi3Zr4xCsN1IQUHgnXiQ 2870
mergekit/_data/architectures/distilbert.json sha256=6A-qSc0Bzpa2VsH3km4nMr-oqYz1st9lOh67hb5EMUM 2729
mergekit/_data/architectures/exaone.json sha256=3jXy1i0DeKJV63nhMdokcpRofZsUxytRDSli9kkyJ7U 2670
mergekit/_data/architectures/falcon.json sha256=K2Zp6qs8-DLgpLA6CHS7Y4kc9Cgmek2FQzkSXafkTuI 1426
mergekit/_data/architectures/gemma.json sha256=lr_A1yimdszjLljCxPaqQLbHP4F1uXmRN-qYi4sWI8M 2853
mergekit/_data/architectures/gemma2.json sha256=0IxTt9ZvSPLyipiPq0XjugPxO4FYWzKlh2zV4f_Bpe4 1726
mergekit/_data/architectures/gpt-neox.json sha256=-f4wFCzHh3xCwLYdoMiw787K2cXCIxXlJJSZv_A5QDw 2264
mergekit/_data/architectures/gpt2-sequence-classification.json sha256=EWiRnGQEM_xsurYcsHobifUbSOdyJWYBYU3IINZwk7s 1764
mergekit/_data/architectures/gpt2.json sha256=7GmeHH8T3ht9JcdLbVqug36pOzImRReT3cJs3wAkRAo 1532
mergekit/_data/architectures/gptbigcode.json sha256=xsftfOKDu_W6g2P32e-vrcM7owcTqVJXW6NI-n-tptc 1876
mergekit/_data/architectures/internlm2.json sha256=cNIlmb06fDU7riSaLxdd6exur1ivjRp4JhoA1wouy2E 1327
mergekit/_data/architectures/jais.json sha256=_L0cncNEduh8Io8cMQzpEKGw_lUAw_tMZ_1nuU9y2b0 1932
mergekit/_data/architectures/llama.json sha256=N8nE3mFRceBO23_2jvpZYESs_RLEoY4eHXqaA6CPHRs 2730
mergekit/_data/architectures/mamba.json sha256=ARKO5b0R1XV4EolZUyiUizZpwLIMvMTEmqMWz0Kj05k 1596
mergekit/_data/architectures/mistral.json sha256=CL8HoRHrhciJNdkvAyKuIAfXrc75PuTMeIVWxa3N8zE 2991
mergekit/_data/architectures/phi-1.json sha256=PHpdaDIszrgk3Ry_N7GMHpCE5ooCdXooicPzunBEybM 1749
mergekit/_data/architectures/phi2-old.json sha256=QXQB0VaeJVJSlBiW8IbDbBHNlpJMS70yn_4YHnGI0kk 1614
mergekit/_data/architectures/phi2.json sha256=zfj_9_aHW3A7JsxeEM4PuzLunku_vf46ksofNubonEY 2079
mergekit/_data/architectures/phi3-small.json sha256=FYYw7r6RXwmXvOtUzYqz5ufUrafy_21_e-g9XAsSG4Y 1960
mergekit/_data/architectures/phi3.json sha256=6gqJe1r0eflNxL-4ehyfK-eImb0np_3ahGnx7xWAAcI 1148
mergekit/_data/architectures/qwen.json sha256=qKNtEP7Rf-zzxLbb5xskZYIY4QqpTpF_z8QlQyu5KBY 1300
mergekit/_data/architectures/qwen2.json sha256=3jVilGLiC_A-4t_Lc6LmY8rZWao4_bRw9JyRVP_xhEY 1860
mergekit/_data/architectures/roberta-masked-lm.json sha256=Kc26GJbO9_yBsLZKTwU9nqlrECZi1U85s0BVQOJvvYI 3192
mergekit/_data/architectures/roberta-sequence-classification.json sha256=b22JbfTtCBvAN9M75S8HWuQqlwrjGztAYF7iLSmom14 2992
mergekit/_data/architectures/roberta-token-classification.json sha256=syynr_GhC6FyUe8ga4Ho7YDv6RcU2Lsi9j34yuLOYFs 2839
mergekit/_data/architectures/roberta.json sha256=GqLO456KIOXpkBLjdbR_sMwED7EZW2ZgrNCMlWk_tCQ 2826
mergekit/_data/architectures/solar.json sha256=rooBA9Wi5ZeblsoOvQtIfZGHKFLTUhM665pHM0qdpps 2271
mergekit/_data/architectures/stablelm.json sha256=Mhnceh3Ehya86RrXWdcPj6X9yO4DKvP_QqSZSmhwedo 3325
mergekit/_data/architectures/stablelm2.json sha256=PV-Zu4-_q6i6P6PTk9dj3-kZNUBbzdcEhKU01O2ZvQs 2160
mergekit/_data/architectures/starcoder2.json sha256=W6q0EVzdfB4saVCcttdzB5VWpuQwIo0ySSWJRhvW-vQ 2307
mergekit/_data/chat_templates/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
mergekit/_data/chat_templates/alpaca.jinja sha256=lZN7m88is3Wca-fKjZLYF-jAksUJv8tjY8nKv8CaQkU 668
mergekit/_data/chat_templates/chatml.jinja sha256=mQAABOtZNuEuLLm6ZEm30ZQVW2Q56GhvZYsVzHGTiws 201
mergekit/_data/chat_templates/exaone.jinja sha256=rdc9B1DXog-KkQD2DkqMfm5y_QJROBa8mSpw2jnL83M 408
mergekit/_data/chat_templates/llama3.jinja sha256=nRKYUYKrD82hL9AJsqf40wqRwASFfEctVjbzzq2C3lY 400
mergekit/_data/chat_templates/mistral.jinja sha256=eWhTFyI1qzqqSBABPd_i6rSBvaMwba1PcAwA1Dbu1ZY 1058
mergekit/evo/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
mergekit/evo/actors.py sha256=IsIDta6wTkUK29TrrrHJ3cnrNG6O55MEY1672UUrD-g 11453
mergekit/evo/config.py sha256=d_ykY4E77IS3JY7zb-oQEr-fCMzTjAQ4854TSusI8SY 3182
mergekit/evo/genome.py sha256=LSYXxRuOG4EiOfCBduzB-OAEE_Lf7NFt1OTt0juZ-Go 14435
mergekit/evo/helpers.py sha256=xUnWU7TqyGv-A_0Dc0OPmlQbVdrXrRYzd798-Q897Ic 3745
mergekit/evo/monkeypatch.py sha256=oKWWDoevd-UWllid8iDyHFBoXjCq-6L0W42cw6j_vOs 4106
mergekit/evo/strategy.py sha256=QIFboI4XUxoMKrNwbloEV4JEbobkB-wk4AIXeVxDG0s 10238
mergekit/io/__init__.py sha256=vUWE0EetYt7tTMi9UbWxGHBUPb9Oj3v67--7wDsPM14 957
mergekit/io/lazy_tensor_loader.py sha256=wEMMWsvxxUXMpORZElgmcYoz4rCs7OgkpVs5ic3FEg0 5038
mergekit/io/lazy_unpickle.py sha256=MNAAHQj341e0TNIeBcI6NaioQwYMWNKK8n7Ol8GdUiQ 6415
mergekit/io/loader.py sha256=V8vPvfre2SLjOcdQdWR-MCCp-9hsdKKz0qDOxt4z3i4 2868
mergekit/io/tasks.py sha256=4CsOAmR5I6Av3kq4cAqCdM3sRriEroarIVvzcQGFIQs 7163
mergekit/io/tensor_writer.py sha256=vr4LDrZXJXLTXFjxAQBwNI1OXN8yKseK0sGgr6A5TWI 5054
mergekit/merge_methods/__init__.py sha256=qcv47IC294GJF6jj9AeUjZaHiAqRpS94RhaoOcm4Kfw 3914
mergekit/merge_methods/base.py sha256=nOmYeUFFfc8gYLpUdxviBqeeNW9XEjh8yoEl3zjeDAI 1772
mergekit/merge_methods/generalized_task_arithmetic.py sha256=zpJCdk_eKT5qagg34ZFwoPh-CxGi2frY3cQ6MQhmsDs 8235
mergekit/merge_methods/linear.py sha256=kfsIVuANhi-q4XYXOzEqKbQhhmYVFyaTRXBdXCW4Kuw 3246
mergekit/merge_methods/model_stock.py sha256=Z-ixjIJEsCZDn9vqMAEqI0CsJ00M4blxHP7gtqaeI2M 4810
mergekit/merge_methods/passthrough.py sha256=HqwRIEa3UaP3O7easah_cjbdk4IVK18SwqZQxC9yGoc 2204
mergekit/merge_methods/rectify_embed.py sha256=kxqe7UAK4c3GsGoRa02QipDVmMWDBmZON1lSnPpBY3c 1799
mergekit/merge_methods/slerp.py sha256=NKr24yNB6TWpTvJc_GTkFUiAOogmQ_0exO5lPWETUmk 5140
mergekit/merge_methods/tokenizer_permute.py sha256=qS0i9ap2XafA8RW8y6BHTWTY-iZOUWZpbSsrrle86SY 5053
mergekit/moe/__init__.py sha256=3VRywq16WScEX1C7Hip5G9_2pyTvR2npkuDrxvVfy8A 460
mergekit/moe/arch.py sha256=Zst2__FhjR5UsbOQZjkjx9u7PGiUKxu3RVFwG-hFQhI 1744
mergekit/moe/common.py sha256=p2XkkZVHl7Mr_XNXaj5wWlu2rUtP5_mYW8bGOWTVso8 2596
mergekit/moe/config.py sha256=K34YrgaIytq19YN00iarRkgkgs7zRPuLuQFem8hk4is 3646
mergekit/moe/deepseek.py sha256=rQRYIQl3PFsHkAi6DZHHKSX00FZAtncf7XImjpW-wAI 7627
mergekit/moe/mixtral.py sha256=7CvV8J9pE3U9nWsL40jL3AxABxOXAl7rLMXB6_jee6o 6862
mergekit/moe/qwen.py sha256=QD6OAjPKKqU9PxTEwyKhqY_GIHuDfOgsixhll7grQVA 8024
mergekit/moe/router.py sha256=IDCzfcitPakJ8XLVfupmWW0R3eVegYTwh9Bbl_TM_eg 6357
mergekit/scripts/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
mergekit/scripts/bakllama.py sha256=c6DlevzKOqeB0xuaYDz-CWK1lBnMIycVWTdMNA9Fpa0 2571
mergekit/scripts/demixtral_svd.py sha256=L3H7UqQ87O6-iAvXSeAjugyerK31vCn65pYdm-Ko1Ac 2955
mergekit/scripts/evolve.py sha256=QLbWS6vlIeI08Thl03erFwmxVQtUSbn3iZQZOqRbD2Y 12890
mergekit/scripts/extract_lora.py sha256=4O3vQs7lFxh1Th7Ycg2tCYEQZ6JhzkS7i7z6A6WrtsU 21320
mergekit/scripts/layershuffle.py sha256=4Zm9aQcEnDzuxvxJUIBSskfm8KHKr49MIcxOVoveWCs 4465
mergekit/scripts/legacy.py sha256=bDc-W7c0AYTn_MyfAzgwyTE2faRE5Mcl2iSS-Rthpcc 4077
mergekit/scripts/megamerge.py sha256=Mrx_E71b-ROxmup3pnFbyVupbOOYX9_buedzsSNJ36w 5556
mergekit/scripts/moe.py sha256=R2LSJRETgDPdiqaJ6jk4-MqDtwVK3NDAma3zfIIpatg 7396
mergekit/scripts/run_yaml.py sha256=nvmg2FLhTrKewyIfNaYxykj_2CpVHKpx1-gpCg9kIvI 1664
mergekit/scripts/selfalign_weights.py sha256=85pd6jqnUd2LMtpPMai3vrWFFZQevdu0ABa8Ijd3Z4o 17004
mergekit/scripts/tokensurgeon.py sha256=PWdZAbXIqq26uyCQp9AHIcFHM6tpMJZ-X1x79WHdFXk 20702
mergekit/tokenizer/__init__.py sha256=9NoiQbPp9hnMdvkZFQQxEa7cCaYwE68642Xvp71xEAU 961
mergekit/tokenizer/build.py sha256=7_cyy3vvxSW_olI0zSAgiLHwIt0OfdZ7mlwmq1chtFY 9897
mergekit/tokenizer/config.py sha256=bf9PM5NqemPw_DTP-RnBsqLzPB4jOx-ZaK1dim5OF2Y 1833
mergekit/tokenizer/embed.py sha256=coc5vksB-4vhMn0LVrhOm8kNYe58J9xSktkG5S1DLOI 6974
mergekit-0.0.5.1.dist-info/LICENSE sha256=46mU2C5kSwOnkqkw9XQAJlhBL2JAf1_uCD8lVcXyMRg 7652
mergekit-0.0.5.1.dist-info/METADATA sha256=rVGhyKmghK1lRQv0KR7IEmTnbQPZdEf8alRSsM6XF7k 15751
mergekit-0.0.5.1.dist-info/WHEEL sha256=P9jw-gEje8ByB7_hXoICnHtVCrEwMQh-630tKvQWehc 91
mergekit-0.0.5.1.dist-info/entry_points.txt sha256=Hb_hztmj5FTnJE3rLTZ96_MFaHkw8fGbI-Ehv7P44u4 467
mergekit-0.0.5.1.dist-info/top_level.txt sha256=2vRk9HCVcaKiv0lzzUxnMmvzCPS48OsFCnCCl2C44Tg 9
mergekit-0.0.5.1.dist-info/RECORD

top_level.txt

mergekit

entry_points.txt

bakllama = mergekit.scripts.bakllama:main
mergekit-evolve = mergekit.scripts.evolve:main
mergekit-extract-lora = mergekit.scripts.extract_lora:main
mergekit-layershuffle = mergekit.scripts.layershuffle:main
mergekit-legacy = mergekit.scripts.legacy:main
mergekit-mega = mergekit.scripts.megamerge:main
mergekit-moe = mergekit.scripts.moe:main
mergekit-tokensurgeon = mergekit.scripts.tokensurgeon:main
mergekit-yaml = mergekit.scripts.run_yaml:main