levanter

View on PyPIReverse Dependencies (0)

1.1 levanter-1.1-py3-none-any.whl

Wheel Details

Project: levanter
Version: 1.1
Filename: levanter-1.1-py3-none-any.whl
Download: [link]
Size: 157251
MD5: ee725ef385e354b8c352e0b6e8500ea6
SHA256: 7a24b719a3dbc428743fc2f80df5334d36d1d02f7359e523f4664c2eddcabf76
Uploaded: 2023-10-24 18:23:51 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: levanter
Version: 1.1
Summary: Scalable Training for Foundation Models with Named Tensors and JAX
Author-Email: David Hall <dlwh[at]cs.stanford.edu>, Ivan Zhou <ivanz[at]stanford.edu>
Project-Url: Homepage, https://github.com/stanford-crfm/levanter
Project-Url: Bug Tracker, https://github.com/stanford-crfm/levanter/issues
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: MacOS :: MacOS X
Classifier: Operating System :: POSIX :: Linux
Classifier: Programming Language :: Python :: 3
Requires-Python: >=3.10
Requires-Dist: braceexpand (>=0.1.7)
Requires-Dist: dataclasses-json
Requires-Dist: datasets (==2.11.0)
Requires-Dist: draccus (>=0.6)
Requires-Dist: equinox (>=0.10.7)
Requires-Dist: fsspec (==2023.3.0)
Requires-Dist: gcsfs (==2023.3.0)
Requires-Dist: haliax (<2.0,>=1.2)
Requires-Dist: humanfriendly (==10.0)
Requires-Dist: jaxtyping (>=0.2.20)
Requires-Dist: jmp (>=0.0.3)
Requires-Dist: matplotlib (>=3.7.0)
Requires-Dist: optax
Requires-Dist: pyarrow (>=11.0.0)
Requires-Dist: pydantic (<2)
Requires-Dist: pytimeparse (>=1.1.8)
Requires-Dist: ray[default]
Requires-Dist: requests
Requires-Dist: rich (>=13)
Requires-Dist: safetensors[numpy]
Requires-Dist: tblib (<2.0.0,>=1.7.0)
Requires-Dist: tensorstore (>=0.1.36)
Requires-Dist: transformers (>=4.22.0)
Requires-Dist: wandb
Requires-Dist: zstandard (>=0.20.0)
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 9167 characters]

WHEEL

Wheel-Version: 1.0
Generator: hatchling 1.18.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
levanter/__init__.py sha256=U1cmNinzYruoNDk_ps2tnnXqnL2lR5n_aGjND4Wqjpw 228
levanter/callbacks.py sha256=lySgLNM0-vRNuinV6GzcetxCulApHUBBdsRkZdFqC0o 8582
levanter/checkpoint.py sha256=er8GHK5FQx6pT1PPbmuOGo89cdsYBLGsSVps9zpHBIU 18243
levanter/config.py sha256=lSSnFteGNqnMkcBXW1Lr8k8oFB3ivRr4v9pkjfNa_EQ 4233
levanter/distributed.py sha256=u6tD4bMSfroulYutmk3LuFKj-Y3LkfLEsK_ZU0WemAA 11425
levanter/grad_accum.py sha256=RpArTpoPB6NBHHe3E49AzNiyN6EtvmdiEdQJNuNlIEE 5482
levanter/logging.py sha256=A58GfBGeP_pcpfdJkMaHud24XO_SMBp82NCYS-xSjvc 11301
levanter/lora.py sha256=lNT2zro9xL8bfofj3UZBQUdRjju-tu5Z6jUKgeSZkGM 19970
levanter/mesh.py sha256=Gf1AlSUaomMP7r9Oo6on_E4VH46zyn8XJimdIVV4e1M 1981
levanter/shapes.py sha256=D1K6VvdlNTtynFCU0WJgnbg_GbhNQpwVfgOUZ1yw4pU 2015
levanter/tensorstore_serialization.py sha256=HrNuMpU_1aVjaRz_qtVQkQqemMUFeGUp6KTOSrbLKLo 6561
levanter/trainer.py sha256=i6PXorlYe8nRsTFl0GIpeOcrWkIE1ubtT0rG_YS3GJA 30165
levanter/types.py sha256=FZOA5bdB4THxHuQTBYqtks3H-p81UxnqdPfBK2E9M-Y 709
levanter/visualization.py sha256=DbdkE0HSXueTmBML65rQMDPzsmmXoDdGO--Ew1ztyu4 3375
levanter/compat/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
levanter/compat/hf_checkpoints.py sha256=JVhfN6aaFUQUMxuW5-ff8xu5fcCZPDr9ZYaye8GSKDg 33696
levanter/compat/torch_serialization.py sha256=1HldhxmsIFUZnaSwQ3dD4KTTDjdx_6tt1L_PkXlgIrE 17594
levanter/config/backpack.yaml sha256=eJ8zk9h86ilqIeQWNOhMox5TPaTSoz6X6rDQGd5T5NE 512
levanter/config/backpack_nano.yaml sha256=0PweT8X7VAsb0LMCVabhLCo-AVIlOLYIQxLJaHpfGE0 416
levanter/config/gpt2_1536.yaml sha256=asH1PzL3d4-1K1US5Ot1-3BLbv7WyFqEV5ZOuclka9Y 459
levanter/config/gpt2_1536_legal.yaml sha256=vAlFtwf7kCCfwga_6KZZKRJh3_pmNOWoSANO_05IeyU 674
levanter/config/gpt2_20b.yaml sha256=Y04CWUkEVj_kDbduDPb1YVwJdUOICaCFTdsqyQdfO_w 725
levanter/config/gpt2_7b.yaml sha256=BKsYA6Lkqv8JEO6RZrVtkHZ2mkRlSwhemifFGh2rOCs 579
levanter/config/gpt2_large.yaml sha256=FidRrhJ9tZrwOvD-KV_c8y7MDXks-HhJAXxiDFCIR1Y 407
levanter/config/gpt2_medium.yaml sha256=xHU8Uy0keQlg783IGFw9jomijidodPI2lfBL5_RN7to 427
levanter/config/gpt2_micro.yaml sha256=bhifGSZOHo74L_pJLpmDzSOYnxbem4r8W16d2hHDFxQ 319
levanter/config/gpt2_nano.yaml sha256=1PpY41fzAPoxY2jK-SM6wHUBIvGbz3vk_TnWTbKlmyE 389
levanter/config/gpt2_small.yaml sha256=2NsV_RarmvkBf7Z4M0pKLE9TkIpxJ_MHKyuttk5Qjoo 450
levanter/config/gpt2_small_fast.yaml sha256=lB4eegVASPDZ-lIaT6nm2Gv05MSyqWAoo0AwQ84zkTw 479
levanter/config/gpt2_small_fast_pile.yaml sha256=aIYJbYDNfbTHL5iQ8JGVfq7Pp61YW2t588GAhB4WxpY 454
levanter/config/gpt2_small_local.yaml sha256=PeroGUywPd2-QPJMJS2_0BWO-GhSD8oWGVDd3mUwhfg 460
levanter/config/gpt2_xl.yaml sha256=C1zZcvEBgGXu_7rGNdrMNTwU5y8TGZpvuMwRnfkc1HU 404
levanter/config/lakh_medium.yaml sha256=hjw5i5wxuwGW-mH-zwNcqUD1xW5ygSX6YbFkwOcPE6s 654
levanter/config/llama2_7b.yaml sha256=KNTI0hkzwAtOK8fRk0h8ho5wNEhmTu1cM7dBw6vjNlQ 861
levanter/config/llama2_7b_continued.yaml sha256=o5JBr_WfsBW8OFc5KXUTIQKBr0vPdzMitYN7DupH37c 444
levanter/config/llama2_nano.yaml sha256=IUlvUlXVljbQ5_4S_1eyZn8FN8sOg9-bvdDaTy7erS0 626
levanter/config/mpt_7b_continued.yaml sha256=cAUknazrGEQcMzdner51xdid0c4pRIeXzMzelAUxVhE 414
levanter/config/mpt_7b_continued_biomedlm.yaml sha256=bYBJtnrEDzm8_SX7EuEv0weOONZEqlLU-v2g63Ow4Ns 727
levanter/config/data/openwebtext_source.yaml sha256=gI-1HFMW6cNUX485XntkaqMCqJbXMJk7X4pdL-8EYo0 272
levanter/config/data/pile_source_old.yaml sha256=qd8xW7jW9ZNoxG1AOtHL98F5sSp-Cz4w-2K5K3aLFls 225
levanter/config/data/pubmed_source.yaml sha256=O-YXlN2MAdd5FTDM0srf9erXIry4DuKNd3CCmSker1k 257
levanter/config/data/redpajama_1b_source.yaml sha256=Bec1hp26gFIIglR_53jLsNWLinYgtTvDVQjqhBqMinQ 179
levanter/config/data/redpajama_1t_source.yaml sha256=D_wt7qUCpqCu2NSTOedvxXeL3xssUxrbOvlIX0z8FWQ 164
levanter/config/data/wikitext_source.yaml sha256=KXFaac0ik_TLVzwbiL3QQM1oLUQJn_4kTriWX_iF3Dc 85
levanter/config/lora/mpt_biomed.yaml sha256=rjqAg4JJQLRHBkhIikUc8KHMqzMnF_OevM2pFHPjmp4 762
levanter/data/__init__.py sha256=Nas9VzQoXftbrSLMLWnlos0pCelPCqJJT4U2WFohtL4 604
levanter/data/_preprocessor.py sha256=Kyjadd_3X3RGx5ZJoaNisuAPvMhJRb-txN38ptxmdFY 7199
levanter/data/dataset.py sha256=-gnDPjfVIjrEkEwLpLKpEi-PBkk2i72Lg_LwEQ1eNIU 1698
levanter/data/loader.py sha256=-zAx9uJ8qlCIvnQKBixMA0BvvH4QBeSzzF1bXg7z0uY 13918
levanter/data/shard_cache.py sha256=G4fV04vMtgZotXQn3A-VT8pBF_2-4-UcoMo7x7UDDWs 45594
levanter/data/sharded_dataset.py sha256=oLK7kT_yaY0Rm2X_S4liGSFBTuf9a94JpDcw4dvGf84 13071
levanter/data/text.py sha256=w0CvuVD1pAkaiA_6sJhtvWkGtICizj-TaFjXL8ECcX4 21830
levanter/data/utils.py sha256=sWZNdXZybiWy4dyfFgTaJmpPJNGSirjT5d9rbScpwAk 412
levanter/main/cache_dataset.py sha256=zFORadXCohaHaPYLbHOn2dTTcmZuQQK-NMOgiOdMCPk 1516
levanter/main/eval_lm.py sha256=yC5PagbJMie4eaCo3ccCYLSaps4BULVE4XZv63HSdy0 5223
levanter/main/export_lm_to_hf.py sha256=CW9WBZWSVpfUz54Nzf2rWFpTKWmZJnIPXoCKa2GltMY 2437
levanter/main/lora_lm.py sha256=RffbKRMVgmXUNstU1UIg1a5CnAESB7LpD4gYsYFLVKg 5852
levanter/main/train_lm.py sha256=Qm_BG_5_ZkkavazLPFO-tTk0CLeQOnlxJvm1fKa_zzg 8441
levanter/main/viz_logprobs.py sha256=vRVI75mcYz1uAW-Qe4n8E5VqAct2UgP4BwVSJzrXiFQ 3457
levanter/models/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
levanter/models/attention.py sha256=y0NRDOVE7XmZQdnst-PFY13g26tDpGoPIDgK9BSfPtE 7410
levanter/models/backpack.py sha256=WSvZ_8RfYJ67lWcpZ50MO3i7SZi-4WR56hJAmz9IKmE 16631
levanter/models/flash_attention.py sha256=7nIaTD0Kwm3SAgbRDq7rMirT4jCh34O0xIR9HGn-VQg 11169
levanter/models/gpt2.py sha256=NVqmXx2o3Po-3wZpM9v_taAK9eXGiK4tsGam2aCNYNk 15916
levanter/models/llama.py sha256=M5Jy-dYvPTGw5V0FENFpWLNnedNv9c5UeSUmL8nbHkg 23578
levanter/models/lm_model.py sha256=i2OMxFYwlGhibd3mxTmMBnuwySjneAJHaBrAHzY5eUg 3278
levanter/models/longformer.py sha256=TatMFPX7WjBmOfJmOsY-RIPo48t-36OCf7Xlwd834nY 4990
levanter/models/longformer_scale_test.py sha256=ksfUKaBTJkCx8jOGaq3Bli_hHE4ePdNarKCTuEunpVk 1079
levanter/models/loss.py sha256=yNrzuHz4RwUMfF1ilyZyW5qmL1539ACePi3wfHjylKE 1551
levanter/models/mpt.py sha256=9pnB6j2kCxYGZnZ2PeD6yu-RSkB7QbEbd5Hb8GJ5kJ8 19239
levanter/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
levanter/utils/background_iterable.py sha256=55kv2z03vI6M1wrKIy_UMkwVW3KLXuD1hO68tUQu6B0 2835
levanter/utils/cloud_utils.py sha256=XxQVhHMXmRufrK79acUjdq0ZEe3crf5ovCbyZPsSy1k 3670
levanter/utils/datetime_utils.py sha256=CXBIIklb0uPS_Tq94n3t6yLLSRv9AEEdUx2HyPFoNp4 1059
levanter/utils/fsspec_utils.py sha256=J6rCPjevX8TJ8bVv97JN58Kr7piL_XsLWFi4gFwV00Y 187
levanter/utils/hf_utils.py sha256=fz7_3rLQ6ZLamCtX0lHFYgk_t5A0v7OUFalZ-tq9wks 763
levanter/utils/jax_utils.py sha256=ys4DqZZ6qAX4o_3ATcCCIdM2pCDzxtGl1tmf14O2GCc 9710
levanter/utils/py_utils.py sha256=_CV6SN2qso17T2cwLAXuIhrW4sSDUl-5BUmGmK2fVcs 4269
levanter/utils/tree_utils.py sha256=3zbPTwG74Mi59-RZmLbNreOeo4JDwHQ5TJz8XjLuklI 1611
levanter-1.1.dist-info/METADATA sha256=lOLyXjOo46nlOgVNk9dZVP9l-8XLgOeFCJb2mecYiLM 10663
levanter-1.1.dist-info/WHEEL sha256=9QBuHhg6FNW7lppboF2vKVbCGTVzsFykgRQjjlajrhA 87
levanter-1.1.dist-info/licenses/LICENSE sha256=bJiay7Nn5SHQ2n_4ZIT3AE0W1RGq4O7pxOApgBsaT64 11349
levanter-1.1.dist-info/RECORD