Wheelodex » Projects » modalities

modalities

View on PyPI — Reverse Dependencies (0)

0.3.2 modalities-0.3.2-py3-none-any.whl

Wheel Details

Project: modalities
Version: 0.3.2
Filename: modalities-0.3.2-py3-none-any.whl
Download: [link]
Size: 137768
MD5: 05b463afd4f03c7bb0cd9daf48c0acff
SHA256: e370311cbdbfa5c33373fe3dbecdfb187c4bcb6be053127f4ad5f8c8cd82b956
Uploaded: 2024-12-02 22:22:43 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: modalities
Version: 0.3.2
Summary: Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.
Project-Url: Homepage, https://github.com/Modalities/modalities
Project-Url: Issues, https://github.com/Modalities/modalities/issues
Requires-Python: <3.12,>=3.10
Requires-Dist: numpy (<2.0)
Requires-Dist: torch (~=2.4.1)
Requires-Dist: packaging
Requires-Dist: tqdm
Requires-Dist: pyyaml
Requires-Dist: transformers
Requires-Dist: datasets
Requires-Dist: protobuf
Requires-Dist: SentencePiece
Requires-Dist: rich
Requires-Dist: omegaconf
Requires-Dist: pydantic
Requires-Dist: click
Requires-Dist: click_pathlib
Requires-Dist: jq
Requires-Dist: class_resolver
Requires-Dist: wandb
Requires-Dist: einops (>=0.7.0)
Requires-Dist: flash-attn
Requires-Dist: pre-commit; extra == "linting"
Requires-Dist: pytest; extra == "tests"
Requires-Dist: pytest-cov; extra == "tests"
Requires-Dist: debugpy; extra == "tests"
Requires-Dist: ninja; extra == "install-helper"
Provides-Extra: linting
Provides-Extra: tests
Provides-Extra: install-helper
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 22595 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.6.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
modalities/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/__main__.py sha256=d1XgVj6Pqtl_5cR-l9JSLFCDBN-7uIsd8gxcc5T1xnM 14973
modalities/api.py sha256=uA0n4gv0PtWZuJpKsj5um_SnYZf8zlQFPRKNDUTsAVc 6041
modalities/batch.py sha256=ia0GQNHElWBK3IjmyAYRFyUucO921A82mWE1amekzGM 4398
modalities/evaluator.py sha256=lJOSOfeG1HmPghxumJnR6dneJtpn5X9tBg0omBVLoiY 6950
modalities/exceptions.py sha256=WuAx__QQkGMc6Ujm8gB3jn9IjkBqAX5UOSCTGF2JZP8 323
modalities/gym.py sha256=Woku0TitAOCUG34SGPou3U54vvaJPceDgRHGagzwwAQ 4900
modalities/loss_functions.py sha256=IhKV-TYG2xzZjaFuQti56CCh9WFRdUrN-awFyhUA7LY 5017
modalities/trainer.py sha256=3ZcIa_brQSuivS3xisEOGQAJyxNjo_106mIxHk4jOHU 15529
modalities/util.py sha256=pXhAbkRVhnBcnimEmW6BELjBJUfWsb8nitzYNEyLZcI 7393
modalities/checkpointing/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/checkpointing/checkpoint_conversion.py sha256=9W2oRuvePtVN4OrykIejvTwFPk-H9WTaErQPkc0jG58 1688
modalities/checkpointing/checkpoint_loading.py sha256=NVYgrfjF9J8_dNZ7mRYrP3CMHWPxNW5E45mDz1zQI3k 1589
modalities/checkpointing/checkpoint_saving.py sha256=HYuCzsn-z7-e9P3TWmcPOTNrSjrib7NqE37ZmSvBYvs 2745
modalities/checkpointing/checkpoint_saving_execution.py sha256=pLVEtQlLn0LgmU5QIq7_Zj0u05U4Cd4cLQ4zATaTgTQ 2268
modalities/checkpointing/checkpoint_saving_instruction.py sha256=-ALUX_lJ1Xbo13lXd_3rtgtQIFhy7c-fj4dmPeMZcdY 540
modalities/checkpointing/checkpoint_saving_strategies.py sha256=kD6Q7EKhMevOgRLD3G4VccxhJR1wNmyq6TtGaLcFv7w 4844
modalities/checkpointing/fsdp/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/checkpointing/fsdp/fsdp_checkpoint_loading.py sha256=iqAWpxe_a95R_HTegFxOy6rsfbLSeYxCSwu3pfzZsQE 3630
modalities/checkpointing/fsdp/fsdp_checkpoint_saving.py sha256=4TVLjMl-yKc5bQaG6tjZde-6RLhhgxvg0pAmzhBvEQU 6286
modalities/checkpointing/torch/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/checkpointing/torch/torch_checkpoint_loading.py sha256=dHP-kChlUHD36xJ8b4v9KhZmUm08tdotRaycBBLYlOU 3317
modalities/checkpointing/torch/torch_checkpoint_saving.py sha256=myclzhupuxly9t0D8tZ0yjrQ1pcVlrU0fbCJPjmXqb4 3157
modalities/config/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/config/component_factory.py sha256=-7yr08f0PQ96y42ZVPdRX57ryd6AAkBTkZ8chd53yo8 9785
modalities/config/config.py sha256=3k5UECouOQQnKCZP6XXK9OU0GifJMBKZC3-9UxaNR0M 12876
modalities/config/instantiation_models.py sha256=ocAZbMkewSMa5Qjq2bI8eLCdDl728vCVkdrT2XKpG0Q 15374
modalities/config/lookup_enum.py sha256=ItaYTtYhkzuWnDWMGloUdTYrYVV_9oXri0ifS-Njsww 220
modalities/config/pydanctic_if_types.py sha256=xbHGpSqvM8HMZW9zROTeNjfq8PNjU560U26Htxlsgw8 3827
modalities/config/utils.py sha256=f5UTjGQBeU_uplrtJVC_WIWxqnYHH364HqO3sgTkdrQ 630
modalities/dataloader/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/dataloader/create_index.py sha256=a_sOsWH6Gj0eRK_Itqj7sQd_FbWvBlwwpYKxkeY7eFY 5222
modalities/dataloader/create_packed_data.py sha256=AGU4cFA0gWQ48fUiqHT7RKXgvD3XJAUktWzYC4VOtgQ 18930
modalities/dataloader/dataloader.py sha256=D52n8daJtFzFepgTBKae6PrTUbdnWhrL5HbGXQu21lI 4013
modalities/dataloader/dataloader_factory.py sha256=MEEguj6Y8eTB4gFkstLNNQp1cJBs5IEobbezJZybk8s 1315
modalities/dataloader/dataset.py sha256=hDTiPVJvFyx2yStyPEtRipAZIp6GV2nHaOgKZml0ykc 17327
modalities/dataloader/dataset_factory.py sha256=aLVa5iOr3Md3RKjA7BIW7QtzlcbLJ6JsV3SUN5m3WE4 3786
modalities/dataloader/large_file_lines_reader.py sha256=y6Y6URCGJr073An3zShMrHWPMZNuHAVw_-tW3G0e78Q 5066
modalities/dataloader/samplers.py sha256=kJgCIrUwH0FvKh2zzNKVxjUZdUPlviShxUcsdEZL9qo 6257
modalities/inference/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/inference/inference.py sha256=EqOo8KJic3CtTYBuM870qdclqryPNKWbGBa-zBnwwLc 1750
modalities/inference/text/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/inference/text/config.py sha256=Z2Ww42B7s23K-s2iE-GI_V2yUkBHeA0AHQVXpb2xX4E 721
modalities/inference/text/inference_component.py sha256=Q8jLK3601XFe5e1ZNGf-yY7pYz_b7Nz9ZlW-zGkPCmI 3664
modalities/logging_broker/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/logging_broker/message_broker.py sha256=EuaXZ3e5S-ZzwZ7MCzZUBfKa-my5MyNZQeWDKyzhVNI 1236
modalities/logging_broker/messages.py sha256=5bX3U03iSyuzq6QH6fnvZgz25MxSmnKNrJxIyBwrvps 883
modalities/logging_broker/publisher.py sha256=zEshME7aWekMhrxVMK0Y3Sv_kLpDD87okwcm9cP1ASg 1147
modalities/logging_broker/subscriber.py sha256=-vn8VqNGcB9OUW_IYje1LThimzi7dI6m-lisq5Hozbk 462
modalities/logging_broker/subscriber_impl/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/logging_broker/subscriber_impl/progress_subscriber.py sha256=_hJqZWOoV-F-LLcKg3ny6Sm6JbUcBq5q7QvGcqOHUVU 3765
modalities/logging_broker/subscriber_impl/results_subscriber.py sha256=U5tJkiV4esA-wmJv6tmklvjjwer3Si-7S8mZjjb2Tis 4275
modalities/logging_broker/subscriber_impl/subscriber_factory.py sha256=aHOY8kLb9tss4lrfPWfoDL0XU0wlZ9iNblf7AE6ghu8 3477
modalities/models/__init__.py sha256=AbpHGcgLb-kRsJGnwFEktk7uzpZOCcBY74-YBdrKVGs 1
modalities/models/model.py sha256=qRnihCzCi2ihtEEgu2cwwgh-72ceHEbLRczESFR7yCM 4634
modalities/models/model_factory.py sha256=xiay-thmvy8wA5D0P6VflDEPCneOS14nQXgx5fOdTrg 5293
modalities/models/utils.py sha256=V6uZ7pr6_TXKBroetASz_NxSNa3AzZxKkZnZnKjoFVk 1740
modalities/models/coca/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/models/coca/attention_pooling.py sha256=VPg_PBjR3Hwi6XmwjKw76OB2lFVtAmT42IxDQHPOwTQ 1799
modalities/models/coca/coca_model.py sha256=zuYagEe8MaWGwhL63FuW6hPZEGN5jw_LHJ5MSvl-C6E 11254
modalities/models/coca/collator.py sha256=JEeJPpZsyLkJ5GQTzmdhPrrI_NqV56s9keyc97AvLBI 3051
modalities/models/coca/multi_modal_decoder.py sha256=yKGGnZBVWBuHdj0dNA3wwk9fGE4uTZJu5I5bGq_yJHs 7181
modalities/models/coca/text_decoder.py sha256=vV7n1oLEC-Y97ae59QG1iU9oK6KHvFMoPwMrmES8Aak 3932
modalities/models/components/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/models/components/layer_norms.py sha256=zI5t0q9orDs9UjU-J1_F5Vn7UFB8Le8l-sOSfmmdUSw 3399
modalities/models/gpt2/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/models/gpt2/collator.py sha256=jfh4pDSyOQZ7y3SpKjSJ1IQh-PECy_CQDKGVSHsjxZA 1775
modalities/models/gpt2/gpt2_model.py sha256=lQdFnNXsMSwDE1NdXUsKb02DT9VqBF2Cs9SdUdsCFSg 35696
modalities/models/gpt2/pretrained_gpt_model.py sha256=usz0g6HrumwABZpSmrfJrnwkkaSFqj2qLAMGu48Ozak 1179
modalities/models/huggingface/__init__.py sha256=AbpHGcgLb-kRsJGnwFEktk7uzpZOCcBY74-YBdrKVGs 1
modalities/models/huggingface/huggingface_model.py sha256=YwKikKlUY7irpPn5C0y_FPeZtF27az-L6wo-QYPrEEA 5356
modalities/models/huggingface_adapters/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/models/huggingface_adapters/hf_adapter.py sha256=pFtxLF2ewdNnbCRiB9pW5R4LQ7c6jxnIguaNwOKcli0 6597
modalities/models/vision_transformer/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/models/vision_transformer/vision_transformer_model.py sha256=37GvmgHAlbse4H1TYuxvTtU2yjx6GIFSp4oenH230b8 11844
modalities/nn/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/nn/attention.py sha256=esMKn3spKSQJM22evn2s_9dONpOFipYnJvGbyYJNvn0 4330
modalities/nn/mlp.py sha256=6NJ8EwRuUfBoe6iZSnoT9D51hYkoeYPYk231_IdLblU 1031
modalities/nn/model_initialization/__init__.py sha256=AbpHGcgLb-kRsJGnwFEktk7uzpZOCcBY74-YBdrKVGs 1
modalities/nn/model_initialization/composed_initialization.py sha256=ctuDPO_pWsEQksZnDs2rx9sfI56Qbaf7vyw7P8kZaAA 7484
modalities/nn/model_initialization/initialization_if.py sha256=0WWFiSfJv_7oUM6EBn363iHDauGFp8QfEoaomOCzWP0 202
modalities/nn/model_initialization/initialization_routines.py sha256=OJ-w7o0-y083xfmdLPDp3ZGGLrxrTRRRtnGNtpnbEMY 5731
modalities/nn/model_initialization/parameter_name_filters.py sha256=BzRP00UqJXacdyoipfUqdWR6kV7g7Ypn4FJWH1ooWwA 2954
modalities/optimizers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/optimizers/lr_schedulers.py sha256=4p1tprw6UwFOfPf-EJ4iagmIiaEyYWNlQQ0dA6pqXaA 731
modalities/optimizers/optimizer_factory.py sha256=HSxUSdDgJzSxN2iy4adZMSqLqks1eXIDpoMj7HEMA7A 7105
modalities/registry/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/registry/components.py sha256=sEj5Dbxwc133MMAo5ZHjdxM_Fyczd8dubANwWhldY8Y 13896
modalities/registry/registry.py sha256=wUUjZTFMflWaKmL6qYQ0oAg4afjglUn8WHGXKw4z_84 3833
modalities/running_env/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/running_env/cuda_env.py sha256=Z_Kriau19Pd-_7SA2kBKG_ffd4Q1xQctBc5LXb9G6Nw 1635
modalities/running_env/env_utils.py sha256=EoxpdbSemuEdNjgQil_mnqI0GQKIIqgpFKsb68TlS6o 1935
modalities/running_env/fsdp/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/running_env/fsdp/fsdp_auto_wrapper.py sha256=YYw_j16QW76Ptd2H99gfrUoBWA7N2WXrsYjIVb3jIOs 2230
modalities/running_env/fsdp/reducer.py sha256=_i0iALetA6iVzbZ_o-6TWUq_FKqvKkUSBr-RvRbrqdk 444
modalities/tokenization/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/tokenization/tokenizer_wrapper.py sha256=EsNNz3x_aMI5qst2JlcSRy9crzw4KZ9IELVLsyZQ2mM 7219
modalities/training/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/training/activation_checkpointing.py sha256=QwNRg4XBNxqslH5zFhRbm25e5HUFW8usQkQdgIvgncc 1329
modalities/training/training_progress.py sha256=EKEkkrxEK5ifTaZ3j9Kf9CYRgcvo39-tImcYZNjS13Y 1166
modalities/training/gradient_clipping/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
modalities/training/gradient_clipping/fsdp_gradient_clipper.py sha256=Ni94ZFz5fZ4VAgup6QL9HhiXhW3x4yUT7mEzvwaY4ww 3343
modalities/training/gradient_clipping/fsdp_gradient_clipper_config.py sha256=KJKWRvrzTaqAsiXMtKw_nRqe63j_W_9ja9IHqOkp95w 1816
modalities/training/gradient_clipping/gradient_clipper.py sha256=aY0ed_1eY1ktG6a-cDEa27cclbIQ3GCCzMGOpXX7DI0 404
modalities/utils/mfu.py sha256=JC28sGERU8O5QSaq2T30goQ4mGeQnFjsK4jx8pvlzgY 5909
modalities/utils/number_conversion.py sha256=4Jxs_sPNf_0z-uJ6NEyjxYZpd2EFNBiyPa5-8DJntL8 15436
modalities-0.3.2.dist-info/LICENSE sha256=KBZIzRjVb0C3e-RO5Dt9Sq7IhqgGma3eBDr_cLt_6CI 1080
modalities-0.3.2.dist-info/METADATA sha256=k0-UiQUVaf2J2uwj4C15f8qxQl2bPUmja0VlrgSsm_g 23748
modalities-0.3.2.dist-info/WHEEL sha256=PZUExdf71Ui_so67QXpySuHtCi3-J3wvF4ORK6k_S8U 91
modalities-0.3.2.dist-info/entry_points.txt sha256=mx7se6eRSG3D-A2x7bxMiRR6Vq5KL7SaygQTCNEU2IM 56
modalities-0.3.2.dist-info/top_level.txt sha256=K9mRxd2eEbTMJNqVooswz9O4hGW7AQulSX-J0CLM1ak 11
modalities-0.3.2.dist-info/RECORD — —

top_level.txt

modalities

entry_points.txt

[console_scripts]
modalities = modalities.__main__:main