Wheelodex » Projects » alpa

alpa

View on PyPI — Reverse Dependencies (0)

0.2.3 alpa-0.2.3-py3-none-any.whl

Wheel Details

Project: alpa
Version: 0.2.3
Filename: alpa-0.2.3-py3-none-any.whl
Download: [link]
Size: 373485
MD5: 36a5e91a5c3a53812f41261f1e51c33b
SHA256: 17dd005975cbd75d1c73f09a68fc3c151d1f0352bf2a896a2891a2fbfe335f50
Uploaded: 2023-03-07 07:43:52 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: alpa
Version: 0.2.3
Summary: Alpa automatically parallelizes large tensor computation graphs and runs them on a distributed cluster.
Author: Alpa Developers
Home-Page: https://github.com/alpa-projects/alpa
Keywords: alpa distributed parallel machine-learning model-parallelismgpt-3 deep-learning language-model python
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.7
Requires-Dist: tqdm
Requires-Dist: ray (==2.1.0)
Requires-Dist: jax (==0.3.22)
Requires-Dist: chex (==0.1.5)
Requires-Dist: flax (==0.6.2)
Requires-Dist: pulp (>=2.6.0)
Requires-Dist: numpy (>=1.20)
Requires-Dist: numba
Requires-Dist: yapf (==0.32.0); extra == "dev"
Requires-Dist: pylint (==2.14.0); extra == "dev"
Requires-Dist: cmake; extra == "dev"
Requires-Dist: pybind11; extra == "dev"
Requires-Dist: sphinx; extra == "doc"
Requires-Dist: sphinx-rtd-theme; extra == "doc"
Requires-Dist: sphinx-gallery; extra == "doc"
Requires-Dist: matplotlib; extra == "doc"
Requires-Dist: yapf (==0.32.0); extra == "doc"
Requires-Dist: pylint (==2.14.0); extra == "doc"
Requires-Dist: cmake; extra == "doc"
Requires-Dist: pybind11; extra == "doc"
Provides-Extra: dev
Provides-Extra: doc
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 4446 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.38.4)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
alpa/__init__.py sha256=jwlcllSwSQ0IMPbcjLXr2s-iBSBpI5k4wwluvMUENFA 2352
alpa/api.py sha256=fBz786rUXE3Yf7HadmBTBQAjbyppZD8EsqjSiqqsEuY 10294
alpa/create_state_parallel.py sha256=h7vPhK_cQgyfzFeMn0kEt7fa_x0t9UqsUV83a3oOugE 8762
alpa/data_loader.py sha256=2mp2EazJ7sE2F1b9lbix_I1S9W63lcqK0pKHlWtuQBk 10489
alpa/device_mesh.py sha256=AR9yMoWdfsYPh6zVXwq9nfWG-v9xejOpJ4e9gy36w2s 99052
alpa/follow_parallel.py sha256=nq4SEwU25VOMyEMh635Z7Cmf_i4GnE6BDLeCFRYwl0s 4172
alpa/global_env.py sha256=krMke0glnH1x-JRLcz7dKjJLDxvk1IekrJ-mrAXQi68 4873
alpa/mesh_executable.py sha256=gmdO2W76_SUff9u1a3nKd-f_29dbhFWrXNwBoA00Ov4 52794
alpa/mesh_profiling.py sha256=1QZPz7CMgzW47xnDt9TOaxK6sXCXTV5HY0ZwUoUwwhA 34378
alpa/monkey_patch.py sha256=TQf1e6Zy8w_qDKCHHw83PsnzV8UHe44vaFlkcQGWVP8 9417
alpa/parallel_method.py sha256=SjsDNuQ-zuz5kdntdLN1dYzrbZdmho4wx35XXju2A-U 17934
alpa/parallel_plan.py sha256=x6OFZND3d-pziulGKZ0HxZHwa1AKeSfp3noXFz-JQOQ 2067
alpa/serialization.py sha256=tHE8dfG8zrZVDdQf2uxidgkRN-1xGk5h4HOPrmQ6Fl4 7861
alpa/test_install.py sha256=7sA6njY7bnjEBkLHUn9n-PpL1AE6HqNAxgbet3theZY 2192
alpa/testing.py sha256=LzbatzVEZTjny-tvQd52JpLDwdhJhGpoEXGOE--C8OU 14965
alpa/timer.py sha256=xCvcLIO3bfLwhm-ubEKEJWRrLPEmWiGz2WGfJyvwrgg 2321
alpa/util.py sha256=RTZM9UyzQ-UjHfWRjFLGZogE-9C5nfH8ymqmibFSkoo 58814
alpa/version.py sha256=BLX_N3MxUI0ZK3dLXK_qwexjcjokU47HYeWnXRgXVNI 25538
alpa/wrapped_hlo.py sha256=Xp13vme38GAqbNzy9ILt-sEYOYBJUROEGIn4ypNPGFk 2400
alpa/collective/__init__.py sha256=UCHXM-Yb9kIhZBEheEDoaQ7uNRanZNVKWTFlWPTwAgk 1191
alpa/collective/collective.py sha256=gqDLqDDCFad9W3fgId-yMkFfGiK8z44C9rYhCGi9ARM 30636
alpa/collective/const.py sha256=r0h9zZAnN-vsibpUwohoaU9XMI1xDkJq9DcW4Fj829M 891
alpa/collective/types.py sha256=WcQii7V-BMsh2NqVXQ12vxkNFKf3-q7JwwvM-vkkUFA 2204
alpa/collective/util.py sha256=Bmr8mNdfyvIgQqpNYt5xrN7e_pUNQv1zYI78DhtVTww 2104
alpa/collective/worker_nccl_util.py sha256=KNho-uWYlOvUk60YmXRb3U_oopv8ul5nWcHro7CEh2c 2037
alpa/collective/worker_nccl_util_cupy.py sha256=lzWyAwPxWhoQaL4iVlSk7Dubop0jvfJzajZuLWodjkQ 11536
alpa/collective/worker_nccl_util_xla.py sha256=aBd0uyr6PzgzHkeatZL3JFufinsRQnKiZUly3JvJ2co 8353
alpa/collective/collective_group/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
alpa/collective/collective_group/base_collective_group.py sha256=oYnoEW4XJ5mYXhYtQ7MgbdXIiXjihFsgkkDAQQfDKrg 6231
alpa/collective/collective_group/cuda_stream.py sha256=YRHH4kPyCu_TXrpAnzy5IzUcBNvU0LZ61yQ_IgtlYyU 2955
alpa/collective/collective_group/gloo_collective_group.py sha256=VNNT-pTplxhrI-L9QGX7J58MsM3Qqg9DwrwK5Zvvo_c 19520
alpa/collective/collective_group/gloo_util.py sha256=asG3WDA7Gv17TVTK4sR55Li2lbfOoaPAvtnlXMwABfA 8483
alpa/collective/collective_group/nccl_collective_group.py sha256=NdBLbk-SyIXV83Ooh9EZU8yfSHpZqRDaxewc9lULvVI 35398
alpa/collective/collective_group/nccl_util.py sha256=7JlMi5lFRvDVOkzwwJunh40M7WQ_Gt_-DqPSjOuvI3U 9497
alpa/collective/collective_group/xla_nccl_collective_group.py sha256=s12jdeLpqEarYjvCHYj5CfKVnfsdfNQFV8sVr66EGpg 18739
alpa/collective/collective_group/xla_nccl_util.py sha256=NrVBRKLiFTwg6p_FtxTBbCMKzzBiSgD191IX7qNeANc 229
alpa/model/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
alpa/model/bert_model.py sha256=f_8HYk91fpuly4cxd2KtqMG5dIdYFxLE0bB7THsMIXE 31419
alpa/model/conformer.py sha256=5JwV0LezyBfUCNCswY6NeRf-X04HrhO2wEfT_NZwoQg 12248
alpa/model/gpt_model.py sha256=WRbdGLJ3xVkrL4sYMzaxcSzqojQpRV77xTLyfX-ZapM 5183
alpa/model/model_util.py sha256=485RjFakHrpIrXcc7ZP8CltCOc6kRpebabRpm8mjJxI 21748
alpa/model/moe.py sha256=V7ZystukSrOEjliIgIaPx6YAohQ0jSy8_WcZhYxWdl0 15737
alpa/model/unet_2d.py sha256=gdYiaeTbGcd2mDZnKDI6AdK_Aot6eCOc9cI6cQHgJAM 45076
alpa/model/wide_resnet.py sha256=2SOU7EeyflbHPzK40HgZmQAo4Nk4xYk4Wbw5CBatnaQ 5313
alpa/pipeline_parallel/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
alpa/pipeline_parallel/apply_grad.py sha256=dTT1fnJulyjbQZFxX72o4T4-YwsTVrmqyWFg9bAPFZU 55268
alpa/pipeline_parallel/compile_executable.py sha256=4GcoVWg82q-vvE2nVQTjq913mhNfcy3-xfQXWvC7KTA 29176
alpa/pipeline_parallel/computation.py sha256=psLLKIwKFDh6jUoFJwf7Ym8a0vbFJR_A_VjD9OYPp1k 47366
alpa/pipeline_parallel/cross_mesh_resharding.py sha256=iPoUXDPEDBZcifuGHZmhxoCH0c1LJ3iwX5hcfMTCl20 80546
alpa/pipeline_parallel/layer_construction.py sha256=7PFhGj1YsWXTAQwfL2XwaXw19rxUITM9Mm0kbiNAw1o 31097
alpa/pipeline_parallel/layer_stats.py sha256=dIDlDHZ32ZuIndQ0n1Rz5vZg-7YrM01gflSk0F1tBf0 3978
alpa/pipeline_parallel/local_pipeline.py sha256=YvIgvD_Yx8VAnEmV9R7nTF_BFsPoZXKElbqoiCcQkHk 5627
alpa/pipeline_parallel/pipeshard_executable.py sha256=SBsA5vQOYtSRFBsb3CCC121Ep0L36m3BT3lJlgr1FI8 28199
alpa/pipeline_parallel/primitive_def.py sha256=Cl3hUGNi0uDrIEYfspmeoVgXpmPx7XMOO6G_Sk3hY8E 6253
alpa/pipeline_parallel/resharding_tensor.py sha256=WtlvoSCGyDfAwwDyhEgB_5Pk_to6P1ZAhjVYl-gRCu8 9179
alpa/pipeline_parallel/runtime_emitter.py sha256=RmNfIngdfNLTglSlke2TS20NwNr61WhugxruBjO98JA 53292
alpa/pipeline_parallel/schedules.py sha256=2uHNp46GDS-ltcxlsvhsPn8LcWseDJDNvycu354P-8k 17920
alpa/pipeline_parallel/stage_construction.py sha256=2GLBhnMnwhTYar-lcvnVFshEk3UAl3L6cZDpbzxj1KA 36626
alpa/pipeline_parallel/stage_profiling.py sha256=bFiPPOiCIx5yoOLr1qjNeYWSPWR_lxLRrJCPJHHlIoI 75218
alpa/serve/__init__.py sha256=2p8lwqBQmvUJ5X4nGtiPxZ6aOXTZi40vSX-kSpkEG10 93
alpa/serve/controller.py sha256=SXtiYVZ7xfXutDbVWsL7ynzom3l1YzuDSziRaDsulFA 10703
alpa/serve/http_util.py sha256=nKY19U_pvzO1ICXiqRrwKUAqvVtjHj7r0xtjU6e8jNg 13011
alpa/serve/run.py sha256=OCMT3MfDHZG44a2bId5bsgeRB0fZyxPf6jjhjD2Khn8 525
alpa/shard_parallel/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
alpa/shard_parallel/auto_sharding.py sha256=E2dKlIno9XrDdAGl7BNfF5wdqCecN1iLK-XPBNJogfQ 32775
alpa/shard_parallel/compile_executable.py sha256=O3hVGZO8BGfTZC307YTphoer2YCug-YNTvw1_H8lEx0 18648
alpa/shard_parallel/manual_sharding.py sha256=wNEn5xfU7FWIP8HbHseldtnZDgCu2yxqec5vIMMmp2E 6443
alpa/torch/__init__.py sha256=EPfv5ROZFUav9O7jqGiYhv79GsQA-HWIjDcvAgcxI_I 6215
alpa/torch/tensor_utils.py sha256=0KuwjXL_UJIYB0mb001qVmy2S5IE4GkugNhKwzKr7_I 3809
alpa/torch/trainer.py sha256=QywY_KC36onIOf7kBCJPSTNaWLSifkgDnVzZBT0DH7I 4486
alpa/torch/nn/__init__.py sha256=Zx8czV3vw0UiaFHpAlUxPsevYt-yHRfbfehaWEWYyfU 19928
alpa/torch/nn/utils.py sha256=mWb2iTxoEf39dct9xjIQg7GgH5iDDgb1yG-7Pl571pA 17130
alpa/torch/ops/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
alpa/torch/ops/mapping.py sha256=NjC3U7L4j3RCPu2emLHeoChAXYM_Pc9ucyyYfUiWviw 18137
alpa/torch/optim/__init__.py sha256=Qh74GFhfDvZHSdc4XTV8oCwzK4auRqbEyXp-Ajf_1M8 41
alpa/torch/optim/adam.py sha256=YWr6J_mEDhDXp1BmEA5uWqUutBeeua7SR-6XlQXdFVI 1422
examples/llm_serving/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
examples/llm_serving/client.py sha256=KRgNrl_VUfvkeHw4zWUyzan5rlZI9c4V5GtOcI5jv58 2814
examples/llm_serving/codegen.py sha256=MwdFtBZ66e3KNKg1_IMCBfLy7wihkW6CZJyEQp-mKew 2304
examples/llm_serving/generator.py sha256=ZVhglw5B-PyQX7qhc8OO8wuBaPXXWebdkH6u9OduQ10 10421
examples/llm_serving/launch_model_worker.py sha256=6cBq0QqhoTOAAUBEOHdhoC4RZ8wJq8VR7sO0rQ3N6wQ 21202
examples/llm_serving/launch_website.py sha256=xAequX7MZTQO_FeVCxctzgAn2hfkT4bw6sbSynNibns 2763
examples/llm_serving/test_completions.py sha256=JvVO8_Egcryku_h1E7g5s5eVIlgXGHjbO_i5w0y9-kQ 658
examples/llm_serving/test_logprobs.py sha256=7UYmj8-jcj6AG5qguhQuVhusslqwD2HmqDCCuGo-7Ko 1800
examples/llm_serving/textgen.py sha256=vBIgLsb1mJRiRngObw_BmX_6Z7nyeePYLWotAOgArbY 2348
examples/llm_serving/textgen_1d.py sha256=YqRSoQiPB37ZB1smNdmxLbTp3KSNxzwrUT8k29Uq8ig 2423
examples/llm_serving/model/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
examples/llm_serving/model/bloom_model.py sha256=LrasD4IAAz2jQ15CDtCMR39NVteJ82nhHdxKyW1ddAY 38495
examples/llm_serving/model/codegen_model.py sha256=g8gzS-q3vTSnBixa-EQcDCzLHt2re6YBV08u_X5TWVo 39216
examples/llm_serving/model/opt_model.py sha256=BcDThnRYipB15NFp-LVJvC0_puJ_4daG1QitTmIkhkQ 42090
examples/llm_serving/model/opt_model_1d.py sha256=Oy7JKF1lXOvDZweHl9aDhZ4L886CUb7K1U6EelUGjzw 31238
examples/llm_serving/model/opt_utils.py sha256=mR9D6zGFJdvR_FNj2cxwOB_9mf8nV9jrJ94yFrmHFnY 1817
examples/llm_serving/model/test_cache.py sha256=0ToveIayXnvPD49YHzxJn4fX5g7axTXJM1geDhXJOhE 3002
examples/llm_serving/model/wrapper.py sha256=hB2f1CBUq4yyCA8Tph0xXalM9P3b--C-G4DT-FKW57o 26571
examples/llm_serving/model/wrapper_1d.py sha256=GLitfYpAxwdznQ1PNpIoPPhcxvtxE2PuwZIDOmak9K0 7911
examples/llm_serving/service/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
examples/llm_serving/service/constants.py sha256=837QiL7er3b6ngvXDiSKMYL51XpNDTRORi8TekYUY0A 887
examples/llm_serving/service/recaptcha.py sha256=vN2bzHxdjnIrvFFkrCaePVbrClQQ_osDufss8wyNxGY 3536
examples/llm_serving/service/scheduler.py sha256=aH-BNsNpEhZR4sbEW4tU-VLkcfHcwFDHu7r3ZGV3lHs 9944
examples/llm_serving/service/utils.py sha256=tK66Wl5jJT7sM6aIiHkl35T5Zi7D4l3hBWW0HHim9yw 2673
alpa-0.2.3.dist-info/LICENSE sha256=GZvj0Ky-u5KhyUiaDTFFB5OGEHFsxdSDTYksyhts1xc 11410
alpa-0.2.3.dist-info/METADATA sha256=wfRWGWpWjmnTheQJROIGNimYed02RTJrLNOvbEHKtPU 5812
alpa-0.2.3.dist-info/WHEEL sha256=2wepM1nk4DS4eFpYrW1TTqPcoGNfHhhO_i5m4cOimbo 92
alpa-0.2.3.dist-info/top_level.txt sha256=RsJa4QzTWT_1uI9PI_CsQk9SU5DMt3ii6m-dw826Hy4 14
alpa-0.2.3.dist-info/RECORD — —

top_level.txt

alpa
examples