Wheelodex » Projects » InternEvo

InternEvo

View on PyPI — Reverse Dependencies (0)

0.5.2 InternEvo-0.5.2-py3-none-any.whl

Wheel Details

Project: InternEvo
Version: 0.5.2
Filename: InternEvo-0.5.2-py3-none-any.whl
Download: [link]
Size: 293328
MD5: 23c0f125bda8949bea093204dc09f4df
SHA256: dfb373b99905f42ac17ee9d2325cf6a179615cb736d3ccc557f5b9b308c741a9
Uploaded: 2024-05-13 03:48:20 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: InternEvo
Version: 0.5.2
Summary: an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies
Classifier: Programming Language :: Python :: 3.10
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Requires-Dist: transformers (<4.30.0)
Requires-Dist: sentencepiece
Requires-Dist: numpy
Requires-Dist: tqdm
Requires-Dist: psutil
Requires-Dist: packaging
Requires-Dist: pre-commit
Requires-Dist: ninja
Requires-Dist: gputil
Requires-Dist: pytest
Requires-Dist: boto3
Requires-Dist: botocore
Requires-Dist: pyecharts
Requires-Dist: py-libnuma
Requires-Dist: pynvml
Requires-Dist: tensorboard
Requires-Dist: rotary-emb
Requires-Dist: xentropy
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 4694 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.41.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
internlm/__init__.py sha256=aOxMYXhWx8FXNf4FOQZvi-CRRVdAuf9AbUdSu2c-gHM 267
internlm/accelerator/__init__.py sha256=TFKEQnJ3fttGE1t1Y65xFc9l8x6ApryL_V7nyGpuRTc 147
internlm/accelerator/abstract_accelerator.py sha256=0pJNZTonmG-IAYG9P-RoVJUwN3uJG8lRV1IKY0I8rpg 4017
internlm/accelerator/cuda_accelerator.py sha256=TYKYn0oUK_urGN9yCT0kF0081glAu809dtsowtTjxY0 11010
internlm/accelerator/dipu_accelerator.py sha256=J0nDY8eDjiDCd_2HzNkg9qOqO4puRWA6wC2fFsvsfqc 11446
internlm/accelerator/npu_accelerator.py sha256=1mFWqHvSBPrBv4w5j6-JivJMDP4uLen5DQ0ss8Yq5wQ 10866
internlm/apis/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
internlm/apis/inference.py sha256=ErGlylZFf6232pXt9uwBe0NMcOuq_ZWTUk4Y-zSEUUs 37532
internlm/checkpoint/__init__.py sha256=5aGNihpEtIM2CEz5QS4gpRRc0oJ6q7esG7Za7hwD9ts 83
internlm/checkpoint/checkpoint_manager.py sha256=ffcN8NokEhzNv01urOltj0yffIVgbNwNh2EWXKbAJCY 27404
internlm/checkpoint/components.py sha256=vVo_3nKDOHuTlmmV6a1oogttc41nl4-Vkp0AngMXkpc 20076
internlm/checkpoint/load_funcs.py sha256=Df2TEP8PAUjNPTf-6eCNyUu_oGayqvA1rvdNKekLwRA 14172
internlm/checkpoint/utils.py sha256=E6VVWl8RC7EOugA4U8pLE-X9u_rA70JJV3xv0oWxDmk 2474
internlm/core/__init__.py sha256=7IcUI3tRNCRdiyp78xjvWaoqk80qq7q4PccwsllrL0k 158
internlm/core/engine.py sha256=hBPZewgM_dAwi7I_-7JDl3FubT4-R8EzbqAAaZHQ-uo 7458
internlm/core/gradient_handler.py sha256=SK01qbdoZYGnflPTD1Ev-6K8acyPBZ8mnvGh2dIcIVw 3113
internlm/core/naive_amp.py sha256=cpmx-1HxM5QCxqwiY_6kGXZTQCzSYf4o9vfhIbdGKj4 8456
internlm/core/trainer.py sha256=i1Ux1-9qY7pbfNtQjr5x0NQ_HlXkPAn1JJku1us23hg 7598
internlm/core/context/__init__.py sha256=AZePVe-sU8yRVrwhDDU2Gl6OwY5TDVXNHSWHUpmMYSc 1220
internlm/core/context/parallel_context.py sha256=ZbziME5sTP5rGzYem7_wXsGcQ1pxQE-jpQW9h12lhls 27076
internlm/core/context/process_group_initializer.py sha256=KsnPuDz6NJEaZuFcFqbpCjUiSZz1ps6zY9ozFVw315E 38371
internlm/core/context/random.py sha256=f8_NcgmXhE1MsCAb5OqGfuCQxfm3sERdZIJH8QoYkNk 4295
internlm/core/parallel/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
internlm/core/parallel/shard.py sha256=6jOYYflxWmZ24v7evS4c8WjQwm8DVcQqJPUlwhVfghE 3810
internlm/core/scheduler/__init__.py sha256=hxxi2csf4c12oPlIVccb7WSnyJXoI9okYeLtB8ecTlc 303
internlm/core/scheduler/base_scheduler.py sha256=tvAzgAPuDTDgrJuCxeyY2lfWLW8VRSkQU2a8VbZzT4E 5258
internlm/core/scheduler/no_pipeline_scheduler.py sha256=VfVoMd06ZUrmIcVMOwWNfwMGJduObpxjs_Y5SY5znbA 8882
internlm/core/scheduler/pipeline_scheduler.py sha256=WKKRKqty2SYdA18aXWxrNiLEL9rqyhgDmQxUoqg3rnU 63810
internlm/core/scheduler/comm/__init__.py sha256=091S3RU43sq6vOnJAH_M74L8HAlSjVZMkV7Fgj2Tq7g 884
internlm/core/scheduler/comm/p2p.py sha256=R3QHFhL0IUXrwhoo9AqV-eoi_DbmLH9VQ6mTqaDH3PY 22670
internlm/core/scheduler/comm/utils.py sha256=M816UGKtg4WrM_HfwNtyvQjZWC9pCPex3Te-BlFKLYU 4958
internlm/data/__init__.py sha256=9LQOYxS2yWH-b0pHMkX_TZr_wvUaBh7hgNGobjTz_2Q 209
internlm/data/build_dataloader.py sha256=HHR_Ph1JcONNM8kX4KlM4ubmbwbWlXADC_0fwy1hT6U 6991
internlm/data/train_state.py sha256=xixu5hUgkkKGFZOjarUmtob1tkTO8ImbOf8zcNTAfGQ 454
internlm/data/utils.py sha256=HbVBuJgiu0AWPTYT-qsKS4zdZz5gvp-0XwSAxf0lpAc 2546
internlm/data/tokenized/__init__.py sha256=FKoOPMKBrQg-fVCC9t6AHrkJ91_vJT6faTtVPxQAd38 418
internlm/data/tokenized/batch_sampler.py sha256=SHDiNvlaYkzpJ_cs2Y__Jieulqkq6RDwP_QeKhkAez4 15158
internlm/data/tokenized/collaters.py sha256=Qv1Pe86d9bvjkRRmQXgLHGHlcNL1ldqDpVoCprfyW80 4401
internlm/data/tokenized/dataset.py sha256=6a0CUtegWAiST9zGPPe5qaZjpIjMZ8mqkGp8g5LlsAI 1714
internlm/data/tokenized/dummy_dataset.py sha256=FRAe5_YVViyexqQv3nONa3I9Ar9Q0N9RrUd1zXtxC5k 1406
internlm/data/tokenized/dummy_dataset_multimodal.py sha256=TysiauPgSmurFxu05fVVtPAjg2K4cUGnT19Y_szx6IM 1894
internlm/data/tokenized/packed_dataset.py sha256=_LVc8Gd5m1DleoV0ltqdbaLt6PS_4PpGpmC9AjfmYNc 22498
internlm/data/tokenized/single_dataset.py sha256=5BAV-SycdFrxBro0ayvzqCBDQLe8KtXOIZ7tddOODTc 3740
internlm/eval/__init__.py sha256=35BjZiYtrCq8aLfWX2IXkuClIYfBSzetDBTSmUFm2pQ 86
internlm/eval/evaluation.py sha256=WKrdaSGUFgXtWgZ2WUrEFte4QfxaKkVNM2Y7j59slx4 4999
internlm/initialize/__init__.py sha256=__paAMdWvge__lT5m8N-FBXjri92LaGlBnPtq6VBm0M 368
internlm/initialize/initialize_tensor.py sha256=FDxXUBpCtd3_91C8YmZOCtolgCwW09OhCOHebHmrR_I 1793
internlm/initialize/initialize_trainer.py sha256=YtkkDWdcT2kcVK0BM_VJ9RvN1Tw5ZDh-SiSGQMbFiC8 5934
internlm/initialize/launch.py sha256=wqpEHw5pLSJyaiqIUAfTinHfoisPa3geoQbjr3lgJNU 27583
internlm/initialize/legacy/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
internlm/initialize/legacy/launch.py sha256=1LVPgwtwlj4zwNHktGX01C2mDDsbMutbVOgRc_au3jE 1592
internlm/model/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
internlm/model/builder.py sha256=Cd61-FIgA3Wo6be7cAwZY80h04eaFwBqsNPcTjq39H8 1354
internlm/model/metrics.py sha256=oPUDMqYsWSOZQf0xqKKQeFtZkGmJKznI_Qc3G_3VNkc 16875
internlm/model/modeling_internlm.py sha256=dMn46GRMKlbPOmY0M7qtaKJ3gb9te5nd4gVCdTEdfII 15915
internlm/model/modeling_internlm2.py sha256=OY0ZHbiGEuTboWK09Kjrh9uP28WGYKctjDFYDNG-QA0 21691
internlm/model/modeling_llama.py sha256=j00Bzd0SWpVKOLDGbd9K5HtLkPIFw15MfxqEUR_8xNo 20973
internlm/model/modeling_llava.py sha256=Of5jonA9_nAgjOkThJlzOVbVmApCBpOPL40q4FFSXvI 10481
internlm/model/modeling_moe.py sha256=m65z6YgNBx2tqCEsi2s5npYxE6PQ_zVZEfuZQhItMM0 17537
internlm/model/registry.py sha256=rnfAt_1cQ_D_oLoQubH4FZF9qnW8KqlaaNUXLSoE88s 2952
internlm/model/utils.py sha256=mwdJz8PYjRUjYHeX2TTAprbOxYA56bMvv1CN8g6Rvpg 883
internlm/model/llava/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
internlm/model/llava/clip_builder.py sha256=y8qkO7EbueUEneJVYoQJHbq4ga_7_hTTiag1DhUqSQo 499
internlm/model/llava/clip_encoder.py sha256=WGVtK8dh8viZZjUCdSWzof9srxJNpmnEElpi7x4DDW4 2674
internlm/model/llava/projector_builder.py sha256=_s8EkzhKyxYp90dQPi--4dIl6as30De1XcDEtnOFRbA 1407
internlm/model/losses/__init__.py sha256=mOEqnBuXpQ0u7tvOLZFMQqGxUm7_q-IDGCZfvRxdPRQ 73
internlm/model/losses/ce_loss.py sha256=0ofTs_8C_AwgqMtrIvrwrMObTUZ3YIYCBVGY2StIkCA 1716
internlm/model/modules/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
internlm/model/modules/embedding.py sha256=EyyAVkopw2lPobxglqUknB16U08cG0S_KR8drj8TQVo 13791
internlm/model/modules/linear.py sha256=p5T046eoRAeh6Mc5P3wVx6Go2e8QRZjr1GNRilg9x64 21583
internlm/model/modules/mha.py sha256=ndVOxyC09hd-BLJkWzk_jMwseDw050lo8G2OzzEBfDY 27792
internlm/model/modules/mlp.py sha256=Ik0q6q3CRUkmX2ZrsJzw5kmmIIGV68cqZG0OudJZlio 4613
internlm/model/modules/norm.py sha256=YbveuvohswK4W27jtNMKGdiggfmRCr4hAWDTpU91sAY 424
internlm/model/modules/utils.py sha256=myZqSbFUS2gMjQHuJH4AgcNp8IlrdPTJCjLwsT-OC4k 3277
internlm/model/moe/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
internlm/model/moe/base_layer.py sha256=SSIxniSANNa-dc1bks1EYheAt_WhJ1Otg5DgQEJtNH0 1198
internlm/model/moe/experts.py sha256=Ae1oehO_moKZYCrFOB5Itx-twvB3QH7qr0MCfW7LU_4 2762
internlm/model/moe/gshard_layer.py sha256=UoGsXRuiT5H2Rdyt6i0d8ddMLA8SygsRtfZiGScq-7A 20335
internlm/model/moe/moe.py sha256=J3_322kvIuJ_d3RfphuD5qoXk-X4n9vQBqtPLIwJSr4 4848
internlm/model/moe/utils.py sha256=gYHiwC-5wOZ8JvBaNBdKiFaunFrrf8T9eptIDjKWSr0 2021
internlm/model/moe/megablock/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
internlm/model/moe/megablock/megablock_dmoe.py sha256=uHIKLvEUaGeBxlAfpWFFZ6aAsZw7EMWFUjGYAfymXIg 8669
internlm/model/moe/megablock/megablock_moe.py sha256=r8MZ3XkQ_UYgBHf_bYfLhJepPAXz_qGP0lBCp1JZNkc 13597
internlm/model/moe/megablock/mlp.py sha256=NzZgdMhOWagD_LJ8WER3q3625O-4334jFjC9glgwVLQ 2563
internlm/model/moe/megablock/utils.py sha256=n19NG0E0ufrvkbe7LOHDIz26BB6brPeW3XSGk-yh2nU 11288
internlm/model/ops/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
internlm/model/ops/attention.py sha256=W3TPeXAHMEDpcFiBJSvJvVjQMaNX1pgOj25D90oc4LA 33645
internlm/model/ops/cross_entropy.py sha256=iOou0oVjUpTLZmyMkdQONvbbxuI-Mb6FhDtPLuMxmAU 2084
internlm/model/ops/linear.py sha256=Th7NUE5A5HGTjiHr0pXvo-S3Fcv25gmIIW-yqpsQynM 2400
internlm/model/ops/norm.py sha256=MIQfuPHY7dNaHxDu5-SYVhipf_3lV2Wjm1GdXW_HKto 2489
internlm/model/ops/rotary_emb.py sha256=fRJZB47mPAYgRey5Iy2tNhh9_Vj1gaVzmq9vkwijLS0 5346
internlm/model/ops/utils.py sha256=u45dpicqrEatZcPEDEylfX4q2FkZnPs7dExiU1TldqM 1670
internlm/monitor/__init__.py sha256=y5lOzdP4ZQySNZMxy6pEXYu52_eYkVMpmablH7TpVXI 193
internlm/monitor/alert.py sha256=M2YUoJU6rmq_1e6VMrz7owrp2-6zpwSgrhjtsEAFlLY 1479
internlm/monitor/monitor.py sha256=QGdPPbPLPcbr1a_P5vYsiPXoTt2wou_FOyMjanz5-Lc 10213
internlm/monitor/utils.py sha256=LIphs4ZdRapPc337rLNKV4KZ-FqTE6_X7q45to5pN1M 776
internlm/solver/__init__.py sha256=eOLFsccL2poDAfxNDYjfBAq8mCw0dXaP0Op6fFjS1WY 252
internlm/solver/activation_checkpoint.py sha256=pXfwMnUWjlut8VYKo1EwF_ls39ZNG_v5PauoYY23l08 10095
internlm/solver/optimizer/__init__.py sha256=vM_SIKMSrVc7argyJidHwBLqOLQZgUJgZwVN2ajagxA 252
internlm/solver/optimizer/base_optimizer.py sha256=FJPJkJqrWFTnCWblzbbd8z39cvEICNKq3zP4cUEkTn8 1080
internlm/solver/optimizer/compatible_adamw.py sha256=2ElWF559fMF4p4946gqgQsYdvYZDJxLO9ZOZOPXexag 1946
internlm/solver/optimizer/fsdp_optimizer.py sha256=PcK0wC1yjZWrBbQsQBoLoKjuzrOO2jhfFxdxlrNSJz0 9173
internlm/solver/optimizer/hybrid_zero_optim.py sha256=QraEkmXox3NL2bfnozxpjdMMB71PFAsNgb8lRF43c8w 42554
internlm/solver/optimizer/store.py sha256=7JHuFT2E68lYvxknX9f2sDtb0q0N_Wcv008JHapXT54 10132
internlm/solver/optimizer/utils.py sha256=hQumAfIi237kNKhBSiH32x-j6AIvvR3pgKsCDdZMEpU 20351
internlm/solver/schedulers/__init__.py sha256=6fU1hGFWnlHIV-hqd27gG-mhRGXHcmSNvU-COYGiFBg 272
internlm/solver/schedulers/beta2_scheduler.py sha256=AuENoRuov3o93ZGDd840BPzO0Q27Kt3EkRMaQk2k0SI 844
internlm/solver/schedulers/lr_scheduler.py sha256=y5DKUlk1_Qz33YK-tcWOg5g-wQNMZcdPewKxV-kYTcY 5940
internlm/train/__init__.py sha256=APTyPSfxEFChsBmQ8I4F30XWVyo_zAzC0UBYOuZKflE 601
internlm/train/pipeline.py sha256=x2QBbUf_6QE2epMr9v6KiwTxIClB--rPpsIExERtaxc 26101
internlm/train/utils.py sha256=rNbdAc2MLtdU8SHnt9GdGtD2DoqF3nxXfz6CimCqfvM 3575
internlm/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
internlm/utils/common.py sha256=jNm97fGRLIjNxVHhYM4l9EM4sDWMboXUS4bLtgh1loU 7964
internlm/utils/gputest.py sha256=cMLHrgqT8kKft0ruWQxtJtoWATL0I9NchQI5OkOYj2A 6321
internlm/utils/logger.py sha256=klcZzchIFatrh3-BlfW9KjlPYJdFmF6s7aC-cCg8qpg 2112
internlm/utils/megatron_timers.py sha256=0MhARYCPlAz2-0GBYcq-Lu0SLWXJUGinvemjjsYIA38 4156
internlm/utils/parallel.py sha256=l_PQ3LDZmhVc7vYXLALPL_YgC4Tr9Nta2PfvIj-1hps 3953
internlm/utils/simple_memory_profiler.py sha256=WbIVp5daDwwzKkeNPu0MYcs8smA6y3HA1gQk5imgbBI 24734
internlm/utils/storage_manager.py sha256=Qt4MMqmxJPfuqpRBhMlqA5_mnY2L5y9nLtmguFYN8H4 46133
internlm/utils/timeout.py sha256=qDj9o25YlHIUrYQDG1GALJ3KAoIovne2770-lpN2IM0 3126
internlm/utils/utils.py sha256=cO82Qd1LgIcyag-6lXkerWV60Fe6gBRJn1dLT1SMtUY 4032
internlm/utils/writer.py sha256=-aWsE533uMM9mF67CEW0u9sgvHptwznQUTkuju9SN8w 7117
tests/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tests/common_fixture.py sha256=Ourm-pxNi0P8n-M8XmgoGxHX_WkUy-Ja5GmsVfzRin0 4526
tests/test_core/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tests/test_core/test_pipeline.py sha256=C01_w9Mua9MJUmOi-7oln6fhfb1EsdxqFducqEeDH9k 5841
tests/test_core/utils.py sha256=pfeKmREuWS6PoMcweWxfPNF72QL9iyyx9dZH6es5Duc 6968
tests/test_training/7B_check_acc.py sha256=dZov-m6J9FvPPUellVYdfW982oX0ZIfW98f_KJuzQK4 5750
tests/test_training/7B_check_init.py sha256=WTsMKQDBs7f16mrasRIsoarv4LhwzGcq3AO21YIBwiY 6360
tests/test_training/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tests/test_training/test_forward_output_no_fa.py sha256=3qq0_YzNt9DDXtBKZjkjXS0rJPcw9TVXWwrjPmS6Bmw 8054
tests/test_training/test_load_ckpt_loss.py sha256=MADJxxm4VA0HjaGHf5jsff3eT0JdybWSwS4zxOhvHmE 11809
tests/test_training/test_loss.py sha256=tDdOzNyHX-kfCMA-juKn2Hvb5yiv-S-b9AKgjzGryOc 14426
tests/test_training/test_no_fa_train_temp.py sha256=Q4HCR6A2VhhMc11es8we2Oj6gx6Gp-PEhslsOn4Qo4M 3855
tests/test_training/test_norm_weight.py sha256=yyLFaYpT-Om6woCqbZzsrvUAFvz7kNtESBcIoLxf8tE 6773
tests/test_training/test_swap_nb_loss_and_gradnorm.py sha256=JyzU01_gWCeD-2LzdskoXXsiJkS-5SvVihOAUrdnbVA 12656
tests/test_training/train_CI.py sha256=5v_AfWLWt15cMOTft596yXK6LtqbDliyPh973em3OO0 14290
InternEvo-0.5.2.dist-info/LICENSE sha256=-Gmt5wlfbmbTbRccP4ExpQtDna8DZ7QENUaoy_OAd1w 13656
InternEvo-0.5.2.dist-info/METADATA sha256=PvBThblq5SsmwlJDMuPBQVSPE-p7_BN78E0qDYlvk_k 5608
InternEvo-0.5.2.dist-info/WHEEL sha256=yQN5g4mg4AybRjkgi-9yy4iQEFibGQmlz78Pik5Or-A 92
InternEvo-0.5.2.dist-info/top_level.txt sha256=oxdRxuFYmuxbIJanqjDGMm7Kpyf4sSAWJIa6Q3AY_8M 15
InternEvo-0.5.2.dist-info/RECORD — —

top_level.txt

internlm
tests