Wheelodex » Projects » dlio-benchmark

dlio-benchmark

View on PyPI — Reverse Dependencies (0)

2.0.0 dlio_benchmark-2.0.0-py3-none-any.whl

Wheel Details

Project: dlio-benchmark
Version: 2.0.0
Filename: dlio_benchmark-2.0.0-py3-none-any.whl
Download: [link]
Size: 130143
MD5: 89ff032f883094a71d780c9319e33c01
SHA256: 50716778199f83ad67d340a1e36c9e28fa43d2c291047c5e26222592bfad1c03
Uploaded: 2024-08-28 00:32:23 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt · dependency_links.txt

METADATA

Metadata-Version: 2.1
Name: dlio_benchmark
Version: 2.0.0
Summary: An I/O benchmark for deep Learning applications
Author: Huihuo Zheng, Hariharan Devarajan (Hari)
Author-Email: zhenghh04[at]gmail.com, mani.hariharan[at]gmail.com
Home-Page: https://github.com/argonne-lcf/dlio_benchmark
Project-Url: Bug Reports, https://github.com/argonne-lcf/dlio_benchmark/issues
Project-Url: Source, https://github.com/argonne-lcf/dlio_benchmark
Keywords: deep learning,I/O,benchmark,NPZ,pytorch benchmark,tensorflow benchmark
Classifier: Development Status :: 5 - Production/Stable
Classifier: Intended Audience :: Science/Research
Classifier: Topic :: Software Development :: Build Tools
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3 :: Only
Requires-Dist: Pillow (>=9.3.0)
Requires-Dist: PyYAML (>=6.0.0)
Requires-Dist: h5py (>=3.11.0)
Requires-Dist: mpi4py (>=3.1.4)
Requires-Dist: numpy (>=1.23.5)
Requires-Dist: omegaconf (>=2.2.0)
Requires-Dist: pandas (>=1.5.1)
Requires-Dist: psutil (>=5.9.8)
Requires-Dist: pydftracer (==1.0.2)
Requires-Dist: hydra-core (>=1.3.2)
Requires-Dist: nvidia-dali-cuda110 (>=1.34.0)
Requires-Dist: tensorflow (>=2.11.0)
Requires-Dist: torch (>=2.2.0)
Requires-Dist: torchaudio
Requires-Dist: torchvision
Requires-Dist: pytest; extra == "test"
Provides-Extra: test
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 9077 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (74.0.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
dlio_benchmark/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/main.py sha256=3JnC_-MHHp1660V1y9oTVhZvE4vHrisK2GTmAw_M5DA 19367
dlio_benchmark/postprocessor.py sha256=KFqw9XqHp4dFwzA2FF7RknTDTQ04MdK7ymz1cHqIj2k 30793
dlio_benchmark/checkpointing/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/checkpointing/base_checkpointing.py sha256=_8VfKipWyp0uEdCKJJT2qCxWn8zpPkFpwIrnjeYMwQA 4165
dlio_benchmark/checkpointing/checkpointing_factory.py sha256=AeFEcUfEBRBb7akKZFv8KWv9lnLAhrSdo8P0sd73_aE 1971
dlio_benchmark/checkpointing/pytorch_checkpointing.py sha256=elAX6aWRKGYPXiZ6HNi1zsf4O59OdD5PMJmbAAuXc3U 1899
dlio_benchmark/checkpointing/tf_checkpointing.py sha256=RniEgESFWOJe9xAAz8ZNTVdEnW-qs8XWEDHX3L6O0N8 1941
dlio_benchmark/common/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/common/constants.py sha256=tZU-2bPjZKKmIdZ9IScDhahUBGYlFADDimKrj0Y_Vnc 942
dlio_benchmark/common/data_structures.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/common/enumerations.py sha256=luVQXdcw9W4h6uxVrLad7S1o9Es0E6KtEoaJR_hnbfY 7372
dlio_benchmark/common/error_code.py sha256=46wndaHXmOp8olkrz8_QWN2JXuLXWISi4XRdl0DxXQ0 1395
dlio_benchmark/computation/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/computation/asynchronous_computation.py sha256=B5XSb5BrXDRArR_VF3D2mPkXEQJKLOHzXmta0H9mRbw 869
dlio_benchmark/computation/computation_factory.py sha256=Uyqks3bDd1Q0FZmsFxYNcFm2gGckf4vLimvrwWU501w 1440
dlio_benchmark/computation/computation_handler.py sha256=tfM7TxohMUEPOhy2aV0O8OciLG0zuHGwNKPHvpN7P48 819
dlio_benchmark/computation/no_computation.py sha256=f4cEfBKPLsE9FsbvJUhiIXtU4sl8YUN00OIENOiRJ7Y 862
dlio_benchmark/computation/synchronous_computation.py sha256=bmK2PqjXPYBPXXy5qcV7Oe7_Xv20_T9zWJwzcg9US2Q 864
dlio_benchmark/configs/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/configs/config.yaml sha256=gTomZAhXmNAHHY1eJSkLqPeZYmQj-AfyFtqpsMIN7yQ 290
dlio_benchmark/configs/hydra/help/dlio_benchmark_help.yaml sha256=4oIwtsJow5eh6uqmgZL8_RV_gnuGaTKE6BC6JKlUh5w 1613
dlio_benchmark/configs/hydra/job_logging/custom.yaml sha256=aK__yJr7WGH_juW3pDhl6uSo_aGl7RuKc8FgA34L5po 280
dlio_benchmark/configs/workload/bert_v100.yaml sha256=9N9jY4GSZsiP1ZdAEhTt114GYUnTggzhblLSOJ-ZcTY 668
dlio_benchmark/configs/workload/cosmoflow_a100.yaml sha256=VUR9jcwILkeXDpULGASz5hyd9eETkoYRgIhev8_fOHs 466
dlio_benchmark/configs/workload/cosmoflow_h100.yaml sha256=vbJDFS4ja0VbVLHgekqEoHagv9rn9cBsRxeluUczSQ8 468
dlio_benchmark/configs/workload/cosmoflow_v100.yaml sha256=BRWq9R1h0oNBdhHx2f2jRTESoJRzt5fvpqx0x9H6LcI 385
dlio_benchmark/configs/workload/default.yaml sha256=qybstZuuzs7q0qDuzo2SJC-tFJYru032yktwfJ6pDIU 563
dlio_benchmark/configs/workload/dlrm.yaml sha256=6uKJ9oUYU0etUwUZ3VEW3liuptWgtZDJBLbwcp3dI44 612
dlio_benchmark/configs/workload/megatron_deepspeed.yaml sha256=ckLIZKH6oTNR4xijbxZj_Cqegw8EPzxaC0kliZLK3kE 850
dlio_benchmark/configs/workload/resnet50_a100.yaml sha256=fTBJwyCcvuDqGVLBUDbmLq-D5YkpiKX5phupBOzBe-E 453
dlio_benchmark/configs/workload/resnet50_h100.yaml sha256=mudHTlYX8DOh2VJ8zcpg-r435UweyyrhK3nHkl0Ntq4 433
dlio_benchmark/configs/workload/resnet50_tf.yaml sha256=jJ7KpZLpjSWmkikX6CBF2LJ30B02BgXpMwZa-0l50wI 398
dlio_benchmark/configs/workload/resnet50_v100.yaml sha256=vNP4RYdoAhFyoc4-NK6zSP_pLynotMaOh44osFsCY5w 451
dlio_benchmark/configs/workload/unet3d_a100.yaml sha256=qGv76cSWJmwheYy-QvdG-JkSSIlc_2zilQEOLNT9zMQ 645
dlio_benchmark/configs/workload/unet3d_h100.yaml sha256=Qac-qtAEVBA7w4GZCniez72fuHzgg4FGAmXemuxmLXU 645
dlio_benchmark/configs/workload/unet3d_v100.yaml sha256=Blop6SI-3fMq0ppAPEz91NGUXxFex-ImDBhWSDWuJPc 625
dlio_benchmark/data_generator/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/data_generator/csv_generator.py sha256=gM38zwYNYITpcTRxCkB2R1k9DSWF6Ja6pElbGLhmG1M 2599
dlio_benchmark/data_generator/data_generator.py sha256=nZFH9iQYwCOoixL_gEb-fWsZ9no4G1JHFoWQq2Ptc5U 5570
dlio_benchmark/data_generator/generator_factory.py sha256=rRpRexhhUoa31r33I31s2bIhJa9AT8ayIG0pVybEnhw 2492
dlio_benchmark/data_generator/hdf5_generator.py sha256=E_wdLtn-xweN59FXLTBIWwVJKr8AUmyXozMk6tPfaeg 3597
dlio_benchmark/data_generator/indexed_binary_generator.py sha256=_VUPT4eE6IRbeBFnAhl6iXRFqa_RqWrB4d3-7HoH-ys 7080
dlio_benchmark/data_generator/jpeg_generator.py sha256=3s7z4jZMCtSDCq4rYj6OBaVnE3WHGNBg3LPchVM32Hk 2291
dlio_benchmark/data_generator/npy_generator.py sha256=wufsQ81undusu6Jg7gi147eRTaDDLUiWJ7tgNyoXfl4 2032
dlio_benchmark/data_generator/npz_generator.py sha256=iNtEAYCw2M08ixLVjzAbNov6pOtAPoyn2dzbZCo9D6M 2208
dlio_benchmark/data_generator/png_generator.py sha256=0vBjuuAQT4nSfyxFrRdwH3JrP9kjG244BgXwjnVBTiA 2281
dlio_benchmark/data_generator/synthetic_generator.py sha256=hHwVGq2MlE3b3edNow5k5a9OlaG84raWAJzWznbdyyE 2002
dlio_benchmark/data_generator/tf_generator.py sha256=5_lqQLqMTY8MIzNQSrM4XvwR0UDrnD4CLwbsR9P9a0o 3764
dlio_benchmark/data_loader/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/data_loader/base_data_loader.py sha256=gouHjxP9TX1W1fUrt46boWakIs7CSveOYIcdSsHQyeY 1807
dlio_benchmark/data_loader/dali_data_loader.py sha256=LPkkGxhKWrudGYsxvokS7v3VYgIiC_Jgkp4-VNenF5g 8027
dlio_benchmark/data_loader/data_loader_factory.py sha256=P_PhQNIrsXbvPrl0ODV0bGtjtZ8xL9WRIsh9LTflVbA 2772
dlio_benchmark/data_loader/native_dali_data_loader.py sha256=I8ws31OZPc75cTbFydIIe_DPpItHeT7-jW9LS662VDU 3164
dlio_benchmark/data_loader/synthetic_data_loader.py sha256=yfzKy7eeScc5IfBvGjgr9RZSuAruzWrCvq-E2aH9bU4 2012
dlio_benchmark/data_loader/tf_data_loader.py sha256=xGM3hffDvFisGhPwCf76UTtjcMXJ2KyN9UmO8f1lHJY 4909
dlio_benchmark/data_loader/torch_data_loader.py sha256=k-tnyu877ITPBc7jBHzy9HBCrpe0YwhCXWD5bJi-O48 7769
dlio_benchmark/framework/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/framework/framework.py sha256=34KVqxQTHqRZ-TWx5i7UtX4_56xtPVvivV-6yfVfpI4 3106
dlio_benchmark/framework/framework_factory.py sha256=6nuF-63YFEe5zjqDTN4H4K_jP45Kd71nM8FAv2JdRfM 1361
dlio_benchmark/framework/tf_framework.py sha256=x7-3hRCK2dPHVj2DBB8Z2d7WWO89XFc32sydtlDnY64 4699
dlio_benchmark/framework/torch_framework.py sha256=AJDIYkNBEcHwoFh8Dj-l_Lagh2SO_kZ7HBYWj-AdQE4 3288
dlio_benchmark/plugins/configs/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/plugins/experimental/configs/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/plugins/experimental/src/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/plugins/experimental/src/checkpoint/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/plugins/experimental/src/checkpoint/pytorch_checkpointing.py sha256=SQB2SEPvzY5hN_TlJSETVEUUV1W-R3cF2gxbvAa9wYk 1860
dlio_benchmark/plugins/experimental/src/data_loader/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/plugins/experimental/src/data_loader/custom_torch_data_loader.py sha256=LcjtHH41YtvWbn2Ee11ClgtaJ0Ilfr3XlakYzjYFMPU 5249
dlio_benchmark/plugins/experimental/src/reader/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/plugins/experimental/src/reader/custom_npz_reader.py sha256=uzY8nn8HJwpeiz11Es6YocQU28AxvnmLDR-n7yxyqIM 1824
dlio_benchmark/plugins/src/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/profiler/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/profiler/darshan_profiler.py sha256=V3fHxgVy-qNl6JqQLD7mn2OaEa7iYycWgfvOIuo28_w 1660
dlio_benchmark/profiler/io_profiler.py sha256=9-7UumRcOl7IFZhFuzmKPHCZYvVY49Z1IlWVVvKZ-lU 1038
dlio_benchmark/profiler/iostat_profiler.py sha256=8mQhCCAq7gji8uvGcPgUX34HsRJif8te-DDzzaukeyU 2844
dlio_benchmark/profiler/no_profiler.py sha256=JmYEhwk4PdX2UDQSzzV4DUmsy0wP4k2C7bgf6GoY1Ck 869
dlio_benchmark/profiler/profiler_factory.py sha256=8dd2advOriKr1B8REEhcDgf0QNsVclbsC7pg6zdNLJ4 1545
dlio_benchmark/profiler/tf_profiler.py sha256=bHrK6Nz0U46i5BJF755I0JUuYI4u_ti7OpeCQvOring 1736
dlio_benchmark/reader/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/reader/csv_reader.py sha256=vWSgSwY8UOPTzkusp-eSAlpulqUZ6X5F3S8dVDmrCjA 1954
dlio_benchmark/reader/dali_image_reader.py sha256=IzRso0AtSoAke5bGM1BeAbxbsdCoK1r47HgoNg-PC1o 3679
dlio_benchmark/reader/dali_npy_reader.py sha256=rCHD0_J8uLbHfhnRp41qScMcgoMCY1ikKgvbqoKeqSo 3789
dlio_benchmark/reader/dali_tfrecord_reader.py sha256=mBdykIYdIKzP7P3uxDRIIcmw2p_w_0upDQ1sQ2BwWAY 4206
dlio_benchmark/reader/hdf5_reader.py sha256=RwXks9I7pSjlIVEovaQXsUoXUBGFfi-5BPEgS7zLU7I 1937
dlio_benchmark/reader/image_reader.py sha256=6X4Gqsg0kUWrvWRekBiDFtjf-Zi4_ODcblT1sz_uwwY 2193
dlio_benchmark/reader/indexed_binary_mmap_reader.py sha256=HYnbBfF0Ms8tduSBgypubTBKORo2CzAfiVX0lUq6oac 4191
dlio_benchmark/reader/indexed_binary_reader.py sha256=GUG2n7vUKUOqvMQCSK3Y6VeRsbNfLBZfHBCx-p6Kmvo 4093
dlio_benchmark/reader/npy_reader.py sha256=goO5PFUGKT-GlahMNjebhnDKzhti50TxomYw5Nyw_m4 1901
dlio_benchmark/reader/npz_reader.py sha256=g8_3--_aB9xk3jtmiOb1gGy0BcLHBGxGdj1-E1OWrCM 1964
dlio_benchmark/reader/reader_factory.py sha256=d5VFevLOo5kzoRZM007jbMXBG6VQNdVBLJY9GVpuFFE 4486
dlio_benchmark/reader/reader_handler.py sha256=x0eT9pMOmk5oXMMpzwvdpX9rmwyAn_Ub8jau3QyGQiA 6019
dlio_benchmark/reader/synthetic_reader.py sha256=9PdKrKpVBkzo2non3aZkgrUYN1Pb8ePBn2no8xbwpDI 1921
dlio_benchmark/reader/tf_reader.py sha256=26af9_uIiDcqe2elPp5w8BSDWvxFTHX7ERW1paimBmc 5047
dlio_benchmark/storage/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/storage/file_storage.py sha256=rCBW5-kdJ-b0Nu-4RpqdF3Le0r6kf7FgAReT8VD3Qjs 3233
dlio_benchmark/storage/s3_storage.py sha256=0HMlU7fyIk96Z3cOIjs2n9F3Di8muqy7np71oPAAfZY 2364
dlio_benchmark/storage/storage_factory.py sha256=4nMfUnwmRB2yGZADDFTHEeY0qY8w7QfpCAyf-G4Ndrs 1305
dlio_benchmark/storage/storage_handler.py sha256=czmpZq6IgFWWP_yw6W2eUv-rBkWIrNFdu5A318CRW80 4522
dlio_benchmark/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dlio_benchmark/utils/config.py sha256=RMeAZSimK3w_kZ_BXJxYOpLyL8VNqKAXWvIKNAbn4sw 29228
dlio_benchmark/utils/statscounter.py sha256=0e7CqMlg492wEqv4ISAMD0yOq1ZFSWA3-xOe-IJtw2M 21084
dlio_benchmark/utils/utility.py sha256=tXXTme2HheAgPVcP41s4-giiMPFzlMVA7onsokrfwlA 10111
tests/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tests/dlio_benchmark_test.py sha256=uI52H8nXo641XZAT_c75arStcpMbMU4Zbq2t4fAyuKs 25820
tests/dlio_postprocessor_test.py sha256=fBagM41GaeSnTn4jCmojfndbSMTRG1nUBKiNTM_enX8 2323
dlio_benchmark-2.0.0.dist-info/LICENSE sha256=HrhfyXIkWY2tGFK11kg7vPCqhgh5DcxleloqdhrpyMY 11558
dlio_benchmark-2.0.0.dist-info/METADATA sha256=9x7GqiSBNkoAe3Yla3J6GhIIFY-Li1OKgI8eGnGsdfo 10765
dlio_benchmark-2.0.0.dist-info/WHEEL sha256=UvcQYKBHoFqaQd6LKyqHw9fxEolWLQnlzP0h_LgJAfI 91
dlio_benchmark-2.0.0.dist-info/dependency_links.txt sha256=lIqrfBDoOR6NZl3El4M3Jxz37gG0EsrenFKIxMOSEMI 90
dlio_benchmark-2.0.0.dist-info/entry_points.txt sha256=rlaCgzkuBlgIc9xmS9P_zhZZglDbVixjiYUyGmZndxc 115
dlio_benchmark-2.0.0.dist-info/top_level.txt sha256=unuBwULQhqa08HVrY6CP9015Ic6mgZofEbvwNcw-h6s 21
dlio_benchmark-2.0.0.dist-info/RECORD — —

top_level.txt

dlio_benchmark
tests

entry_points.txt

[console_scripts]
dlio_benchmark = dlio_benchmark.main:main
dlio_postprocessor = dlio_benchmark.postprocessor:main
https://download.pytorch.org/whl/cpu
https://developer.download.nvidia.com/compute/redist