zgl-streaming

View on PyPIReverse Dependencies (0)

0.0.1 zgl_streaming-0.0.1-py3-none-any.whl

Wheel Details

Project: zgl-streaming
Version: 0.0.1
Filename: zgl_streaming-0.0.1-py3-none-any.whl
Download: [link]
Size: 262487
MD5: 66035ac5910e0f92382d25290e2e6bc3
SHA256: 0646bba877e399f2457a159384dba42ac3e4eedd6b7bbea489e49877e95326dd
Uploaded: 2024-09-12 20:00:11 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: zgl-streaming
Version: 0.0.1
Summary: Streaming lets users create PyTorch compatible datasets that can be streamed from cloud-based object stores
Author: ZeroG Labs
Author-Email: chris[at]0g.ai
Home-Page: https://github.com/0glabs/zgl-streaming
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Python: >=3.9
Requires-Dist: boto3 (<2,>=1.21.45)
Requires-Dist: Brotli (>=1.0.9)
Requires-Dist: google-cloud-storage (<2.11.0,>=2.9.0)
Requires-Dist: matplotlib (<4,>=3.5.2)
Requires-Dist: paramiko (<4,>=2.11.0)
Requires-Dist: python-snappy (<1,>=0.6.1)
Requires-Dist: torch (<3,>=1.10)
Requires-Dist: torchvision (>=0.10)
Requires-Dist: tqdm (<5,>=4.64.0)
Requires-Dist: transformers (<5,>=4.21.3)
Requires-Dist: xxhash (<4,>=3.0.0)
Requires-Dist: zstd (<2,>=1.5.2.5)
Requires-Dist: oci (<3,>=2.88)
Requires-Dist: azure-storage-blob (<13,>=12.0.0)
Requires-Dist: azure-storage-file-datalake (<13,>=12.11.0)
Requires-Dist: azure-identity (>=1.13.0)
Requires-Dist: zerog-python-api (>=0.1)
Requires-Dist: AliPCS-Py (<1,>=0.8); extra == "alipan"
Requires-Dist: AliPCS-Py (<1,>=0.8); extra == "all"
Requires-Dist: GitPython (==3.1.42); extra == "all"
Requires-Dist: PyYAML (<7,>=6.0); extra == "all"
Requires-Dist: altair (<6,>=5.1.1); extra == "all"
Requires-Dist: databricks-sdk (==0.29.0); extra == "all"
Requires-Dist: datasets (<3,>=2.4.0); extra == "all"
Requires-Dist: docformatter (>=1.4); extra == "all"
Requires-Dist: docutils (==0.17.1); extra == "all"
Requires-Dist: fastapi (==0.112.0); extra == "all"
Requires-Dist: furo (==2022.9.29); extra == "all"
Requires-Dist: huggingface-hub (<0.25,>=0.23.4); extra == "all"
Requires-Dist: humanize (<5,>=4.7.0); extra == "all"
Requires-Dist: jupyter (==1.0.0); extra == "all"
Requires-Dist: mosaicml-cli (<0.7,>=0.5.25); extra == "all"
Requires-Dist: moto (<6,>=4.0); extra == "all"
Requires-Dist: myst-parser (==0.16.1); extra == "all"
Requires-Dist: nbsphinx (==0.9.1); extra == "all"
Requires-Dist: omegaconf (<3,>=2.3.0); extra == "all"
Requires-Dist: pandas (<3,>=2.0.3); extra == "all"
Requires-Dist: pandoc (==2.3); extra == "all"
Requires-Dist: pre-commit (<4,>=2.18.1); extra == "all"
Requires-Dist: pyarrow (>14.0.0); extra == "all"
Requires-Dist: pydantic (==2.8.2); extra == "all"
Requires-Dist: pypandoc (==1.13); extra == "all"
Requires-Dist: pyspark (<4,>=3); extra == "all"
Requires-Dist: pytest-cov (<6,>=4); extra == "all"
Requires-Dist: pytest-split (==0.9.0); extra == "all"
Requires-Dist: pytest (==8.3.2); extra == "all"
Requires-Dist: pytest-codeblocks (==0.17.0); extra == "all"
Requires-Dist: sortedcollections (<3,>=2.1.0); extra == "all"
Requires-Dist: sphinx-argparse (==0.4.0); extra == "all"
Requires-Dist: sphinx-copybutton (==0.5.2); extra == "all"
Requires-Dist: sphinx-tabs (==3.4.5); extra == "all"
Requires-Dist: sphinx (==4.4.0); extra == "all"
Requires-Dist: sphinxcontrib-applehelp (==1.0.0); extra == "all"
Requires-Dist: sphinxcontrib-devhelp (==1.0.0); extra == "all"
Requires-Dist: sphinxcontrib-htmlhelp (==2.0.0); extra == "all"
Requires-Dist: sphinxcontrib-qthelp (==1.0.0); extra == "all"
Requires-Dist: sphinxcontrib-serializinghtml (==1.1.5); extra == "all"
Requires-Dist: sphinxcontrib.katex (==0.9.6); extra == "all"
Requires-Dist: streamlit (<2,>=1.26.0); extra == "all"
Requires-Dist: toml (==0.10.2); extra == "all"
Requires-Dist: uvicorn (==0.30.5); extra == "all"
Requires-Dist: wandb (<1,>=0.15.5); extra == "all"
Requires-Dist: yamllint (==1.35.1); extra == "all"
Requires-Dist: databricks-sdk (==0.29.0); extra == "databricks"
Requires-Dist: datasets (<3,>=2.4.0); extra == "dev"
Requires-Dist: pyarrow (>14.0.0); extra == "dev"
Requires-Dist: docformatter (>=1.4); extra == "dev"
Requires-Dist: jupyter (==1.0.0); extra == "dev"
Requires-Dist: pre-commit (<4,>=2.18.1); extra == "dev"
Requires-Dist: pytest (==8.3.2); extra == "dev"
Requires-Dist: pytest-codeblocks (==0.17.0); extra == "dev"
Requires-Dist: pytest-cov (<6,>=4); extra == "dev"
Requires-Dist: toml (==0.10.2); extra == "dev"
Requires-Dist: yamllint (==1.35.1); extra == "dev"
Requires-Dist: moto (<6,>=4.0); extra == "dev"
Requires-Dist: fastapi (==0.112.0); extra == "dev"
Requires-Dist: pydantic (==2.8.2); extra == "dev"
Requires-Dist: uvicorn (==0.30.5); extra == "dev"
Requires-Dist: pytest-split (==0.9.0); extra == "dev"
Requires-Dist: GitPython (==3.1.42); extra == "docs"
Requires-Dist: docutils (==0.17.1); extra == "docs"
Requires-Dist: furo (==2022.9.29); extra == "docs"
Requires-Dist: myst-parser (==0.16.1); extra == "docs"
Requires-Dist: nbsphinx (==0.9.1); extra == "docs"
Requires-Dist: pandoc (==2.3); extra == "docs"
Requires-Dist: pypandoc (==1.13); extra == "docs"
Requires-Dist: sphinx-argparse (==0.4.0); extra == "docs"
Requires-Dist: sphinx-copybutton (==0.5.2); extra == "docs"
Requires-Dist: sphinx (==4.4.0); extra == "docs"
Requires-Dist: sphinx-tabs (==3.4.5); extra == "docs"
Requires-Dist: sphinxcontrib.katex (==0.9.6); extra == "docs"
Requires-Dist: sphinxcontrib-applehelp (==1.0.0); extra == "docs"
Requires-Dist: sphinxcontrib-devhelp (==1.0.0); extra == "docs"
Requires-Dist: sphinxcontrib-htmlhelp (==2.0.0); extra == "docs"
Requires-Dist: sphinxcontrib-qthelp (==1.0.0); extra == "docs"
Requires-Dist: sphinxcontrib-serializinghtml (==1.1.5); extra == "docs"
Requires-Dist: huggingface-hub (<0.25,>=0.23.4); extra == "hf"
Requires-Dist: sortedcollections (<3,>=2.1.0); extra == "simulator"
Requires-Dist: streamlit (<2,>=1.26.0); extra == "simulator"
Requires-Dist: altair (<6,>=5.1.1); extra == "simulator"
Requires-Dist: omegaconf (<3,>=2.3.0); extra == "simulator"
Requires-Dist: PyYAML (<7,>=6.0); extra == "simulator"
Requires-Dist: pandas (<3,>=2.0.3); extra == "simulator"
Requires-Dist: wandb (<1,>=0.15.5); extra == "simulator"
Requires-Dist: humanize (<5,>=4.7.0); extra == "simulator"
Requires-Dist: pyspark (<4,>=3); extra == "spark"
Requires-Dist: mosaicml-cli (<0.7,>=0.5.25); extra == "testing"
Provides-Extra: alipan
Provides-Extra: all
Provides-Extra: databricks
Provides-Extra: dev
Provides-Extra: docs
Provides-Extra: hf
Provides-Extra: simulator
Provides-Extra: spark
Provides-Extra: testing
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 15425 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.44.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
simulation/__init__.py sha256=TTUsyYoqhI8RbJZaFeQwXYFC7bjWojMyXMSbKDi4_tQ 171
simulation/launcher.py sha256=J_inDC4LFYg8FHhOtz_jxP9KuHcQ56_jPUUymUIa6aM 469
simulation/core/__init__.py sha256=9IHLmUrQxkgn4XAG0v0E0YY9Bl7F_imyD4JFvmSfFJU 147
simulation/core/create_index.py sha256=_Dw4zJpYrPUDc6VgYlW0ipf-9lBzg0zFMAPthQChfRQ 2591
simulation/core/last_used_ordered_set.py sha256=Y_tTs3t4QCRsgREsx8n8e2wPrz33cJNYXuO4pIT5CpE 1167
simulation/core/main.py sha256=Hdq_7pvCDTqUAXxkeNYOK2CQs1_BSVmb8btyQ2wVLVY 12067
simulation/core/node_tracker.py sha256=YXYitxQRyl8X3tyHjTs5geN_vflgmFWy6hgVAgPER-8 9532
simulation/core/shard_downloads.py sha256=JvqjJE-3OlVErOYs7GYXfT7Wsuw3TGfxvLMJS_IZSO0 7518
simulation/core/shuffle_quality.py sha256=7zeN_g7fOVZUYYEwkq9pApLBkExeJWwKUBtMBDqBQXM 7248
simulation/core/sim_dataset.py sha256=kK8iy9J336H2dCbAe2y9O7GKSNcBCr3STxvOeKq2L_A 25080
simulation/core/sim_spanner.py sha256=8DeLN76bY4BefarOkU00VAZVLeBR-7JskQZ4ObpxyoI 1275
simulation/core/sim_time.py sha256=hdZg3mwVJldYN1It8T5Eode4Y1i5iKKHlKd4-OVuDDE 10970
simulation/core/sim_world.py sha256=c4i9VcBD3gXJLmydFZSqBY6HxSuJZB2yqjX2LBXBGi4 1937
simulation/core/utils.py sha256=oRf57PU4xRm8aRQW_2nr01KNIo1V-BdcM1TonJNuYcM 6111
simulation/core/yaml_processing.py sha256=9XXhTYEXVYeBQKaoJ8p4wnI4jxdmBVQ-rkw3xOkILTo 9397
simulation/interfaces/__init__.py sha256=MundlunCh_FGbBoQEvnWNvnkUzxZbrMWKHl7p5UMqrs 131
simulation/interfaces/interface_utils.py sha256=nPz-0hNLirMBJfA-CSa-1R0EghWFRKgyuo2zqeVSFhE 4469
simulation/interfaces/sim_cli.py sha256=hNts5Svvwusvy_T5sidu0tvdVzh-sZKHqkflYCkIJ94 5690
simulation/interfaces/sim_script.py sha256=HoH0qq7I-d8hT6kXpGchNJj-gSJfy-cgX_fuOX34mWg 5162
simulation/interfaces/sim_ui.py sha256=aCBeeopufDuvXaXStuZYH1annwVRqhK29ya-OiLjXLQ 21816
simulation/interfaces/widgets.py sha256=uHxd18Cg_ucKWFa-B5orDKS3XEzkudqA_g6tbLFBJ5I 23561
streaming/__init__.py sha256=u8q3XKtDm-Gu8Tk1hWdboNRh4V_1EGNRgU2Nkcaqtag 708
streaming/_version.py sha256=lGENNLckZ1uiX7vl0wM0NJla5bmoYibkLLnzhWIFcqw 140
streaming/py.typed sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
streaming/base/__init__.py sha256=KxHSCWf8qANqk9VopjPg8ZEQCOYFdDmpvCvGs7dVClA 599
streaming/base/array.py sha256=R_wTyXFsZmyGOBdSmRjEM7yQ3UR9Ut6JMaqXwZEyeSU 3109
streaming/base/compression.py sha256=TcIOEaq1AUF5vDFbHMIYwMNLhaAqJDlehfe4j0RkjaI 6277
streaming/base/constant.py sha256=aJFJBGC7PIvoy9x02rMv-m__lpyJDsikiyu9Qh509aY 660
streaming/base/dataloader.py sha256=nPl_0fjYDNZ6Rv_Y6PqV4Z17PZ-SmkC-i7NGn1sVvh0 3574
streaming/base/dataset.py sha256=n5OFXeNhAOpAi_eboQvEoXvgcVzvxyIaqGZEXNjWua8 68917
streaming/base/distributed.py sha256=eeypFyi8P7hfcQSg834Sgk_Ka9YC0xfiSU6DZlTNiRQ 3929
streaming/base/hashing.py sha256=2irh1oPMUdGdzpbrP6IL9lN2_NKleboU9jaDJBLhxR0 1611
streaming/base/local.py sha256=E2S4PJ2rZ-oIce97sc_rQ4x0yXy8WG3WQKErl-Vw1mc 2268
streaming/base/sampling.py sha256=4YDQ8hO3q9od_hagzL5DAQ8WNB8DiPj_zaKhPQrxkIY 3137
streaming/base/spanner.py sha256=TCW7fEUVQ1etx6BqIB7dIFmlyHgRNTUr8SPjr4kNnFY 2261
streaming/base/stream.py sha256=6MjmwPzz1ZK-Z3YQVvBIUeAg6Hn3n8pmZUwBbbSU8o8 23511
streaming/base/util.py sha256=7bwht3TgYwqXRc3duzy9mbabs3EaP8HNdAusnq053XY 20472
streaming/base/world.py sha256=H3FMcUqijKOjadty40HXvDQRukUo25PZFMkW8BbICdw 5465
streaming/base/batching/__init__.py sha256=OnFiX-ew1CA7Ya2wTbhDVybjGyUsmfRaYVwNDQtmsBE 1788
streaming/base/batching/device_per_stream.py sha256=nhst995uoma_r56Tv1QZlhgn51I-BEIah_ho9lwQQKQ 13143
streaming/base/batching/per_stream.py sha256=TWE700oKFEOSBH5PeOAR2sLnsSPeuZTHy_NvOKAchz4 8619
streaming/base/batching/random.py sha256=Szsg55AkWKFOeOYbyorOTx7wh6-fIboCv-5QfPMvNkA 3468
streaming/base/batching/stratified.py sha256=FUYQb_d6byjg4X-z2mnczVcTJJSgmk13s334XtkpmXs 10534
streaming/base/converters/__init__.py sha256=pyj82q44XkqJ11GRVrsmJ50h6SYN9iOQ3oornPv54pQ 543
streaming/base/converters/dataframe_to_mds.py sha256=8UexCpgHzC2qywVNw5CBe7UCbsVE4VJ_ZbSiLDGo6xg 12427
streaming/base/format/__init__.py sha256=IbX2guqIx9a40CUXi5cNBVR_pHIbn0YdMNYOsYLew38 1343
streaming/base/format/index.py sha256=VWVTqkacrUzfHYviitDipJY0GKJrUPFNLfOKHMbo58c 337
streaming/base/format/base/__init__.py sha256=xc1WOxxX-hVLTrrAkSmIHrw9gLwqjhKboan79DBRrxA 235
streaming/base/format/base/reader.py sha256=7yvZz3MG2CHS5Wt6OjU0KK3--79_vbAKgBf8FoecO4U 13617
streaming/base/format/base/writer.py sha256=bQJYSG7llCEyR5KbylrDbUTzeXgx_R_eQGDiGAlYsBg 23780
streaming/base/format/json/__init__.py sha256=_nAFD4zlZ_gexzdyY2RvUdTz8EAjqNz1qmxuDaOKqsA 302
streaming/base/format/json/encodings.py sha256=ZrPdB_KPQgk418j91BfgHOBOOMS99lFjb9_R7EAV8zA 1965
streaming/base/format/json/reader.py sha256=-YgYEm-933yTcSPDUvLXGd--TjEC3tolOC3HGVhrdg4 4380
streaming/base/format/json/writer.py sha256=SILVVv9CylOetDhPPJWoKHQCihPBetetdAL5pBvD5fk 5071
streaming/base/format/mds/__init__.py sha256=GB5pVhlsibAgpN1FHZlrdrHkdx0N-5uVmnf6yq-UeLc 295
streaming/base/format/mds/encodings.py sha256=_8tP_24EtHK99vUieV2Mqws6e4ky5hLNV9T1i9Vt430 17025
streaming/base/format/mds/reader.py sha256=jL4HIUiQt-0gUjHdr_mcKhm9G7L0eCGZfor32_FWMWk 5631
streaming/base/format/mds/writer.py sha256=SF8LoXAVsJdmTBBKFrZf6u5LI8_1pTA4YonZtGeb158 6344
streaming/base/format/xsv/__init__.py sha256=XLRbUGz8B8QkO6CAHjTGRCWpoSKCIfacqgg7jkwS2OI 395
streaming/base/format/xsv/encodings.py sha256=7dKLjc8_GW03b3vfBqjclRabxE6hCCMxPTNJoNUXlgc 2847
streaming/base/format/xsv/reader.py sha256=NzeF7ZdOBfryHrZPbkMIDVkFS6p2lp9AIQqFQChAEWc 10411
streaming/base/format/xsv/writer.py sha256=WN_qxTHZhOLtLXWBl6aAJmuFjTQaqcY-0qCy5WUWRiY 12002
streaming/base/partition/__init__.py sha256=3Sb5Q6XxvWPoKAEODI3g38yX2HQ3Oz7eQ48QGXV99Jg 3075
streaming/base/partition/orig.py sha256=m30fhFBFCgVfKRfWZSQUP5YCZPrgzMWYFtSdzoIFqQw 9305
streaming/base/partition/relaxed.py sha256=C_UnoGV8W1lpOxSr7zukZfYBIHVZ2rcvNZsqngGxmQg 5517
streaming/base/shared/__init__.py sha256=aY3C-hbcQSY-Igc9lk1j6NAzqjyPRVE-7JZ57KhCX34 814
streaming/base/shared/array.py sha256=u43d7uo40qqVnCo8a6svoaN7Ab2daUC6au_TUk-YA-o 2037
streaming/base/shared/barrier.py sha256=MZUgViV0E9o8Ta4lTYlvEV8U8PNhyHs0hb47253mGl8 3819
streaming/base/shared/memory.py sha256=vNbAnVVpHPswJQlFIJuz4gS6Bw-zoyFSAXlDzOC1SNc 4960
streaming/base/shared/prefix.py sha256=YRTLsWdyyte6tt-E2J5reJ2A_YADdjGaqblmQAVWZbI 7941
streaming/base/shared/scalar.py sha256=qUNgJPbIX9CTSIUXYmjkEyzCcTI_YvvGdMixs4VXoqo 893
streaming/base/shuffle/__init__.py sha256=rjaW7oQSuGofX90_jvuNxhpZHKoA9qXpHZng4jobFck 1946
streaming/base/shuffle/naive.py sha256=QcTLIKXB-yAQpL1tCNy6UCl9v--cK9bngm6xH-Vu6hg 1662
streaming/base/shuffle/py1b.py sha256=nVifNyj_MIK3nak3LGCEvbTNHFifnu02XnBeuRy-9Og 3318
streaming/base/shuffle/py1br.py sha256=OCmkVN4HgU05LArUHhTfAYSsEYOX7wqIbgTFLalpgwg 4343
streaming/base/shuffle/py1e.py sha256=9ffQCRDG9GSgEJAcfybtTup2oxJcjFoIIflsyFXNARQ 7052
streaming/base/shuffle/py1s.py sha256=qn0M-5eAij17p5A26mGGTSHj0YfgkPuEx64d28Deuu4 5345
streaming/base/shuffle/py2s.py sha256=HaOefd81gEeU3alnxqbzdh42qeorddNmh-tGbztIUuE 5005
streaming/base/storage/__init__.py sha256=S5WS1Fm33SCchqJrt3LEyS8IHF5FJWqHEsiJDB93x9Q 1330
streaming/base/storage/download.py sha256=W2tNb1F-P40_AOsgGt0ouMcs5iYNZZdYcErBCREfkBU 23961
streaming/base/storage/upload.py sha256=-thU1HMUseXB8PpHc05AqBzjtcS8JzOefVm6YvFgbug 59754
streaming/multimodal/__init__.py sha256=1MBe6epqSy4yerkPmYiwVQ8_yXVoCLCl0K5j8_BEdXg 408
streaming/multimodal/webvid.py sha256=yxYxARFyypicsneSd_9RDDfjoh3wpKIEWLh4atID87I 21444
streaming/multimodal/convert/__init__.py sha256=-4DIieCt4LbA3EOvUBGW0ne_m4d95Ev5htZY-kLVYQE 157
streaming/multimodal/convert/laion/__init__.py sha256=hc0tLBZuuTF3EqMb8zAwdsyiTfJpTSMsF8nS0i0LXX0 118
streaming/multimodal/convert/laion/laion400m/__init__.py sha256=t9w_S1YjNBJPv_ZNZiwUA2hKdkU745Hb3K_RHwO0SIg 123
streaming/multimodal/convert/laion/laion400m/convert_and_upload.py sha256=Jt2FUtXsL5JVwfx8oZwrifPvA1q5jH9r06FqKcA4lZs 9352
streaming/multimodal/convert/webvid/__init__.py sha256=L5CMfi9Hwcv6jQT7ZT0d33_FlolIu0xZKhf7y8Rhb5I 119
streaming/multimodal/convert/webvid/crawl_webvid.py sha256=YXoXb6NEJ2GMrlqKukyGJnrL5LmLJgtfnraxLKGtWWQ 4309
streaming/multimodal/convert/webvid/crawl_webvid_subsets.py sha256=459QNmSanpksk-1qb8ykZ6oOgXDEzwg5OSV0Jr6Z19M 6665
streaming/multimodal/convert/webvid/extract_webvid_videos.py sha256=Lm_5cB07IAqgYDfMXIFKldOd2d_93ydhoyFv1-FPrSc 2589
streaming/text/__init__.py sha256=5EKW8iAKiMz8Bqa7ZqR6usOVGSRh1C-n89EyTuSw2Es 380
streaming/text/c4.py sha256=P1WHkQJew2fOsVU8BnC2MoJlZ5Ovts_luNu_upQSydM 8435
streaming/text/enwiki.py sha256=Ff47Iaa2ltTmlN5VJNfPAgn4JJc0rQRU4tXN7JE9agA 7379
streaming/text/pile.py sha256=TOQ45rsvMHJYD3UZBpL6V-E-P1rRtkUtkKQ4zJz8kpY 8366
streaming/text/convert/__init__.py sha256=HdhWUBs8F0HePR8YZa0mydvO_iAfSh4fTldDbDhb0_Q 151
streaming/text/convert/c4.py sha256=ineCN2Ndb21SYv1GPzWLlNadgM19eykcxLtdvNq8fpQ 5038
streaming/text/convert/enwiki_text.py sha256=WFYxlWe47M_8tBZ46ASCSoEYDY0GzNXQLlYoaDCV6AQ 3919
streaming/text/convert/pile.py sha256=fcmfKmpsqRZQrvXOk7RRmnczUR95SnAvIAObI4ezvaY 7175
streaming/text/convert/enwiki/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
streaming/text/convert/enwiki/mds/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
streaming/text/convert/enwiki/mds/create_pretraining_data.py sha256=3sw0Ymk1RSJ2bfni8V01YVre59nmnO2m8bdp_Ih8aFA 15176
streaming/text/convert/enwiki/mds/make_train_parallel.py sha256=ESAUYrHToLGGF887VeZEPoLcHEN-pk8uHZ_zvGJNZ0g 5148
streaming/text/convert/enwiki/mds/merge_shard_groups.py sha256=ou_J1wmeI0gBt34zalc6apvnNDF4elc8OwZeLYAvTG8 2302
streaming/text/convert/enwiki/mds/pick_eval_samples.py sha256=fRM_Q91wi5lTW2NagXMZiNvm0KEmzCAgdmkLU4XsC28 2106
streaming/text/convert/enwiki/mds/tokenization.py sha256=jJDBjyulSrcd45KX-dJmel9qXAa42Jb9A9-L6BFePPg 12473
streaming/text/convert/enwiki/tfrecord/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
streaming/text/convert/enwiki/tfrecord/count_samples.py sha256=ShHtZYfAcll4BavlfJtEhw_IdqU4XumJtfia97vbeiw 799
streaming/text/convert/enwiki/tfrecord/create_pretraining_data.py sha256=Dfpsz2veXoPtvVzizxIRV-MHhaFvugwhCFFItj7eIew 14632
streaming/text/convert/enwiki/tfrecord/make_train_parallel.py sha256=Q4qvPIe5QuXZM0OWMqvc13wWT-M_KR6yFuIAk-vuMlM 1239
streaming/text/convert/enwiki/tfrecord/pick_eval_samples.py sha256=VKZSs3LN0PzapFnQaYsyY4vbD7KAhiA7A_sI3Da1DKA 3829
streaming/text/convert/enwiki/tfrecord/tokenization.py sha256=jJDBjyulSrcd45KX-dJmel9qXAa42Jb9A9-L6BFePPg 12473
streaming/vision/__init__.py sha256=YtOwgEY-7zppoMvzu2h3YBA7Qp00ZV62FPG6epHiJFU 503
streaming/vision/ade20k.py sha256=igQgwvFut5G74i4pYVMVNXn5uBweTXw2aTBujwnsgNU 7669
streaming/vision/base.py sha256=y7bDkue9ClMDkVaSy89s5GjqNs2Nsi59W86brzU9sfo 8900
streaming/vision/cifar10.py sha256=XCdi6BlmKxgSUNQC3gL_8xqHs9xREaIr2jCNUlgdQ2Q 4768
streaming/vision/coco.py sha256=V_joKEpAo-XW8HESyjbQOP48Hr2WrUjexEILlcFfIxQ 7302
streaming/vision/imagenet.py sha256=XDaTGPX8CaRXmnpG8T0MHYmkGELGDrnVSt9JXjnIwkA 4760
streaming/vision/convert/__init__.py sha256=Z-ehH6K3gkMlyj_h3XcQvHv2t58QAVWiyea6alk2xRw 139
streaming/vision/convert/ade20k.py sha256=LV2lUb18ML57cCJ6FSVeeg2s7CoLbNjikCvZLohXL_g 5848
streaming/vision/convert/base.py sha256=pjs7KV7JwIC6lwWqnNYyDxRrf_87P1ipC9aRkDjZDfc 2647
streaming/vision/convert/cifar10.py sha256=Me9X6eWcnE2u_KEa0imlFKwyku7JI6cePQNhg5X5398 2423
streaming/vision/convert/coco.py sha256=c6eV5hSmE229n7JlOdgs9z9TRkBhKLsuiEuM6nv0uZ8 7651
streaming/vision/convert/fake_cifar10.py sha256=E9uMU5w5wEe7f10u3u7a8J0mYa0BRNoY8agsGmplWks 1498
streaming/vision/convert/imagenet.py sha256=PqG6mdFJ7MnSk0Sdd-2ljxFYJ22k-w3gPG0CUGVzrUE 5005
zgl_streaming-0.0.1.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
zgl_streaming-0.0.1.dist-info/METADATA sha256=96tzaoKOdNvpg6LIhPGRZM5Wt6Gtkuu1IZzPILV4TCs 21530
zgl_streaming-0.0.1.dist-info/WHEEL sha256=eOLhNAGa2EW3wWl_TU484h7q1UNgy0JXjjoqKoxAAQc 92
zgl_streaming-0.0.1.dist-info/entry_points.txt sha256=kqgZPftUU8qoQpMT1yTyiJNJM9lRSrKmkGeJ25NSPpM 71
zgl_streaming-0.0.1.dist-info/top_level.txt sha256=D_eZcq7NZQ4T5bg6_Ecqw8CISIeX1DeEp-9nyrcG2sg 21
zgl_streaming-0.0.1.dist-info/RECORD

top_level.txt

simulation
streaming

entry_points.txt

simulator = simulation.launcher:launch_simulation_ui