webdataset

View on PyPIReverse Dependencies (73)

0.2.111 webdataset-0.2.111-py3-none-any.whl

Wheel Details

Project: webdataset
Version: 0.2.111
Filename: webdataset-0.2.111-py3-none-any.whl
Download: [link]
Size: 85514
MD5: 84336f6e7e65b14078a62477667a557b
SHA256: 57a70eb5d7029303ce2262d900ee3f16443bb5e9cf25f634775ce972859bcee4
Uploaded: 2025-02-12 20:12:12 +0000

dist-info

METADATA

Metadata-Version: 2.2
Name: webdataset
Version: 0.2.111
Summary: High performance storage and I/O for deep learning and data processing.
Author-Email: Thomas Breuel <tmbdev+removeme[at]gmail.com>
Project-Url: homepage, http://github.com/webdataset/webdataset
Project-Url: repository, http://github.com/webdataset/webdataset
License: BSD-3-Clause
Classifier: Development Status :: 3 - Alpha
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.10
Requires-Dist: braceexpand
Requires-Dist: numpy
Requires-Dist: pyyaml
Requires-Dist: autoflake; extra == "dev"
Requires-Dist: bandit; extra == "dev"
Requires-Dist: black[jupyter]; extra == "dev"
Requires-Dist: build; extra == "dev"
Requires-Dist: bump2version; extra == "dev"
Requires-Dist: flake8; extra == "dev"
Requires-Dist: imageio; extra == "dev"
Requires-Dist: ipykernel; extra == "dev"
Requires-Dist: isort; extra == "dev"
Requires-Dist: jupyter; extra == "dev"
Requires-Dist: jupyterlab; extra == "dev"
Requires-Dist: lmdb; extra == "dev"
Requires-Dist: matplotlib; extra == "dev"
Requires-Dist: mkdocs; extra == "dev"
Requires-Dist: mkdocs-autorefs; extra == "dev"
Requires-Dist: mkdocs-jupyter; extra == "dev"
Requires-Dist: mkdocs-material; extra == "dev"
Requires-Dist: mkdocs-material-extensions; extra == "dev"
Requires-Dist: mkdocs-minify-plugin; extra == "dev"
Requires-Dist: mkdocstrings; extra == "dev"
Requires-Dist: mkdocstrings-python; extra == "dev"
Requires-Dist: msgpack; extra == "dev"
Requires-Dist: mypy; extra == "dev"
Requires-Dist: nbconvert; extra == "dev"
Requires-Dist: notebook; extra == "dev"
Requires-Dist: papermill; extra == "dev"
Requires-Dist: pip; extra == "dev"
Requires-Dist: pdm; extra == "dev"
Requires-Dist: Pillow; extra == "dev"
Requires-Dist: pre-commit; extra == "dev"
Requires-Dist: pydocstyle; extra == "dev"
Requires-Dist: pytest; extra == "dev"
Requires-Dist: pytest-cov; extra == "dev"
Requires-Dist: pytorch_lightning; extra == "dev"
Requires-Dist: ray[default,tune]; extra == "dev"
Requires-Dist: ruff; extra == "dev"
Requires-Dist: scipy; extra == "dev"
Requires-Dist: setuptools; extra == "dev"
Requires-Dist: torch; extra == "dev"
Requires-Dist: torchvision; extra == "dev"
Requires-Dist: transformers; extra == "dev"
Requires-Dist: accelerate; extra == "dev"
Requires-Dist: peft; extra == "dev"
Requires-Dist: bitsandbytes; extra == "dev"
Requires-Dist: twine; extra == "dev"
Requires-Dist: typer; extra == "dev"
Requires-Dist: wheel; extra == "dev"
Requires-Dist: icecream; extra == "dev"
Provides-Extra: dev
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 13300 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.8.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
webdataset/__init__.py sha256=0NhxBO140EXkOELsP-g39DHzRHlvYOk61ma5JF8XYSc 1656
webdataset/autodecode.py sha256=0bn3l446HN7HQLu-cgO7e7vVI6WJp3TfpkPlxaOCts4 16631
webdataset/cache.py sha256=8z7HJXwrPHKtBUSp6dsjQcHy9-kcSdcPNw2QFU4ktTg 9914
webdataset/compat.py sha256=L7Z_lBaPUHf79HI9vtaFuJDDYNVYxsVXZcdB_TZ3VM0 18668
webdataset/downloader.py sha256=nGQj8PI4Q5y66OPlnDZpEOnYqGbdyAcu0YzU9H8itQ0 12382
webdataset/extradatasets.py sha256=Ui97zWx_gZR1wb8GordQIV61JvflkTxRrgNG5Y1dd84 4482
webdataset/filters.py sha256=pt3JU1AMPmKXND5l2NNw1W_adXWcxilolf0FCAaHZds 33108
webdataset/gopen.py sha256=BxlnGOD_xjQTI1W8Bjt2jzSi-K66zgR4pyOCnGzkUaM 16403
webdataset/handlers.py sha256=G0J5ePhFIUwce867i1xqFwiqyQT443Q2Nr74vVziNkY 1797
webdataset/mix.py sha256=U8BTbm8MNWNoQ-RIB-xe479avAUe3Pb5OKN3_Eb9Stc 3959
webdataset/multi.py sha256=xOWMiXEDGwz8DHVqaqsqeSn_XqXp-M416D1e6fdd-gs 5199
webdataset/pipeline.py sha256=wxPjP8p-VQhMFmV9lnA60uICw_BB6V4G1GryaOPjyw8 6372
webdataset/pytorch.py sha256=6ndutzM7LwE3vrHT2i85dsYiY7Txr-x2T_N_lRUY0tc 741
webdataset/shardlists.py sha256=Jyq5m9MkTM2VNpa7g3PL3lCMZA3Jx-NWTi_sVxzSds4 17873
webdataset/tariterators.py sha256=G1iiaCBVOe6gimE4eu9ZPcH2GJULr8yTpnLo6L9V7o0 9503
webdataset/tenbin.py sha256=H8osFBiW2jz38cC7My1cybuMTPTMr00d6mZN3DAl2HQ 8461
webdataset/typecheck.py sha256=1uwFgUZ_3qWPGOWBCrF1ddfatwpR32ZhzWS7Iokr2No 424
webdataset/utils.py sha256=V6xCYe49Ocel4jFRT3CEkKHJAw1X7sgFqflex0ezuBU 9365
webdataset/writer.py sha256=W0bEgKXHUFZ-iEp7ADWou7G3jsqVx_aylGRsY-2ARJU 17788
wids/__init__.py sha256=KgCjVOaac2_4qmIpGJoiBGduHt2xLQAK92GUan85EsM 303
wids/wids.py sha256=FOh-PRnkVM91f8XNfsKkriM6Vr1Z5MngL3gVSPPDAqs 22924
wids/wids_bench.py sha256=NhF28lRJDNz6FJE0PIXEZ8ju-8o6gPschN-UsZfpoRU 1225
wids/wids_cleanup.py sha256=1GLmrIy-R4L5uBw70_5pi48xcMPsP1oArQ2fvwroYAw 3172
wids/wids_decode.py sha256=XpavnWxjTV9Gy_XH9y2uBCKXWO2zEat3Ctfhk0ICMn0 5341
wids/wids_dir.py sha256=EJWSsH0J7ZBkpQwRj92TU0nLKApLdQFh7xk9kl-Mbj0 647
wids/wids_dl.py sha256=PRbi4a9rvjHeMvI56TB6FSN7t_uc955X_XvT4aHt_NA 4497
wids/wids_index.py sha256=6EAnFectfeK7mdm8YfUI6cqrPEBccP7a-NTYjuua2KY 11802
wids/wids_lru.py sha256=lwV-KkgvunEkeI5a8MoQstLmQkUIABI5GAgu1X8AkUw 2069
wids/wids_mmtar.py sha256=kGK3Uz50Wv77XHmRxQMbW6UVjkKoHWSnRv8ulIDyKEs 4803
wids/wids_specs.py sha256=ULMkM586G-Vq1NaVmYa4YuUyFNiblEb86m9DAUAHMko 5734
wids/wids_tar.py sha256=b4FAxXdj1-JZWePW2daWD_EjWevIZEQr08YPXxw1P3g 2676
webdataset-0.2.111.dist-info/LICENSE sha256=q15UoQRENJPkNeduYNy7a5UEXhpCvMDYpmL6ABrQpRg 1485
webdataset-0.2.111.dist-info/METADATA sha256=TEFKblmW8_Ytc5EV4kBk7eN9OkSogOWdL8mIpXpuZKs 15999
webdataset-0.2.111.dist-info/WHEEL sha256=In9FTNxeP60KnTkGw7wk6mJPYd_dQSjEZmXdBdMCI-8 91
webdataset-0.2.111.dist-info/entry_points.txt sha256=BMLMnHsgnV58JtJVoANr7kta0txQ-Isk4fROfPp4S6Y 51
webdataset-0.2.111.dist-info/top_level.txt sha256=OWLDO9JiXwmMth73-kuUhY4MwwrLSmojBAlNsHBP2Qg 16
webdataset-0.2.111.dist-info/RECORD

top_level.txt

webdataset
wids

entry_points.txt

widsindex = wids.wids_index:main