smashed

View on PyPIReverse Dependencies (5)

0.21.5 smashed-0.21.5-py3-none-any.whl

Wheel Details

Project: smashed
Version: 0.21.5
Filename: smashed-0.21.5-py3-none-any.whl
Download: [link]
Size: 95393
MD5: 962af6a9ea1fa0241c7cc5869be4e400
SHA256: 90ed1b5b0fc83d4b213cdcf417bf424e391cc7a335706da2d6c0a4e590b79d1c
Uploaded: 2023-09-22 17:52:22 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: smashed
Version: 0.21.5
Summary: SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.
Author-Email: Allen Institute for Artificial Intelligence <contact[at]allenai.org>, Luca Soldaini <luca[at]soldaini.net>, Kyle Lo <kylel[at]allenai.org>
Maintainer-Email: Luca Soldaini <luca[at]soldaini.net>
Project-Url: Homepage, https://github.com/allenai/smashed
Project-Url: Repository, https://github.com/allenai/smashed
Project-Url: Bug Tracker, https://github.com/allenai/smashed/issues
License: Apache-2.0
Keywords: mappers,pytorch,torch,huggingface,transformers,datasets,dict,pipeline,preprocessing,nlp,natural language processing,text,prompting,prefix tuning,in context learning
Classifier: Development Status :: 4 - Beta
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: Utilities
Classifier: Typing :: Typed
Requires-Python: >=3.8
Requires-Dist: necessary (>=0.4.3)
Requires-Dist: trouting (>=0.3.3)
Requires-Dist: ftfy (>=6.1.1)
Requires-Dist: platformdirs (>=2.5.0)
Requires-Dist: glom (>=21.0.0)
Requires-Dist: Jinja2 (>=3.0.3)
Requires-Dist: numpy (>=1.19.5)
Requires-Dist: smashed[dev]; extra == "all"
Requires-Dist: smashed[torch]; extra == "all"
Requires-Dist: smashed[datasets]; extra == "all"
Requires-Dist: smashed[torchdata]; extra == "all"
Requires-Dist: smashed[remote]; extra == "all"
Requires-Dist: smashed[prompting]; extra == "all"
Requires-Dist: smashed[torch]; extra == "datasets"
Requires-Dist: transformers (>=4.5); extra == "datasets"
Requires-Dist: datasets (>=2.8.0); extra == "datasets"
Requires-Dist: dill (>=0.3.0); extra == "datasets"
Requires-Dist: black[jupyter] (>=21.12b0); extra == "dev"
Requires-Dist: isort (>=5.8.0); extra == "dev"
Requires-Dist: mypy (>=0.971); extra == "dev"
Requires-Dist: pytest (>=5.2); extra == "dev"
Requires-Dist: ipython (>=8.4.0); extra == "dev"
Requires-Dist: autopep8 (>=1.7.0); extra == "dev"
Requires-Dist: flake8 (>=5.0); extra == "dev"
Requires-Dist: ipdb (>=0.13.0); extra == "dev"
Requires-Dist: flake8-pyi (>=22.8.1); extra == "dev"
Requires-Dist: Flake8-pyproject (>=1.1.0); extra == "dev"
Requires-Dist: moto[all,ec2,s3] (>=4.0.0); extra == "dev"
Requires-Dist: smashed[torch]; extra == "prompting"
Requires-Dist: transformers (>=4.5); extra == "prompting"
Requires-Dist: promptsource (>=0.2.3); extra == "prompting"
Requires-Dist: blingfire (>=0.1.8); extra == "prompting"
Requires-Dist: smart-open (>=5.2.1); extra == "remote"
Requires-Dist: boto3 (>=1.25.5); extra == "remote"
Requires-Dist: torch (>=1.9); extra == "torch"
Requires-Dist: torch (>=1.13.1); extra == "torchdata"
Requires-Dist: torchdata (>=0.5.1); extra == "torchdata"
Provides-Extra: all
Provides-Extra: datasets
Provides-Extra: dev
Provides-Extra: prompting
Provides-Extra: remote
Provides-Extra: torch
Provides-Extra: torchdata
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 5430 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.41.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
smashed/__init__.py sha256=r9tOo10AQszOiuZJQz1TOP8HIVaO8bA94cchB3QNdcw 220
smashed/py.typed sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
smashed/base/__init__.py sha256=aeOXh5oJ5Hc0sy4ytR6zYdezpmLKiULv_WwLM4KKwkY 686
smashed/base/abstract.py sha256=Z-U0QNHi6fq25W-z7r6xAJIIuEIy2KzWcifVsblBurQ 3744
smashed/base/interfaces.py sha256=A002eRMqUawh3l0pBZGuCf-NkEJsvZqxpxhHmlz5ZyY 12566
smashed/base/mappers.py sha256=bODPWRgv1KuEfST23tZcfkjr7N1vo2kd8sd3tmd09UQ 11525
smashed/base/pipeline.py sha256=Hb8iy74aVq11ZC_VCnQz7EDBTeJCMUUljFaHKRkzipM 397
smashed/base/recipes.py sha256=i3YzUoP6LDiMQ3ifHxtzz-mYTMm4S0qReFsV3xAQhrk 685
smashed/base/types.py sha256=-iidxBly1JyjMkcE7uY14JfuET1U89zJEoCMi0TPxBM 313
smashed/base/views.py sha256=UeiLXy_25JnAHcL_Pk4lsKV00DKiw1C0XefAEyFEvyQ 4380
smashed/contrib/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
smashed/contrib/squad.py sha256=tg0vOYsndgj3Us_9NJ1lg8WhBmLgWisFWKTvDH4mnVk 16408
smashed/contrib/sse.py sha256=zS33KR_DCF0FMN9_OJ67X1-3gPqWf4aM0s92qlMH3QA 1205
smashed/interfaces/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
smashed/interfaces/huggingface.py sha256=pUjdLsUA8Sl15cVpVqLzHBgk3nGdWdBI2iEyQiiDGRM 196
smashed/interfaces/simple.py sha256=1HdkYFHzW38qZAe07yMU2A2axcgPUXiNBCATdRTubVs 496
smashed/mappers/__init__.py sha256=uhkT47MclpbEmEuLLpZK45Bs6uw244lJHH85sTDNKRo 3342
smashed/mappers/batchers.py sha256=_qILVdWvAbDGb_bdG0nDgHsm530biiykuehm-UgHMBQ 1995
smashed/mappers/cache.py sha256=2M8RqW75P1ZhhZYKzN5TDXewXuQVY6LjAL1o0N_Dq_Y 11413
smashed/mappers/collators.py sha256=tHb2q23zatNAZ_FO3hmPTfcrILELrlicV0s7HCJaxOs 19305
smashed/mappers/converters.py sha256=_B-ckee0YAoK8jcsQvLhoH2zwQH1rf4SHpfq5pi5p58 5022
smashed/mappers/debug.py sha256=z8LdhJuLSs20URJosGp57jIRvaZUwk1wt4VwYMaKXEY 2089
smashed/mappers/decoding.py sha256=eKGyNhuLzK-cg1OiNbSXDRC6DRqkWDUIE4FbOxJa_VM 3203
smashed/mappers/fields.py sha256=JEJg29IzVN7McK-V7bgJ0ocj2tNSRqrnmdk6doUSJ2I 6736
smashed/mappers/filters.py sha256=RvYT6M0KYN-HgXJ9gGH6ZDTpoqaV63TMKS6sufB-rpc 2439
smashed/mappers/glom.py sha256=kEBwqbWx3J4c6AqZJPk-GXnm59Y2MlvZYubFP9DvC2w 2118
smashed/mappers/loaders.py sha256=cjvVpGdR5KW6t-iIoRBovpCzAbT7mXP7QdIHI6lIrH4 6726
smashed/mappers/masks.py sha256=4ztv1GiMBFE25r9zz-KqPx4BUQgd8ky4jnpSK5HdE2k 6650
smashed/mappers/multiseq.py sha256=8QehI2k5cmEzTDj39dD6ainDonCkXD6nFU5x9pkAKdQ 21682
smashed/mappers/prompting.py sha256=SN3kt9eWFrJj15NOjGpt_D2fKv5Syxtt3hwsl8x7DEQ 21075
smashed/mappers/promptsource.py sha256=o4OyUoh6U8-wma6bE5Zhmo_iTMDx8zvm1umqTJoweBs 19488
smashed/mappers/shape.py sha256=ylJyL0SgSxFVYr-q51iB9o1TFMg7qOpz-OGBc2cz1FA 11199
smashed/mappers/text.py sha256=VVjqt9gQfIaFKqkYfewqU-lTfF16mCFSssirC7wyqgI 3857
smashed/mappers/tokenize.py sha256=qk49IKdF-5DMCeigRjTVnMG5Ygvq2F31vqkehWsLVSs 13688
smashed/mappers/types.py sha256=OgOiAZ1iOKZH5wp1MGc86MLwqrysWQzRmJYwcrx2x8k 7593
smashed/recipes/__init__.py sha256=DELk2g8ZhBRQhLDBhAzey8eDJeFozcD9ySE7AV19vIA 240
smashed/recipes/collators.py sha256=XAZ0oaZpoMlkga5nvq4gnuqcblkL5iRRkXXhu-RMvG4 10902
smashed/recipes/prompting.py sha256=c6NBTTRFeODFTbVGulj823yYMtf9-uAfrnBqsB276Z8 13166
smashed/recipes/promptsource.py sha256=_ANfb0sHSh1vE04aXPBIMfP0F3-w37DIqZRN6xHG2ec 11276
smashed/utils/__init__.py sha256=GK70pots1b6RC934zHHaotl5V-vqC3kupLnlJKT-eaA 1087
smashed/utils/caching.py sha256=8ksB6_vYnwotuZkZMs628FXF7YQG10pjNxuBLDcoIi4 639
smashed/utils/convert.py sha256=DU3oIk7WwZ6CdhtF8BWpqfOZiA0EbVVvCMT74eoBR0E 393
smashed/utils/install_blingfire_macos.py sha256=BNanE3u4hASLui4yriRpVFfupWRwbRLChgm_3K7SXmU 1276
smashed/utils/shape_utils.py sha256=wWg_HcEasdTa_oMsUB0ZF5PlYVmbCUqscMlNMfSmsYA 3924
smashed/utils/version.py sha256=zsoHJAAFX_mbtSwvvpMXNRYTQnmBZHRFylNcrczbbGQ 1025
smashed/utils/warnings.py sha256=v6pHwSFRtaFjZxBHZRpzuKcu5nfjRaRTgTstQ2_7HCM 768
smashed/utils/wordsplitter.py sha256=DxGvhOVRfvYTl1dI8cMilar-AHET9BVVoljBJzqcAgA 2815
smashed/utils/io_utils/__init__.py sha256=w1UiIR-fu6NpZS7Nv5BdUsOYpICHmM3eTEy4yiO-T2k 684
smashed/utils/io_utils/closures.py sha256=j3LJMvsf5s-RY6N29b32p2jiHpOAJtLSE3StZ6I5uyc 3523
smashed/utils/io_utils/compression.py sha256=zB--A7XDB3li4v0hQUFLFrlECehFp4A5EB6JE_z1ASo 1807
smashed/utils/io_utils/io_wrappers.py sha256=3gnpRmvwrytXd0_YsRn0wkPrPMBXD142sb5B9l5_CuI 5254
smashed/utils/io_utils/multipath.py sha256=IQUkdmwk38b977Csapg_yzHqP_2t6FFeLdlHu2xRw0Y 4485
smashed/utils/io_utils/operations.py sha256=jQNpxouoH9wmyvvphzBZwM3rTCuQKl1uZ4w3jsGUsXI 16929
smashed-0.21.5.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
smashed-0.21.5.dist-info/METADATA sha256=4siAe5lLwjSoZrdSMCI7lW8HHCmByVqb1fNBSyhE92k 8714
smashed-0.21.5.dist-info/WHEEL sha256=yQN5g4mg4AybRjkgi-9yy4iQEFibGQmlz78Pik5Or-A 92
smashed-0.21.5.dist-info/top_level.txt sha256=J_oaEc1HeJJy5XQUaR5C-XsTsMG6-TUTdCkCb5cYVHU 8
smashed-0.21.5.dist-info/RECORD

top_level.txt

smashed