Wheelodex » Projects » transformer-smaller-training-vocab

transformer-smaller-training-vocab

View on PyPI — Reverse Dependencies (1)

0.4.0 transformer_smaller_training_vocab-0.4.0-py3-none-any.whl

Wheel Details

Project: transformer-smaller-training-vocab
Version: 0.4.0
Filename: transformer_smaller_training_vocab-0.4.0-py3-none-any.whl
Download: [link]
Size: 14120
MD5: 1f6acea9e5eb9610d79b10df09e9b8a7
SHA256: 01cb3d8f4818121172e1591a06c3149bf49bc18d6f6f269eb42d2c4ed155cfcc
Uploaded: 2024-04-05 15:31:14 +0000

dist-info

METADATA · WHEEL · RECORD

METADATA

Metadata-Version: 2.1
Name: transformer-smaller-training-vocab
Version: 0.4.0
Summary: Temporary remove unused tokens during training to save ram and speed.
Author: Benedikt Fuchs
Author-Email: benedikt.fuchs.staw[at]hotmail.com
Home-Page: https://github.com/helpmefindaname/transformer-smaller-training-vocab
Project-Url: Repository, https://github.com/helpmefindaname/transformer-smaller-training-vocab
License: MIT
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.8,<4.0
Requires-Dist: numpy (<1.25.0); python_version >= "3.8" and python_version < "3.9"
Requires-Dist: numpy (<2.0.0,>=1.21.0); python_version >= "3.9"
Requires-Dist: torch (!=2.0.1,<3.0.0,>=1.8.0)
Requires-Dist: transformers[sentencepiece,torch] (<5.0,>=4.1)
Description-Content-Type: text/markdown
[Description omitted; length: 7020 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
transformer_smaller_training_vocab/__init__.py sha256=yqyRBpLdkUy_bXnZe_YT08olG8IXVjiNE7D2Gr6BKy4 337
transformer_smaller_training_vocab/contextual_reduce.py sha256=Alv-Eqs6VXhHPnaDi_oTq4Nm4Ej5_VEOUel3zevIonE 7713
transformer_smaller_training_vocab/logging_utils.py sha256=ZPF_ABJ_x72jxw-bxiodnAl2-ngw3gmizEhLds22GR0 154
transformer_smaller_training_vocab/modify_model.py sha256=msZU2mX6Q7QvzJyBusi9DnfjnwR0pIO-gAh5ymJ3Lso 2499
transformer_smaller_training_vocab/modify_tokenizer.py sha256=LNWxDmCVjURn2z6_Pv7kLSCi1lbLZskOJQ4B5iESzwg 719
transformer_smaller_training_vocab/py.typed sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
transformer_smaller_training_vocab/token_stats.py sha256=9tADo9Z9NfubILogz_gyUPcmBLYMoq7SjBIAbzHbN-k 756
transformer_smaller_training_vocab/transformer_set_vocab/__init__.py sha256=y_g9b1cXCFt-1YEPG5T4CcCJW_Fhk2DpaIjU8pX9WLo 716
transformer_smaller_training_vocab/transformer_set_vocab/auto_set_vocab.py sha256=I9XTm56RnsbccCn5h8YK1W2M0vKZcsdZuK81-6DO1NA 1520
transformer_smaller_training_vocab/transformer_set_vocab/set_vocab_bert.py sha256=KmDaIoJn-3b39-CZgnkadEC9mLUlXhyl0HsnZI4nmgE 566
transformer_smaller_training_vocab/transformer_set_vocab/set_vocab_fast_tokenizer.py sha256=2BAplsnQhQ5U4OsyFBxU9Ypb5bx7OVjJrbCNFYNZUh0 3444
transformer_smaller_training_vocab/transformer_set_vocab/set_vocab_roberta.py sha256=sD86r1PdUwOE6cpPgOjqWCWpNjL-Xvq8fR1UMnC7ZJo 472
transformer_smaller_training_vocab/transformer_set_vocab/set_vocab_xlm_roberta.py sha256=cEwTRYWhvnGfg1VcxQMiivJn-fcxisTtwwKiwK_zMzQ 539
transformer_smaller_training_vocab/utils.py sha256=kLrjIaJ7aN9RA6dy0viRPd9cc0iX9aIfavQ68OFUpy4 1414
transformer_smaller_training_vocab-0.4.0.dist-info/LICENSE sha256=sR8-L8A-sxpX2muk3oGtflPFQMtJ9w7GfNWdMXFLvvw 1071
transformer_smaller_training_vocab-0.4.0.dist-info/METADATA sha256=3l3liV9pyExCY7Wl0vzuiRoQH4kinJEcMQ_93PIiE4U 8113
transformer_smaller_training_vocab-0.4.0.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
transformer_smaller_training_vocab-0.4.0.dist-info/RECORD — —