Wheelodex » Projects » TokenizerChanger

TokenizerChanger

View on PyPI — Reverse Dependencies (0)

0.3.4

TokenizerChanger-0.3.4-py3-none-any.whl

Wheel Details

Project:	TokenizerChanger
Version:	0.3.4
Filename:	TokenizerChanger-0.3.4-py3-none-any.whl
Download:	[link]
Size:	10457
MD5:	`e24788496c067758740fab0cbcea5190`
SHA256:	`8e1fc53bc1098a907668d14a89390cadcce4369c8fbdde26488e04da38cc36f9`
Uploaded:	2024-08-27 23:47:56 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version:	2.1
Name:	TokenizerChanger
Version:	0.3.4
Summary:	Library for manipulating the existing tokenizer.
Author:	1kkiren
Author-Email:	1kkiren[at]mail.ru
Home-Page:	https://github.com/1kkiRen/Tokenizer-Changer
Project-Url:	GitHub, https://github.com/1kkiRen/Tokenizer-Changer
Keywords:	tokenizer deletion tokens
Classifier:	Programming Language :: Python :: 3.10
Classifier:	License :: OSI Approved :: Apache Software License
Classifier:	Operating System :: OS Independent
Requires-Python:	>=3.9
Requires-Dist:	tokenizers (>=0.19.1)
Requires-Dist:	tqdm (>=4.66.4)
Requires-Dist:	transformers (>=4.41.2)
Description-Content-Type:	text/markdown
License-File:	LICENSE

[Description omitted; length: 3081 characters]

WHEEL

Wheel-Version:	1.0
Generator:	bdist_wheel (0.43.0)
Root-Is-Purelib:	true
Tag:	py3-none-any

RECORD

Path	Digest	Size
TokenizerChanger/__init__.py	sha256=nQndnQvEft7grBFSCWfzpiCSFdOAqXfDSJ2cnOnhcUI	133
TokenizerChanger/tokenizer_changer.py	sha256=wJ_ZJs0e84SnGSOZ9CPM3p6G1VJI5a0RPlq7P5LOvcs	18185
TokenizerChanger-0.3.4.dist-info/LICENSE	sha256=GkOAyzc8Z4DKIi51a3ISfwuqlca4GLsEGwZfyI6gd3U	10949
TokenizerChanger-0.3.4.dist-info/METADATA	sha256=CikE62lmfxGQLVoaoGPuJjxIrOToKN_j6Mi7DmsmoMY	3885
TokenizerChanger-0.3.4.dist-info/WHEEL	sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ	92
TokenizerChanger-0.3.4.dist-info/top_level.txt	sha256=vjd6el74H3lGclZ7GFIB_Lqq6xXcnofbYye8uPwKtc4	17
TokenizerChanger-0.3.4.dist-info/RECORD	—	—

top_level.txt

TokenizerChanger