Wheelodex » Projects » tokenizer

tokenizer

View on PyPI — Reverse Dependencies (7)

3.4.5 tokenizer-3.4.5-py3-none-any.whl

Wheel Details

Project: tokenizer
Version: 3.4.5
Filename: tokenizer-3.4.5-py3-none-any.whl
Download: [link]
Size: 112770
MD5: 46e3379afca1670fab350e585480ac42
SHA256: edda11760f47787c761a27f4e1ce731a1fdccd7f2a3597a0bf6b01596448da25
Uploaded: 2024-08-23 16:00:47 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: tokenizer
Version: 3.4.5
Summary: A tokenizer for Icelandic text
Author-Email: "Miðeind ehf." <mideind[at]mideind.is>
Project-Url: Repository, https://github.com/mideind/Tokenizer
License: MIT
Classifier: Development Status :: 5 - Production/Stable
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: Unix
Classifier: Operating System :: POSIX
Classifier: Operating System :: MacOS
Classifier: Operating System :: Microsoft :: Windows
Classifier: Natural Language :: Icelandic
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Programming Language :: Python :: Implementation :: PyPy
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: Utilities
Classifier: Topic :: Text Processing :: Linguistic
Requires-Python: >=3.9
Requires-Dist: pytest; extra == "dev"
Provides-Extra: dev
Description-Content-Type: text/x-rst
License-File: LICENSE.txt
[Description omitted; length: 40882 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (73.0.1)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
tokenizer/.DS_Store sha256=xI9sh2PHXqnoO8LWJEvbbzdu_Yo0gMPKcuEvsFGOp4c 6148
tokenizer/Abbrev.conf sha256=jCnhYS-opVczkwR2kZD9yvppQ9AHIckOIqTYlMkdrhM 47236
tokenizer/__init__.py sha256=tIiZR44Cg4GzztbB1O0pbAf_fueYjtp04j_rT9Uv3pk 2819
tokenizer/__init__.pyc sha256=AFzxWlrpPXNvVPpCr_x-CQ0WGiM876Zkr2XjS9AwlVg 2433
tokenizer/abbrev.py sha256=HDXqlmjFrVaqvOO6WBZaLbZWTFlbhjE16kVHndCr9DU 13742
tokenizer/abbrev.pyc sha256=QOfke4utOIU3_-Ez2dZo2Nl8T_FopwDBeYq5A-_iMTU 8762
tokenizer/definitions.py sha256=EPazpto9m8cegR9lYSjiEK655hrhKhf8AiXhzOxowc8 27926
tokenizer/definitions.pyc sha256=g91iiaOJU5XpkoJuQZd9T5YOeA97lR0GCTuMX3FvWy4 26571
tokenizer/main.py sha256=sxFGGzHpEOV2qImcMz0QJyxiEcT9vm_QIwzkvpdRVR0 9646
tokenizer/py.typed sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tokenizer/tokenizer.py sha256=VyrcmIiq93ZLavg5KODI0lXu9-2iG1D8C6_TlZn6yVU 128708
tokenizer/tokenizer.pyc sha256=ho3uzqu3CIAGbUyKLgBxw5XnGCESQXzQi-rJ-M9FmrQ 49803
tokenizer-3.4.5.dist-info/LICENSE.txt sha256=siMdna2T25ta2TOjwa8PBq7k0ZVNh7wjVwouPMMnOm0 1118
tokenizer-3.4.5.dist-info/METADATA sha256=oxructONUqUANqA3P-Jr5KaIUDaKUansaPL0Qldp9Oo 42490
tokenizer-3.4.5.dist-info/WHEEL sha256=Mdi9PDNwEZptOjTlUcAth7XJDFtKrHYaQMPulZeBCiQ 91
tokenizer-3.4.5.dist-info/entry_points.txt sha256=v9w-Gt8suY5ymeStZe2K1KmAUoejA6YhNHMpfWTTFGM 49
tokenizer-3.4.5.dist-info/top_level.txt sha256=ODlQeKqMCvFle4_HiPNY1X5fX-qZyM3ABBmOPG__vnE 10
tokenizer-3.4.5.dist-info/RECORD — —

top_level.txt

tokenizer

entry_points.txt

[console_scripts]
tokenize = tokenizer.main:main