Wheelodex » Projects » sage-tokenizer

sage-tokenizer

View on PyPI — Reverse Dependencies (0)

2.0.0 sage_tokenizer-2.0.0-py3-none-any.whl

Wheel Details

Project: sage-tokenizer
Version: 2.0.0
Filename: sage_tokenizer-2.0.0-py3-none-any.whl
Download: [link]
Size: 17390
MD5: cb1c2cae5f95bb64109483719f6c885e
SHA256: 60b3795dbb4cd168eba86cb57975462617dbf8c93c3ccf6452ef03917cf005dd
Uploaded: 2024-09-17 12:50:13 +0000

dist-info

METADATA · WHEEL · RECORD

METADATA

Metadata-Version: 2.3
Name: sage-tokenizer
Version: 2.0.0
Summary: SaGe subword tokenizer - version 2.0
Author: Shaked Yehezkel, Kensho Technologies, Bar Gazit, Yuval Pinter
Project-Url: Homepage, https://github.com/MeLeLBGU/SaGe
Project-Url: Issues, https://github.com/MeLeLBGU/SaGe/issues
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Requires-Python: >=3.8
Requires-Dist: gensim (==4.3.2)
Requires-Dist: scipy (==1.12.0)
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 6741 characters]

WHEEL

Wheel-Version: 1.0
Generator: hatchling 1.25.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
sage_tokenizer/HFEncoding.py sha256=qHgdbrcp50xvd2yF0pRWYitVMoFBlaSPYlz3pmq0GjM 1433
sage_tokenizer/SaGeVocabBuilder.py sha256=sGa9VBnTjP1OXBN9C64M-vRFTF1hvUifIWM1uUDWQMY 11095
sage_tokenizer/Word2VecParams.py sha256=h2cNS7yIYQiF6TBAyP5-AtUmyGkIhjDYJlw_PMkCTUY 303
sage_tokenizer/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
sage_tokenizer/embeddings.py sha256=YPwIDZkw_11oD8kgdBRQEn6JDSmjOtb9O1LZcmmFajw 4331
sage_tokenizer/model.py sha256=zsanIv-Lr2blqiZMS8-mTWnhFn8_eI5u--FGXTdzMCM 9784
sage_tokenizer/utils.py sha256=yXYWqKi33xMTeehdiOfbCr4d0bMheoj9fIkbAyMjmf8 11988
sage_tokenizer-2.0.0.dist-info/METADATA sha256=XwDJac2netjgmBE1x0MAl2IQwcOhjcQnF_sdXlmJzZs 7323
sage_tokenizer-2.0.0.dist-info/WHEEL sha256=1yFddiXMmvYK7QYTqtRNtX66WJ0Mz8PYEiEUoOUUxRY 87
sage_tokenizer-2.0.0.dist-info/licenses/LICENSE sha256=1EtT94wK0z-pl-AHnR4HxgMr77TzR39uW2v6X4jwTQY 1139
sage_tokenizer-2.0.0.dist-info/RECORD — —