qwen-tokenizer
View on PyPI —
Reverse Dependencies (1)
Wheel Details
| Project: |
qwen-tokenizer |
| Version: |
0.2.0 |
| Filename: |
qwen_tokenizer-0.2.0-py3-none-any.whl |
| Download: |
[link] |
| Size: |
1142131 |
| MD5: |
58bd0e3f77610b59531d50ab7afa01d9 |
| SHA256: |
30518b3a5e6c2427d71d5b5372b44b9daeaffffb94dfc6ea5a7d202f48641eae |
| Uploaded: |
2024-10-18 14:48:12 +0000 |
dist-info
METADATA
· WHEEL
· RECORD
· entry_points.txt
WHEEL
| Wheel-Version: |
1.0 |
| Generator: |
pdm-backend (2.4.2) |
| Root-Is-Purelib: |
true |
| Tag: |
py3-none-any |
RECORD
| Path |
Digest |
Size |
| qwen_tokenizer-0.2.0.dist-info/METADATA |
sha256=nlNW5vwl4ps1nh_AkzN2WpfLZM3YmhrWz4EXskBmevk
|
1220 |
| qwen_tokenizer-0.2.0.dist-info/WHEEL |
sha256=pM0IBB6ZwH3nkEPhtcp50KvKNX-07jYtnb1g1m6Z4Co
|
90 |
| qwen_tokenizer-0.2.0.dist-info/entry_points.txt |
sha256=6OYgBcLyFCUgeqLgnvMyOJxPCWzgy7se4rLPKtNonMs
|
34 |
| qwen_tokenizer/__init__.py |
sha256=3VEvqvPJpxEdfRhKzTljaK1wdkm9k3s2Z289JgpUX8Q
|
153 |
| qwen_tokenizer/qwen_tokenizer.py |
sha256=fb-QTkbWcyscZNSyw7pcMNx_atlyQ7MRpU8FHANtgao
|
3969 |
| qwen_tokenizer/resources/qwen.tiktoken |
sha256=srG437XMXwJLr8NzEhxquj9m-aWgJp4kNHCh3hajMYY
|
2561218 |
| qwen_tokenizer/tokenizer.py |
sha256=fzLurxvsnRj610rmlDalKsyQKjidk_ofJ77g49h2JAs
|
1052 |
| qwen_tokenizer/tokenizer_base.py |
sha256=Fe3UsHelttsqZfoZrdl2otSbRaNeKbZXU_OBqLrHGsw
|
915 |
| qwen_tokenizer-0.2.0.dist-info/RECORD |
— |
— |
entry_points.txt
[empty]