Wheelodex » Projects » llama-tokens

llama-tokens

View on PyPI — Reverse Dependencies (0)

0.0.3 llama_tokens-0.0.3-py3-none-any.whl

Wheel Details

Project: llama-tokens
Version: 0.0.3
Filename: llama_tokens-0.0.3-py3-none-any.whl
Download: [link]
Size: 5784
MD5: bc5049d36f38aaba3a16c94f572fc70a
SHA256: 64fde296a24cc0c587d8cd23c10ee9f6d7aa99f5c779b9919a384889029169b9
Uploaded: 2024-11-10 17:03:37 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: llama_tokens
Version: 0.0.3
Summary: A Quick Library with Llama 3.1/3.2 Tokenization - source https://github.com/jeffxtang/llama-tokens
Author-Email: Jeff Tang <jeffxtang[at]gmail.com>
Project-Url: Homepage, https://github.com/jeffxtang/llama-tokens
License: MIT
Keywords: llama 3,tokenization,tokens,llama-tokens
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.10
Requires-Dist: tiktoken (==0.8.0)
Requires-Dist: blobfile (==3.0.0)
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 5698 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.3.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
llama_tokens/__init__.py sha256=dVVK9PliA2-ICNqCPZaO1VGSgbpLtPvnmvuBGN4bGkU 40
llama_tokens/main_module.py sha256=jQ2lEYbPTaGN6d-6qif7s_CXraUUbEjWL9JDqsb-MoA 2416
llama_tokens-0.0.3.dist-info/LICENSE sha256=sBCCTEPcFiV_T2PSbezAWne96yRTPI9Mpcvn-MHxGDU 1066
llama_tokens-0.0.3.dist-info/METADATA sha256=gG0LqI-c-3cmekTsT0Zd1Xsevdg_Y2wLoRnD8cytbfE 6332
llama_tokens-0.0.3.dist-info/WHEEL sha256=P9jw-gEje8ByB7_hXoICnHtVCrEwMQh-630tKvQWehc 91
llama_tokens-0.0.3.dist-info/top_level.txt sha256=lEChkaQFMMJK-0PH0cZXZpOohxdYh5C-J1xd9A6U1aQ 13
llama_tokens-0.0.3.dist-info/RECORD — —

top_level.txt

llama_tokens