tiktoken

View on PyPIReverse Dependencies (1418)

0.8.0 tiktoken-0.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp39-cp39-win_amd64.whl
tiktoken-0.8.0-cp39-cp39-macosx_10_9_x86_64.whl
tiktoken-0.8.0-cp39-cp39-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp39-cp39-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp313-cp313-win_amd64.whl
tiktoken-0.8.0-cp313-cp313-macosx_10_13_x86_64.whl
tiktoken-0.8.0-cp313-cp313-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp313-cp313-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp312-cp312-win_amd64.whl
tiktoken-0.8.0-cp312-cp312-macosx_10_13_x86_64.whl
tiktoken-0.8.0-cp312-cp312-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp312-cp312-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp311-cp311-win_amd64.whl
tiktoken-0.8.0-cp311-cp311-macosx_10_9_x86_64.whl
tiktoken-0.8.0-cp311-cp311-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp311-cp311-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp310-cp310-win_amd64.whl
tiktoken-0.8.0-cp310-cp310-macosx_10_9_x86_64.whl
tiktoken-0.8.0-cp310-cp310-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp310-cp310-macosx_11_0_arm64.whl

Wheel Details

Project: tiktoken
Version: 0.8.0
Filename: tiktoken-0.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Download: [link]
Size: 1178505
MD5: 5e05e735cfb04bb2b90f6bcf02108329
SHA256: b591fb2b30d6a72121a80be24ec7a0e9eb51c5500ddc7e4c2496516dd5e3816b
Uploaded: 2024-10-03 22:43:59 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: tiktoken
Version: 0.8.0
Summary: tiktoken is a fast BPE tokeniser for use with OpenAI's models
Author: Shantanu Jain
Author-Email: shantanu[at]openai.com
Project-Url: homepage, https://github.com/openai/tiktoken
Project-Url: repository, https://github.com/openai/tiktoken
Project-Url: changelog, https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
License: MIT License Copyright (c) 2022 OpenAI, Shantanu Jain Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Requires-Python: >=3.9
Requires-Dist: regex (>=2022.1.18)
Requires-Dist: requests (>=2.26.0)
Requires-Dist: blobfile (>=2); extra == "blobfile"
Provides-Extra: blobfile
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 4746 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.1.0)
Root-Is-Purelib: false
Tag: cp39-cp39-manylinux_2_17_x86_64
Tag: cp39-cp39-manylinux2014_x86_64

RECORD

Path Digest Size
tiktoken/_educational.py sha256=TUFOp8Q91WjrTvGKhCNEyrhtva82UlenXfhPy9zS7VQ 8229
tiktoken/_tiktoken.cpython-39-x86_64-linux-gnu.so sha256=CWPPMnLaXgH79uSjw7-BPYjEXVGuRtUewF3shJ9sF9w 3431224
tiktoken/core.py sha256=6rZvV6hDe_y6QP5RU-Mn-Awx7QMXqesjM7_Dq8uB01Y 15959
tiktoken/registry.py sha256=7fktZbJ1Kcm8sVyWgEfIy-ZxfUvcXupLUNXKPfSGwQU 3256
tiktoken/model.py sha256=TBiFm7qHmnMA0Q86t1PgZojTigG9_JDzzCcew598PBI 3705
tiktoken/load.py sha256=kb0HIT25tDYGE_iM7BVdTYO3g-G5QdFUjKbplGI32-Y 5305
tiktoken/__init__.py sha256=AYmbR4RBsDfEtKozDMVL4Uc-53jEQKOJE0poPhff_Ec 345
tiktoken/py.typed sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tiktoken-0.8.0.dist-info/LICENSE sha256=QYy0mbQ2Eo1lPXmUEzOlQ3t74uqSE9zC8E0V1dLFHYY 1078
tiktoken-0.8.0.dist-info/METADATA sha256=G22RttOE0IfhdQfm3Pk8TJ0dMyd2iI3l5QbctJnIW7w 6628
tiktoken-0.8.0.dist-info/RECORD
tiktoken-0.8.0.dist-info/WHEEL sha256=W4xB4__7ua2KDA1Pwqrfy49EMv6S-WFCpe5dlbjycHQ 147
tiktoken-0.8.0.dist-info/top_level.txt sha256=54G5MceQnuD7EXvp7jzGxDDapA1iOwsh77jhCN9WKkc 22
tiktoken_ext/openai_public.py sha256=lGdukqVfxy0fkLYQgspecfBxa4DRYH7pACd3r0QcRa8 4624

top_level.txt

tiktoken
tiktoken_ext