tiktoken

View on PyPIReverse Dependencies (1353)

0.8.0 tiktoken-0.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp39-cp39-win_amd64.whl
tiktoken-0.8.0-cp39-cp39-macosx_10_9_x86_64.whl
tiktoken-0.8.0-cp39-cp39-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp39-cp39-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp313-cp313-win_amd64.whl
tiktoken-0.8.0-cp313-cp313-macosx_10_13_x86_64.whl
tiktoken-0.8.0-cp313-cp313-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp313-cp313-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp312-cp312-win_amd64.whl
tiktoken-0.8.0-cp312-cp312-macosx_10_13_x86_64.whl
tiktoken-0.8.0-cp312-cp312-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp312-cp312-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp311-cp311-win_amd64.whl
tiktoken-0.8.0-cp311-cp311-macosx_10_9_x86_64.whl
tiktoken-0.8.0-cp311-cp311-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp311-cp311-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp310-cp310-win_amd64.whl
tiktoken-0.8.0-cp310-cp310-macosx_10_9_x86_64.whl
tiktoken-0.8.0-cp310-cp310-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp310-cp310-macosx_11_0_arm64.whl

Wheel Details

Project: tiktoken
Version: 0.8.0
Filename: tiktoken-0.8.0-cp311-cp311-macosx_10_9_x86_64.whl
Download: [link]
Size: 1039700
MD5: a188930ffb921e5417a5c504b4e8c3bd
SHA256: d622d8011e6d6f239297efa42a2657043aaed06c4f68833550cac9e9bc723ef1
Uploaded: 2024-10-03 22:43:28 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: tiktoken
Version: 0.8.0
Summary: tiktoken is a fast BPE tokeniser for use with OpenAI's models
Author: Shantanu Jain
Author-Email: shantanu[at]openai.com
Project-Url: homepage, https://github.com/openai/tiktoken
Project-Url: repository, https://github.com/openai/tiktoken
Project-Url: changelog, https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
License: MIT License Copyright (c) 2022 OpenAI, Shantanu Jain Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Requires-Python: >=3.9
Requires-Dist: regex (>=2022.1.18)
Requires-Dist: requests (>=2.26.0)
Requires-Dist: blobfile (>=2); extra == "blobfile"
Provides-Extra: blobfile
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 4746 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.1.0)
Root-Is-Purelib: false
Tag: cp311-cp311-macosx_10_9_x86_64

RECORD

Path Digest Size
tiktoken/registry.py sha256=7fktZbJ1Kcm8sVyWgEfIy-ZxfUvcXupLUNXKPfSGwQU 3256
tiktoken/__init__.py sha256=AYmbR4RBsDfEtKozDMVL4Uc-53jEQKOJE0poPhff_Ec 345
tiktoken/core.py sha256=6rZvV6hDe_y6QP5RU-Mn-Awx7QMXqesjM7_Dq8uB01Y 15959
tiktoken/_tiktoken.cpython-311-darwin.so sha256=mdaXlbmKS1LZuf0Fg1_5Zm5rd_5NSvO0gx8Nqr7uTF0 2882504
tiktoken/model.py sha256=TBiFm7qHmnMA0Q86t1PgZojTigG9_JDzzCcew598PBI 3705
tiktoken/py.typed sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tiktoken/load.py sha256=kb0HIT25tDYGE_iM7BVdTYO3g-G5QdFUjKbplGI32-Y 5305
tiktoken/_educational.py sha256=TUFOp8Q91WjrTvGKhCNEyrhtva82UlenXfhPy9zS7VQ 8229
tiktoken_ext/openai_public.py sha256=lGdukqVfxy0fkLYQgspecfBxa4DRYH7pACd3r0QcRa8 4624
tiktoken-0.8.0.dist-info/RECORD
tiktoken-0.8.0.dist-info/LICENSE sha256=QYy0mbQ2Eo1lPXmUEzOlQ3t74uqSE9zC8E0V1dLFHYY 1078
tiktoken-0.8.0.dist-info/WHEEL sha256=8WdzK5c4WNxCJSm166MSYu-d0xZlUHP9uhBLxUSypoM 110
tiktoken-0.8.0.dist-info/top_level.txt sha256=54G5MceQnuD7EXvp7jzGxDDapA1iOwsh77jhCN9WKkc 22
tiktoken-0.8.0.dist-info/METADATA sha256=G22RttOE0IfhdQfm3Pk8TJ0dMyd2iI3l5QbctJnIW7w 6628

top_level.txt

tiktoken
tiktoken_ext