tiktoken

View on PyPIReverse Dependencies (1353)

0.8.0 tiktoken-0.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp39-cp39-win_amd64.whl
tiktoken-0.8.0-cp39-cp39-macosx_10_9_x86_64.whl
tiktoken-0.8.0-cp39-cp39-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp39-cp39-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp313-cp313-win_amd64.whl
tiktoken-0.8.0-cp313-cp313-macosx_10_13_x86_64.whl
tiktoken-0.8.0-cp313-cp313-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp313-cp313-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp312-cp312-win_amd64.whl
tiktoken-0.8.0-cp312-cp312-macosx_10_13_x86_64.whl
tiktoken-0.8.0-cp312-cp312-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp312-cp312-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp311-cp311-win_amd64.whl
tiktoken-0.8.0-cp311-cp311-macosx_10_9_x86_64.whl
tiktoken-0.8.0-cp311-cp311-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp311-cp311-macosx_11_0_arm64.whl
tiktoken-0.8.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
tiktoken-0.8.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
tiktoken-0.8.0-cp310-cp310-win_amd64.whl
tiktoken-0.8.0-cp310-cp310-macosx_10_9_x86_64.whl
tiktoken-0.8.0-cp310-cp310-musllinux_1_2_x86_64.whl
tiktoken-0.8.0-cp310-cp310-macosx_11_0_arm64.whl

Wheel Details

Project: tiktoken
Version: 0.8.0
Filename: tiktoken-0.8.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Download: [link]
Size: 1144242
MD5: e05ee5f4a0c8ef02adf5a263cc461b36
SHA256: 5637e425ce1fc49cf716d88df3092048359a4b3bbb7da762840426e937ada06d
Uploaded: 2024-10-04 04:42:53 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: tiktoken
Version: 0.8.0
Summary: tiktoken is a fast BPE tokeniser for use with OpenAI's models
Author: Shantanu Jain
Author-Email: shantanu[at]openai.com
Project-Url: homepage, https://github.com/openai/tiktoken
Project-Url: repository, https://github.com/openai/tiktoken
Project-Url: changelog, https://github.com/openai/tiktoken/blob/main/CHANGELOG.md
License: MIT License Copyright (c) 2022 OpenAI, Shantanu Jain Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Requires-Python: >=3.9
Requires-Dist: regex (>=2022.1.18)
Requires-Dist: requests (>=2.26.0)
Requires-Dist: blobfile (>=2); extra == "blobfile"
Provides-Extra: blobfile
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 4746 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.1.0)
Root-Is-Purelib: false
Tag: cp311-cp311-manylinux_2_17_aarch64
Tag: cp311-cp311-manylinux2014_aarch64

RECORD

Path Digest Size
tiktoken/_educational.py sha256=TUFOp8Q91WjrTvGKhCNEyrhtva82UlenXfhPy9zS7VQ 8229
tiktoken/core.py sha256=6rZvV6hDe_y6QP5RU-Mn-Awx7QMXqesjM7_Dq8uB01Y 15959
tiktoken/_tiktoken.cpython-311-aarch64-linux-gnu.so sha256=crQKbD6CL4nhgmMv0xgvG7dap0TNTtZfuCcdl7jenrI 3406936
tiktoken/registry.py sha256=7fktZbJ1Kcm8sVyWgEfIy-ZxfUvcXupLUNXKPfSGwQU 3256
tiktoken/model.py sha256=TBiFm7qHmnMA0Q86t1PgZojTigG9_JDzzCcew598PBI 3705
tiktoken/load.py sha256=kb0HIT25tDYGE_iM7BVdTYO3g-G5QdFUjKbplGI32-Y 5305
tiktoken/__init__.py sha256=AYmbR4RBsDfEtKozDMVL4Uc-53jEQKOJE0poPhff_Ec 345
tiktoken/py.typed sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tiktoken-0.8.0.dist-info/LICENSE sha256=QYy0mbQ2Eo1lPXmUEzOlQ3t74uqSE9zC8E0V1dLFHYY 1078
tiktoken-0.8.0.dist-info/METADATA sha256=G22RttOE0IfhdQfm3Pk8TJ0dMyd2iI3l5QbctJnIW7w 6628
tiktoken-0.8.0.dist-info/RECORD
tiktoken-0.8.0.dist-info/WHEEL sha256=uDH-7XD8h12s5cCYJoxFcPa5MXIZbxDlkXPqQ1R3ilc 153
tiktoken-0.8.0.dist-info/top_level.txt sha256=54G5MceQnuD7EXvp7jzGxDDapA1iOwsh77jhCN9WKkc 22
tiktoken_ext/openai_public.py sha256=lGdukqVfxy0fkLYQgspecfBxa4DRYH7pACd3r0QcRa8 4624

top_level.txt

tiktoken
tiktoken_ext