split-markdown4gpt

View on PyPIReverse Dependencies (0)

1.0.9 split_markdown4gpt-1.0.9-py3-none-any.whl

Wheel Details

Project: split-markdown4gpt
Version: 1.0.9
Filename: split_markdown4gpt-1.0.9-py3-none-any.whl
Download: [link]
Size: 12857
MD5: e8cfd40e33bec8cffdd5a36d2fd50044
SHA256: 1c0bbf724f4f3feddc3dcb6c065d4c0c175676ed45c85e00477a912b6b349c36
Uploaded: 2023-06-19 18:19:12 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: split-markdown4gpt
Version: 1.0.9
Summary: A Python tool for splitting large Markdown files into smaller sections based on a specified token limit. This is particularly useful for processing large Markdown files with GPT models, as it allows the models to handle the data in manageable chunks.
Author: Adam Twardoch
Author-Email: adam+github[at]twardoch.com
Home-Page: https://github.com/twardoch/split-markdown4gpt
Project-Url: Documentation, https://twardoch.github.io/split-markdown4gpt/
Project-Url: Source, https://github.com/twardoch/split-markdown4gpt
License: Apache-2.0
Keywords: python,nlp,markdown,natural-language-processing,text-analysis,openai,text-summarization,summarization,text-processing,gpt,data-preprocessing,mistletoe,split-text,text-tokenization,openai-gpt,gpt-3,gpt-4,gpt-35-turbo,gpt-35-turbo-16k,markdown-processing
Classifier: Development Status :: 4 - Beta
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: Topic :: Text Processing
Classifier: Topic :: Text Processing :: Markup :: Markdown
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Platform: any
Requires-Python: >=3.10
Requires-Dist: fire (>=0.5.0)
Requires-Dist: mistletoe (>=1.1.0)
Requires-Dist: python-frontmatter (>=1.0.0)
Requires-Dist: PyYAML (>=5.1)
Requires-Dist: regex (>=2023.6.3)
Requires-Dist: syntok (>=1.4.4)
Requires-Dist: tiktoken (>=0.4.0)
Requires-Dist: importlib-metadata; python_version < "3.8"
Requires-Dist: setuptools; extra == "testing"
Requires-Dist: pytest; extra == "testing"
Requires-Dist: pytest-cov; extra == "testing"
Provides-Extra: testing
Description-Content-Type: text/markdown; charset=UTF-8; variant=GFM
License-File: LICENSE.txt
[Description omitted; length: 4883 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.40.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
split_markdown4gpt/__init__.py sha256=z5mVyqU94RD-Q3R0dDT_WXjlbyyJiO_qPi3l-SDZUYw 627
split_markdown4gpt/__main__.py sha256=IWK1N3uHe1SDiYvfDy5N_d9FUFIt1qHA8yQ3MXbKH5w 1609
split_markdown4gpt/splitter.py sha256=UHIUn-q4ZNpTxKcpr9sTTPHgdWMUB0xtVu451S8lHHA 14710
split_markdown4gpt-1.0.9.dist-info/LICENSE.txt sha256=tAkwu8-AdEyGxGoSvJ2gVmQdcicWw3j1ZZueVV74M-E 11357
split_markdown4gpt-1.0.9.dist-info/METADATA sha256=pmiHUPa27iUOBTMMQ2gQHXoe-RqZbA3jv6lMLCLc9dM 6827
split_markdown4gpt-1.0.9.dist-info/WHEEL sha256=pkctZYzUS4AYVn6dJ-7367OJZivF2e8RA9b_ZBjif18 92
split_markdown4gpt-1.0.9.dist-info/entry_points.txt sha256=zGGO9oPD_BEdtWzh9L_oNuJKYmi28_KStKkQEVwwcxU 64
split_markdown4gpt-1.0.9.dist-info/top_level.txt sha256=9a4vhVLvd9umJucJOkqSrXQke0Eckow5Ien1Gya9-5Y 19
split_markdown4gpt-1.0.9.dist-info/RECORD

top_level.txt

split_markdown4gpt

entry_points.txt

mdsplit4gpt = split_markdown4gpt.__main__:cli