text2dataset

View on PyPIReverse Dependencies (0)

0.2.4 text2dataset-0.2.4-py3-none-any.whl

Wheel Details

Project: text2dataset
Version: 0.2.4
Filename: text2dataset-0.2.4-py3-none-any.whl
Download: [link]
Size: 11208
MD5: 7a00021fc3ebc764579d363420a3f74f
SHA256: 36c55d84bbd26d658a88d315e96481232b7a5693beec004897902f577b4b4021
Uploaded: 2024-11-14 10:14:17 +0000

dist-info

METADATA

Metadata-Version: 2.3
Name: text2dataset
Version: 0.2.4
Summary: Easily turn large English text datasets into Japanese text datasets using open LLMs
Author-Email: speed1313 <speedtry13[at]icloud.com>
Project-Url: Repository, https://github.com/llm-jp/text2dataset
License: MIT License Copyright (c) 2024 speed Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Requires-Python: >=3.12.1
Requires-Dist: datasets (>=3.0.0)
Requires-Dist: deepl (>=1.19.1)
Requires-Dist: openai (>=1.52.2)
Requires-Dist: python-dotenv (>=1.0.1)
Requires-Dist: transformers (==4.45.2)
Requires-Dist: vllm (>=0.6.1)
Requires-Dist: wandb (>=0.18.0)
Description-Content-Type: text/markdown
[Description omitted; length: 6963 characters]

WHEEL

Wheel-Version: 1.0
Generator: hatchling 1.26.3
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
text2dataset/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
text2dataset/_version.py sha256=1DCMqbETTsg3r4Ywwu5BvWVLrJGG8q9h6TYmReg2Gj4 123
text2dataset/main.py sha256=zm4f7ReFRr9C2oXBKiiB_kntif04FgHnaFosMN1wNK8 9196
text2dataset/reader.py sha256=PY8GzAKRwxwBsb0m-VeMEY_8_jZMqJ3lSps6yv1EIr0 2508
text2dataset/translator.py sha256=RnFYvD-PxDnjQS5N-nh8Ioy2BaMUdz64lJIVpz4ZxrY 4862
text2dataset/utils.py sha256=b_TymuMUH-CZnHA51fg_Q9F6TJJDC1T_G7CDgFC8K5w 710
text2dataset/writer.py sha256=taNpuP_FjFuqxZ5YC7hPnDtp59NTr1KyVAFjCO6Hd60 1116
text2dataset-0.2.4.dist-info/METADATA sha256=orw_bGDpeRhMpwqhTF1ZEh7coZ6JuWKub1shEqdN3fY 8740
text2dataset-0.2.4.dist-info/WHEEL sha256=C2FUgwZgiLbznR-k0b_5k3Ai_1aASOXDss3lzCUsUug 87
text2dataset-0.2.4.dist-info/entry_points.txt sha256=A34Cs8HriW7FBF4H0fUM2PVNTdi1couC6qg3Nzk8tAQ 56
text2dataset-0.2.4.dist-info/licenses/LICENSE sha256=UFASP8yC_pnuY_V3sYRmnQrv4b0jzwtETRUeeEx26uA 1062
text2dataset-0.2.4.dist-info/RECORD

entry_points.txt

text2dataset = text2dataset.main:main