DatasetRising

View on PyPIReverse Dependencies (0)

1.0.4 DatasetRising-1.0.4-py3-none-any.whl

Wheel Details

Project: DatasetRising
Version: 1.0.4
Filename: DatasetRising-1.0.4-py3-none-any.whl
Download: [link]
Size: 177050
MD5: f62795a94c34bb5a76c08451ab24dc48
SHA256: 0cf7063f75b6ce7ed269b45af6c9b2e61b2db453fe3974c4b128867131ec647a
Uploaded: 2023-12-12 00:36:14 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: DatasetRising
Version: 1.0.4
Summary: Toolchain for creating and training Stable Diffusion models with custom datasets
Project-Url: Homepage, https://github.com/hearmeneigh/dataset-rising
Project-Url: Bug Reports, https://github.com/hearmeneigh/dataset-rising/issues
Project-Url: Source, https://github.com/hearmeneigh/dataset-rising
License: Copyright 2023 Mr. Stallion, Esq. Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the “Software”), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Keywords: training,crawler,machine-learning,imageboard,booru,danbooru,ml,dataset,dataset-generation,gelbooru,e621,imagebooru,finetuning,mlops,huggingface,mlops-workflow,stable-diffusion,huggingface-users,diffusers,sdxl
Classifier: Development Status :: 5 - Production/Stable
Classifier: Environment :: Console
Classifier: Environment :: GPU
Classifier: Environment :: GPU :: NVIDIA CUDA
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: MacOS
Classifier: Operating System :: POSIX
Classifier: Operating System :: POSIX :: Linux
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Scientific/Engineering :: Image Processing
Requires-Python: >=3.8
Requires-Dist: pymongo (==4.4.1)
Requires-Dist: requests (==2.31.0)
Requires-Dist: call-throttle (==0.3.0)
Requires-Dist: furl (==2.1.2)
Requires-Dist: ndjson (==0.3.1)
Requires-Dist: anyascii (==0.3.2)
Requires-Dist: pyyaml (==6.0.1)
Requires-Dist: pyyaml-include (==1.3.1)
Requires-Dist: halo (==0.0.31)
Requires-Dist: jinja2 (==3.1.2)
Requires-Dist: Pillow (==10.0.0)
Requires-Dist: huggingface-hub (==0.17.3)
Requires-Dist: transformers (==4.34.0)
Requires-Dist: diffusers (==0.21.4)
Requires-Dist: accelerate (==0.23.0)
Requires-Dist: datasets (==2.14.5)
Requires-Dist: torch (==2.0.1)
Requires-Dist: torchvision (==0.15.2)
Requires-Dist: pydash (==7.0.6)
Requires-Dist: s3fs (==2023.1.0)
Requires-Dist: bitsandbytes (==0.41.1)
Requires-Dist: xformers (==0.0.22)
Description-Content-Type: text/markdown
License-File: LICENSE.md
[Description omitted; length: 12895 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.42.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
crawl/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
crawl/dr_crawl.py sha256=fviJ4vwXqQCPL__eAetnClfAFaGYTGSJmAiKN65swr4 1806
crawl/crawler/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
crawl/crawler/crawler.py sha256=3E_BkpyGpcep3-8uRsi_jrAGoyUFdOl0svhj_wHP-GA 4018
crawl/crawler/helpers.py sha256=EOl6j-4wzs2ZVCWGUP-kvh5sVYfvHJY1kAgMDJRO1cw 7614
database/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
database/dr_add_tag.py sha256=05V9SUbFB2AfZlcXQjbHJ2EmewNo2yFizRnHGD-f0l0 3735
database/dr_append.py sha256=SQJcwkjEAXxhZq96m8sY-_QYJWTpWlOVYfA9sexyAKw 1273
database/dr_db_create.py sha256=jvKT3H1nh6tRK2C0ZBYc5j1YCLOIMG3PItIf33VEd_U 1872
database/dr_db_down.py sha256=NtOEv4lf-NgFyvMx04r5XgIReIgXm8GM-hxHFB0md-8 380
database/dr_db_uninstall.py sha256=YYY17WL8e5Gszt0zg8Um-HAe38W7cFX9dPMnPSuByyE 560
database/dr_db_up.py sha256=c5ENWjP7xoUWcsudgvGP9kOcG0czjc4J8gHdj_6jO20 690
database/dr_gap.py sha256=DCpV1HtfPLLbRSupTYTvL3vcnpzS__GG2pIAWsHcXk4 28136
database/dr_import.py sha256=SonYqKNtiv6oMbVjJ2JVzsoQZpC9Thlzv8hXD6XscoA 5776
database/dr_preview.py sha256=2CxLaeE6fl_s8P4UG8wnmNc9bOFYEwNLelZoH5Us0-s 28497
database/dr_select.py sha256=3Sqd7bQ9ajbtkTSxQvPp4dFiNtGUSZLnq_c_R3ze6bk 2570
database/entities/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
database/entities/implication.py sha256=SzqpWbdqp614Rurz-XMU73Kw0Sa-1V7tGuo_m8N7kec 146
database/entities/post.py sha256=rvpgtllbgEGCQZy0HotVdB5qGCSbLXXb-1w4w3nhgNk 1018
database/entities/tag.py sha256=rdGk8QYOQ8BL4HJBNE5H2yG794lRhNtC7mD1XmvrVMg 2486
database/importer/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
database/importer/alias_importer.py sha256=SA_JJLJwrYN2ZcdYCh-tkwdVfbeh9BawfKz6hupkRO4 498
database/importer/importer.py sha256=Ngp_THsdEaQ-uSz8DD2oLBp8UkrblZ9KdOMOU5WZvb0 2456
database/selector/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
database/selector/selected_sample.py sha256=pMTzKlKFs2rPjmjy0V-n7XDZV0q-OF_EaIr-Oor9SJg 273
database/selector/selector.py sha256=139R4YKQWBPpfS1Fahu7JVMzsvcsBqjthg7lcKTEmj0 7758
database/tag_normalizer/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
database/tag_normalizer/tag_normalizer.py sha256=claQGkupEv4RacwNDybxed1GCCB5fzAunAxWZ-eUes8 22863
database/tag_normalizer/util.py sha256=DwhB1xscE_1pVukCsv9Hq7GVWI4U3WXan2Onz4YpBW8 748
database/translator/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
database/translator/danbooru_translator.py sha256=FGrPw1mMCMnUsX_8JF4hOfn0cQ_HOxZ-fxb9QX4uVKc 2261
database/translator/e621_translator.py sha256=7Lx73usdSR7BPaIPUEuIJdNPiczwVnpwVvTNrQ-5aHo 3058
database/translator/gelbooru_translator.py sha256=ovURzKEjmylkQa8rH1oGVnUkX0gr8kIGCXAHigeOX9E 2607
database/translator/helpers.py sha256=dPLrFNEeDwLB-guhIcHsTROen0Dtqw07H86T5StImbg 1730
database/translator/rule34_translator.py sha256=_lDP3NO0LxJtsYGsGVYkp95jFvsS2iPo-eUzt5HNh-U 2485
database/translator/translator.py sha256=bZUvIlQrnbyPoWJJi9E9s8l3yAJQVFOP5O90QJk7FQA 2311
database/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
database/utils/db_utils.py sha256=ngEd7Df2sea1aaPLNRe1xKt8BTqXcH3TrJ_T4BP4tCc 445
database/utils/enums.py sha256=HA5dkO-Itf6cmeRdB5hlf1bgaEoFmJZCQ27zmOugNGs 1852
database/utils/source_url.py sha256=TErsJrjrDpTmVGReL9bjFvRIrHVwDgSgtOu-xRj68tE 579
dataset/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataset/dr_build.py sha256=RfGL1y1EcpR7cHbzZTWYeYQAvSZLBnV93nXGc7jajls 5217
dataset/dr_join.py sha256=qPhfZRRC0SnfOQAsFCE-t9z3_HZ86FTha0sE-YBw65o 6232
dataset/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
dataset/utils/balance.py sha256=-B0aA5fXcspkDQmGdlTrMgPqwlAlXkhvso3weOqGGvU 2484
dataset/utils/download.py sha256=OGIB4jRxMczCyIYgQdJCqtPQ22ovPigurI04rZypIUI 836
dataset/utils/format.py sha256=BLaGw4JZEg22PqS7VGDKRWhXVpavxngbwOzuVT_syB4 2364
dataset/utils/load.py sha256=Jqm2tu6sc6OFLhbIlZiFlKZ52q7cUkigoG3jr9U9CF4 423
dataset/utils/prune.py sha256=EHkPJpezpx6xum4boSz_Leomjqcn03LmZBB5I2KKoRo 433
dataset/utils/resize.py sha256=ZwgJQ1Ln89tUVAc_1zNPu-xwYkACz5SPp1GgyoF4b2E 537
dataset/utils/selection_source.py sha256=WUFbCfAEPtyrjaEf-Jc7caA0r-LpTmeOtItrStVvgBk 1064
dataset/utils/split.py sha256=GdfABCkkrotbac3wnd1xV_uoMq6m39zKIYmidatlcyo 758
tests/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
tests/test_balance.py sha256=0d1eTJissrhk8D8sBWg8l2UJTjK3XidYbcBnTXu79Zs 4393
train/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
train/dr_convert_sd.py sha256=cY9-2qr2D1W0BoLFWcj7PgMRVmfdgFKBvsF1D-ldrYE 186
train/dr_convert_sdxl.py sha256=GdZ2Bj98XUi-udbDRybytMNnPRfJQ4B_vNHVZpJZ5Zw 174
train/dr_train.py sha256=t-mThzM1OUd-fN_tLtEqN_YRcmLK_tViAdVnZfKKMXE 159
train/dr_train_xl.py sha256=wsMXL-8ladXhZITyc8znMbMe5cyMiMDIxt03iYinG_U 193
train/vendor/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
train/vendor/huggingface/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
train/vendor/huggingface/diffusers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
train/vendor/huggingface/diffusers/convert_diffusers_to_original_sdxl.py sha256=Cv_HXHRv0qwOimmRdbjbROyN3giBHIbJ9SmnUMmUnkQ 13654
train/vendor/huggingface/diffusers/convert_diffusers_to_original_stable_diffusion.py sha256=9qD8C2e0-8rQm8VPbyzmTQ2ibiTwgu3wueTG8dbVaik 13299
train/vendor/huggingface/diffusers/resize_with_pad.py sha256=VtVtaqahgQ9R3xGXYkAve1Gk_xyQh5Xp0j5OJ00UdWU 1956
train/vendor/huggingface/diffusers/train_text_to_image.py sha256=vOjnPf0u91z-HFbF5jq4oOAa4jlLp_h6-5CB_vndy-4 46901
train/vendor/huggingface/diffusers/train_text_to_image_sdxl.py sha256=S26u0CvtPazxmEEemHBZ1iF5LsQgK-9q0NZlI63BQiM 56465
train/vendor/huggingface/diffusers/original/train_text_to_image.py sha256=M-GiX_fETCfuqEJQnWrAxrouUghaFfS3OuDF48guk2w 43875
train/vendor/huggingface/diffusers/original/train_text_to_image_sdxl-0.21.4.py sha256=prYqEHH5FW_QaJ1ar73s7pDURhUuikH4xqdE2uKqs8c 51883
train/vendor/huggingface/diffusers/original/train_text_to_image_sdxl-main.py sha256=yyCx-2-OrrA6FWkfBQhU8P_12IaRyqlcPIRM5yAVz5I 53772
train/vendor/huggingface/diffusers/original/train_text_to_image_sdxl.py sha256=UCVdTmUQLltQ7vILB8tcJ66ddeYlRBDRkA7Kb5PZ4ew 53861
utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
utils/load_yaml.py sha256=T7uqDZbE4nHDbsnItjehAi_W9v0Yune_PdQntvZmAEw 136
utils/progress.py sha256=5IdwjUZt2Vqtvm5wGaDHT7dpE9bIQ5PqazCSRngWu4M 751
DatasetRising-1.0.4.dist-info/LICENSE.md sha256=GtRYd7ghTa0x8xE1NqAHGrBj7qXh22Ynz89HzhZdNro 1066
DatasetRising-1.0.4.dist-info/METADATA sha256=TOys7Thzx7fFpBpToy_g8ZKAcOCRgzNX_XIGCigzUgc 16341
DatasetRising-1.0.4.dist-info/WHEEL sha256=oiQVh_5PnQM0E3gPdiz09WCNmwiHDMaGer_elqB3coM 92
DatasetRising-1.0.4.dist-info/entry_points.txt sha256=v92UMtcHwdFN7XevYpxXFXLCXYBDChuxE9jyipcfA6s 643
DatasetRising-1.0.4.dist-info/top_level.txt sha256=JH92y4GdQFDJ2ep-uZQN2PYyan9KqQn6Pn20zOvZWqA 41
DatasetRising-1.0.4.dist-info/RECORD

top_level.txt

crawl
database
dataset
tests
train
utils

entry_points.txt

dr-add-tag = database.dr_add_tag:main
dr-append = database.dr_append:main
dr-build = dataset.dr_build:main
dr-convert-sd = train.dr_convert_sd:main
dr-convert-sdxl = train.dr_convert_sdxl:main
dr-crawl = crawl.dr_crawl:main
dr-db-create = database.dr_db_create:main
dr-db-down = database.dr_db_down:main
dr-db-uninstall = database.dr_db_uninstall:main
dr-db-up = database.dr_db_up:main
dr-gap = database.dr_gap:main
dr-import = database.dr_import:main
dr-join = dataset.dr_join:main
dr-preview = database.dr_preview:main
dr-select = database.dr_select:main
dr-train = train.dr_train:main
dr-train-xl = train.dr_train_xl:main