llm-toolkit

View on PyPIReverse Dependencies (0)

0.2.3 llm_toolkit-0.2.3-py3-none-any.whl

Wheel Details

Project: llm-toolkit
Version: 0.2.3
Filename: llm_toolkit-0.2.3-py3-none-any.whl
Download: [link]
Size: 31608
MD5: 254c294b07ec71d2c907a16b7b3159b2
SHA256: 6207e27b097e64f954c86d2f0159cfdb46e56e702a14c31cd89cddd47b311326
Uploaded: 2024-07-25 15:18:07 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: llm-toolkit
Version: 0.2.3
Summary: LLM Finetuning resource hub + toolkit
Author: Benjamin Ye
Author-Email: benjamin.ye[at]georgian.io
Home-Page: https://github.com/georgian-io/LLM-Finetuning-Toolkit
Project-Url: Repository, https://github.com/georgian-io/LLM-Finetuning-Toolkit
License: Apache 2.0
Keywords: llm,finetuning,language models,machine learning,deep learning
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: License :: Other/Proprietary License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.9,<=3.12
Requires-Dist: absl-py (<3.0.0,>=2.1.0)
Requires-Dist: accelerate (<0.28.0,>=0.27.0)
Requires-Dist: ai21 (<3.0.0,>=2.0.3)
Requires-Dist: bitsandbytes (>=0.43.2)
Requires-Dist: datasets (<3.0.0,>=2.17.0)
Requires-Dist: einops (<0.8.0,>=0.7.0)
Requires-Dist: evaluate (<0.5.0,>=0.4.1)
Requires-Dist: ijson (<4.0.0,>=3.2.3)
Requires-Dist: ipdb (<0.14.0,>=0.13.13)
Requires-Dist: langchain (<0.3.0,>=0.2.5)
Requires-Dist: ninja (<2.0.0.0,>=1.11.1.1)
Requires-Dist: nltk (<4.0.0,>=3.8.1)
Requires-Dist: numpy (<2.0.0,>=1.26.4)
Requires-Dist: openai (<2.0.0,>=1.12.0)
Requires-Dist: packaging (<24.0,>=23.2)
Requires-Dist: pandas (<3.0.0,>=2.2.0)
Requires-Dist: peft (<0.9.0,>=0.8.2)
Requires-Dist: protobuf (<5.0.0,>=4.25.2)
Requires-Dist: py7zr (<0.21.0,>=0.20.8)
Requires-Dist: pydantic (<3.0.0,>=2.6.1)
Requires-Dist: pyyaml (<7.0.0,>=6.0.1)
Requires-Dist: rich (<14.0.0,>=13.7.0)
Requires-Dist: rouge-score (<0.2.0,>=0.1.2)
Requires-Dist: sentencepiece (<0.2.0,>=0.1.99)
Requires-Dist: shellingham (<2.0.0,>=1.5.4)
Requires-Dist: sqids (<0.5.0,>=0.4.1)
Requires-Dist: tiktoken (<0.7.0,>=0.6.0)
Requires-Dist: transformers (<4.41.0,>=4.40.2)
Requires-Dist: trl (<0.9.0,>=0.8.6)
Requires-Dist: typer (<0.11.0,>=0.10.0)
Requires-Dist: ujson (<6.0.0,>=5.9.0)
Requires-Dist: wandb (<0.17.0,>=0.16.3)
Description-Content-Type: text/markdown
[Description omitted; length: 7858 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.6.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
llmtune/__init__.py sha256=1tqZntZuQQdBDIbzDIet9Q2YJO6A-KijQsKOpL5yO4Y 601
llmtune/cli/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmtune/cli/toolkit.py sha256=heKYiR7BdjfbTXCg2zZDWSjCfm2etbWYb-jyZP6hJF4 4643
llmtune/config.yml sha256=fI2xVuoGBCiOrHlGadWEay6AkST5kTqgELmletFwM80 2382
llmtune/constants/files.py sha256=plvzAeYcwYwGVc3sh4Jf-50TBQgNrT5twoBGexZb9Ag 407
llmtune/data/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmtune/data/dataset_generator.py sha256=1sd34cQlbrYsMZHV_Hc7ybnaFJ7qibrfRr7FDjFd9og 2917
llmtune/data/ingestor.py sha256=oLI2ybD1rmEdxn2Gi0mZqsnZOS_ElpOzKf21ST7EHk8 1905
llmtune/finetune/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmtune/finetune/generics.py sha256=fVB-Pzzqyyi_t_GNDzgN0rZnU4HK9nS2GENqxnPjzVM 176
llmtune/finetune/lora.py sha256=yagCAgf77IRxX24bFKZnw4EoG7A-_o-Nj0BUCsEhE2k 3458
llmtune/inference/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmtune/inference/generics.py sha256=SuJQVLy63vMTJudkrsoKAscyKbieJksb1YS92GAPrS0 190
llmtune/inference/lora.py sha256=CjG5K68v8ub0-7y2bV67S8pzmS0OijtsBpdCR7AqLvk 3570
llmtune/pydantic_models/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmtune/pydantic_models/config_model.py sha256=Y6hy6kw92gHT0521tX5Nt5IiFDP2LPsREao8N-P_NN8 11715
llmtune/qa/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmtune/qa/generics.py sha256=0I6_I9SS4tnyC7XmN8PxLVNVSaRpluZuM0g8URe4KLM 2771
llmtune/qa/qa_metrics.py sha256=zeXAVqztvZQ_BIT1KwNyHI67zBy-kWSeDe32ryZMdh4 7419
llmtune/qa/qa_tests.py sha256=Q3uce-FEQq-IWjZ1Vs1L60i_teduhjoQWHSEWizHBVA 1123
llmtune/ui/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmtune/ui/generics.py sha256=RhhB3PsiEZ3xVqC5Ht63GFlM2chEO7nGssrnpu9DQoc 2156
llmtune/ui/rich_ui.py sha256=3tRkDYwBJSo28jJ_mf4R_rZ15bHsf2QsSKu5lqIFA-g 6120
llmtune/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
llmtune/utils/ablation_utils.py sha256=_GAovE3pOk_4gdBudI7A262FP0PZ_EfJCYvps2gYgzo 3338
llmtune/utils/rich_print_utils.py sha256=ujH4bC26UF-wGiyMk5bNo-y1497vhciFZsR3PwenfqY 1377
llmtune/utils/save_utils.py sha256=1eFY4bKeRWhJkUlVbqgfqsEG3YIvpN3N4IU9w0MowxY 2821
llm_toolkit-0.2.3.dist-info/LICENSE sha256=uy2-cxjWcC_ebQA6rhSDVcI5Oet5i3UddieODR3_U7g 10763
llm_toolkit-0.2.3.dist-info/METADATA sha256=_68ntiLAYvwN41rYtvtxAHAkVh73iJozVcAJE33_oT4 10033
llm_toolkit-0.2.3.dist-info/WHEEL sha256=Zb28QaM1gQi8f4VCBhsUklF61CTlNYfs9YAZn-TOGFk 88
llm_toolkit-0.2.3.dist-info/entry_points.txt sha256=dVsfBGMAL02lzS92Y6yQMgMbA-C3YXxG_OGt0fwfM_A 51
llm_toolkit-0.2.3.dist-info/RECORD

entry_points.txt

llmtune = llmtune.cli.toolkit:cli