Wheelodex » Projects » distllm » distllm-1.0.1-py3-none-any.whl

distllm

View on PyPI — Reverse Dependencies (0)

1.0.1 distllm-1.0.1-py3-none-any.whl

Wheel Details

Project: distllm
Version: 1.0.1
Filename: distllm-1.0.1-py3-none-any.whl
Download: [link]
Size: 86776
MD5: c93681733294b7cc25bb5bf83f82e254
SHA256: 13ee60d6f265d7f7eb8c463c5b8fc7bf731c6f9bbd2c5778da31b8323568e5aa
Uploaded: 2024-12-20 04:29:15 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: distllm
Version: 1.0.1
Summary: Distributed Inference for Large Language Models.
Author-Email: Alexander Brace <abrace[at]anl.gov>, Ozan Gokdemir <ogokdemir[at]uchicago.edu>
Project-Url: homepage, https://github.com/ramanathanlab/distllm
Project-Url: documentation, https://github.com/ramanathanlab/distllm
Project-Url: repository, https://github.com/ramanathanlab/distllm
License: MIT
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Requires-Python: >=3.8
Requires-Dist: transformers (>=4.38.2)
Requires-Dist: datasets (>=2.18.0)
Requires-Dist: bitsandbytes (>=0.42.0)
Requires-Dist: langchain (>=0.2.5)
Requires-Dist: langchain-anthropic (>=0.1.7)
Requires-Dist: langchain-google-genai (>=1.0.1)
Requires-Dist: accelerate (>=0.28.0)
Requires-Dist: parsl (>=2024.1.29)
Requires-Dist: pydantic (>=2.6.0)
Requires-Dist: typer[all] (>=0.9.0)
Requires-Dist: nltk (>=3.9)
Requires-Dist: python-dotenv (>=1.0.1)
Requires-Dist: peft (>=0.10.0)
Requires-Dist: sentence-transformers (>=3.3.1)
Requires-Dist: torch
Requires-Dist: covdefaults (>=2.2); extra == "dev"
Requires-Dist: coverage; extra == "dev"
Requires-Dist: mypy; extra == "dev"
Requires-Dist: pre-commit; extra == "dev"
Requires-Dist: pytest; extra == "dev"
Requires-Dist: pytest-cov; extra == "dev"
Requires-Dist: ruff; extra == "dev"
Requires-Dist: tox; extra == "dev"
Requires-Dist: virtualenv; extra == "dev"
Requires-Dist: types-PyYAML; extra == "dev"
Requires-Dist: build; extra == "dev"
Requires-Dist: twine; extra == "dev"
Requires-Dist: black; extra == "docs"
Requires-Dist: mkdocs-gen-files; extra == "docs"
Requires-Dist: mkdocs-literate-nav; extra == "docs"
Requires-Dist: mkdocs-material (==9.4.7); extra == "docs"
Requires-Dist: mkdocs-section-index; extra == "docs"
Requires-Dist: mkdocstrings (==0.23.0); extra == "docs"
Requires-Dist: mkdocstrings-python (==1.8.0); extra == "docs"
Requires-Dist: mike; extra == "docs"
Provides-Extra: dev
Provides-Extra: docs
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 3722 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.6.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
distllm/__init__.py sha256=rh9gcDTywLP6vKPyys88pBfOURtwvbx57MCinDzPVkg 101
distllm/cli.py sha256=KMrgoIkSeidaCbbfvExIwBzovBH9c6BVuEtDlsE85hk 15248
distllm/distributed_embedding.py sha256=mdL0hrZNoEJ6kl0DQhFGYDj_xUKEdkMVrj2sPHIrcU4 5019
distllm/distributed_generation.py sha256=bg6--J1fv1Q_swIJmo2smQwv8bxEh3WEEsFmEHkGcjk 5482
distllm/distributed_tokenization.py sha256=-81XoSF68oZ2HFbU8yaVIspMOwX2YQBth6M2lMOyrsA 5797
distllm/parsl.py sha256=adJ0x-cjLIBlc73_hgSw55ekJcNyTqq5DNqrgmoevsA 8959
distllm/py.typed sha256=pjZ3eoQ8Dd_pUFc1LeRQwf07qFBz7wDueGr3aO8b8gg 56
distllm/registry.py sha256=X7BfMDi1qqnzvsP81rHHFoA6J6TMiojXVhHd8Nl0NI4 6960
distllm/timer.py sha256=hwFGT_Kc4IAXlhDOC5AnfH9NK5HCINY1SH8I1zwT5B0 4241
distllm/utils.py sha256=EcPTBIiaV5n7dkHYlx1J-i02e91ZuSxjbRP7po3FvNk 3066
distllm/embed/__init__.py sha256=bBUBw8RRM_mTXbJBQ_SPxuH7wHLiUutMduyUqKiFj9Q 814
distllm/embed/datasets/__init__.py sha256=_BileclipB4lb8BOLWRNN2UKrrF2XByBkMtPMihmBJI 2275
distllm/embed/datasets/base.py sha256=HC4d44Ix98z9lBfj00bUNHjODP9v3MeystZvFjqOoa8 906
distllm/embed/datasets/fasta.py sha256=V0a4C7--zldh3TJrPJrYyO-qiTvNYl0Khy1h0w_oHIY 3102
distllm/embed/datasets/huggingface.py sha256=QwbGQb7kSNPHp8bg0VEaQapqQptqNPhSb1qxpuvI1CE 2561
distllm/embed/datasets/jsonl.py sha256=kBIq_z0wADegwMYJAOieMA-0Ui3WtYH22IRwoMi2A8U 2003
distllm/embed/datasets/jsonl_chunk.py sha256=cgb8EwZqGpoYWkz6_7xx_YshxykVaZQScr-OWYiJZFE 5814
distllm/embed/datasets/single_line.py sha256=o6qtwsRZK_Jy6cQMql77GTfL1oc3Z3zXbKRO2HVMXjw 1940
distllm/embed/datasets/utils.py sha256=wshjesK-_VmibA2Uqsf1Np2xLKI-d7MYFUlFVr87vKU 1339
distllm/embed/embedders/__init__.py sha256=uVXOqQsJetT1BF4IwSTAg6EqIzw41fovjssv-IxTDV0 1683
distllm/embed/embedders/base.py sha256=JTwrKBOxEJC3wHK_A7u99Ox0Uu-O5HDGGCVPJq_vTvc 1528
distllm/embed/embedders/full_sequence.py sha256=ou98kezRLVPv9qeGTRFMTAhHwlR1x1H0un7PsW7mObc 3770
distllm/embed/embedders/semantic_chunk.py sha256=kv2YgXfsbK4fkCXmnzARqTPxIlwkZaLoM2INtnOdaQM 9554
distllm/embed/encoders/__init__.py sha256=W5qmi_QKjF5RnKiTl6S3qxIDRzyoeEfJbkipI1kL0E8 2334
distllm/embed/encoders/auto.py sha256=b3j0fqxHPX-bocRyfeniFN36ENxh9WfGLO-tqa7sn74 4090
distllm/embed/encoders/base.py sha256=DANdb9wxld03rEj3mnjwwOSFIvUi2tH-tZkGCoRB6xw 1341
distllm/embed/encoders/esm2.py sha256=p5cAfSTou2Ba9x_iofE86Ffn2B18ePfFvSH62aAl2vE 3932
distllm/embed/encoders/esmc.py sha256=BUycf1oHP-BMf65c35tFIfR9Ktmff-_WhpYXxWGQ224 3193
distllm/embed/poolers/__init__.py sha256=cysVrfDiSoDNssiZo7ehWaswo_VSVa-V9dIAGzQaJxo 1458
distllm/embed/poolers/base.py sha256=A6f6tyaVE3Ylp_E1N1mrMjZXz8_TgBK71DkQBQ7_MPs 1005
distllm/embed/poolers/last_token.py sha256=u5q-fVZ2pWSWTEs9Ed7eQXVt-0_k6l09n2gxkzHbpZk 2086
distllm/embed/poolers/mean.py sha256=ZWDqzyoG2EZUyyB53kzrjfrpogvpZ3wpx8PdmGSx0GU 2543
distllm/embed/writers/__init__.py sha256=tL-k8Ag-WF7LbgK2go9FrDuos2I_v13dyTLU_R4ALgo 1500
distllm/embed/writers/base.py sha256=G05O14t1FNH80ZAtiotTUXwIMnLsdl9X6LFNGUK92v8 1110
distllm/embed/writers/huggingface.py sha256=4N6ppCb2jW_OHUNgkoli0grwFY7jJIqWa9ORCKy1wWA 2884
distllm/embed/writers/numpy.py sha256=_kDQlYL17EYWFF_VKxkScNwje4x3YyTqhYFhyIeTN0I 2276
distllm/generate/__init__.py sha256=xgicFxRx0C1DlMzLFNv25BEwQ7Q3xZw3UTp0K9ucos0 693
distllm/generate/generators/__init__.py sha256=PoZ7-INIrgFS6mzGmhctjA_K5iVkq3butf__warhMsI 2583
distllm/generate/generators/base.py sha256=n62FOGC-WzqynYhEvX55s_q7MhqL70QCi_Cp8YYhAdQ 636
distllm/generate/generators/huggingface_backend.py sha256=YQDb11_7HsCD2RKcqfMitC6UYI2Zqy6KVzYMRJl5SCU 5178
distllm/generate/generators/langchain_backend.py sha256=6ScnwIaOHUAb-SRzGcGrlig5mfHG7R2TxQ_h_Z08UaI 3169
distllm/generate/generators/vllm_backend.py sha256=WpiW68XtJHQkAzVOpTHOABMthIn9VePZBEHDMDKlPds 2887
distllm/generate/prompts/__init__.py sha256=zJTDdOPxuQBCArYpxx0Nwhf4vmQPkrFC4M7PoEaz1VI 2719
distllm/generate/prompts/amp_question.py sha256=AIWKUtROH23aNj3P5DB_Kta3nbXbwwPNpHFQt_0g5r0 5584
distllm/generate/prompts/base.py sha256=1Tfu_j2Qshnl_APmlfB9z2el2ysKIV1Zlf32KfZ4ZwU 1749
distllm/generate/prompts/identity.py sha256=5uXj41L1wrLrMWh1BdGOdmgfE2JpkKqhTy0DvQklJ5o 1593
distllm/generate/prompts/keyword_selection.py sha256=go2Cx1qaFlgVirncWK_MUKvZBlefdSTNKdk3Rxsjmuw 3096
distllm/generate/prompts/question_answer.py sha256=LQCd9ldzuxRskG9JxcbjSun86fgg57_CyTp75JD0O_w 3698
distllm/generate/prompts/question_chunk.py sha256=ctk6LhkvDThcBTQcCGhHS-_qEGE0PrmvAaHyK7WufVw 2737
distllm/generate/readers/__init__.py sha256=1hXDdzbWcamCJ0kumVKmGdWU1sEs5kRabp-2z9fdQ6E 1712
distllm/generate/readers/amp_json.py sha256=vwVMv_9shv2_RTwK5ctq8YPKJqMyOpIveAp-Nr_pmRI 1451
distllm/generate/readers/base.py sha256=H4CYoY6xgv2DzEmaWxv4IDI5pOTBYH6Oru1lkhnrEoo 723
distllm/generate/readers/huggingface.py sha256=v6dLGZQfxZWANO6tILwLnOM97-dtm_NGzLg_55X-9n4 1211
distllm/generate/readers/jsonl.py sha256=XT01ZN5UiT2vt2II8qx2s2g4EyXsnxfD3tEHA8d1wmA 1511
distllm/generate/writers/__init__.py sha256=4JhE7cZ0kYoh6SeNRtMdBDov9wSgb0_WCBZgiGxJOlw 1508
distllm/generate/writers/amp_json.py sha256=vsMxn1thL76tubvwjnIXKRxyEczDYluzP8cbuD8_9TQ 2598
distllm/generate/writers/base.py sha256=hyeoWzGQSKW6axoi2KaLZiFxDTR8kdPIaG1LhL-gMjs 1287
distllm/generate/writers/huggingface.py sha256=ffPk91apLUJYLjwRfh4gaeBGecp0lkllCPuXXTkr8Fs 2611
distllm/rag/__init__.py sha256=ptBkaLb23bCTT4eY904b_xrdFuiu28p70nb85-ezsoI 49
distllm/rag/evaluate.py sha256=jJp8ohjr6gQIJZw7XsLm4bvAUfnOr6Y6pdvehVV7ZMM 2975
distllm/rag/response_synthesizer.py sha256=xgMsiXpVDcpH9do-L707p0QiTEyGH_KF2o_WJRkj6Sw 3276
distllm/rag/search.py sha256=Yeqew08quSdMYiZkMTvA8xSSY1o8I63mfOBZMEuXKKE 31246
distllm/rag/tasks/__init__.py sha256=r6yYC6En2WjNKTE9Lxdm5nHmUDhuavAiAjvT2vt5bJM 1022
distllm/rag/tasks/base.py sha256=03fHhxmimHqJgn9Qopji2giKBWgK9G2HOhUd-N--o44 4279
distllm/rag/tasks/litqa.py sha256=HFH0POfw8HouwVP0pL9-UT31eXflIhRBwpJSDb-mEkA 3372
distllm/rag/tasks/protein_function_qa.py sha256=Jfzt3V44MhTzhOyhbXa1yIC0-cx8kn3CdOdW1jqTg-A 3845
distllm/rag/tasks/protein_interaction_qa.py sha256=s3__IW5QY4MEq58IEBd6vhfPgr207IU9tJuegoJgcDY 1795
distllm/rag/tasks/pubmedqa.py sha256=FikKkVjEEWwcxoapnhtQg_-lul9up3HzLd1YHZIvXPU 3095
distllm/rag/tasks/sciq.py sha256=yS2Txgr-ZONIGv3IjroF6wVK-OI7cVu_hQmjScfwK5c 3232
distllm-1.0.1.dist-info/LICENSE sha256=cytr9xZSJpIbXv_9BKo-bZmhJZxP8eAmH5615qvgcOo 1095
distllm-1.0.1.dist-info/METADATA sha256=Pkx1q7qM-sY8pZ-5zAShiOfrFp2JMgjjfAKKvho9wg8 5736
distllm-1.0.1.dist-info/WHEEL sha256=PZUExdf71Ui_so67QXpySuHtCi3-J3wvF4ORK6k_S8U 91
distllm-1.0.1.dist-info/entry_points.txt sha256=9v8T23zvOytIRoQi-158jV9annouAxgGS2bcoUAEcto 45
distllm-1.0.1.dist-info/top_level.txt sha256=PUJt_-xe-edjqgtE1eviWQipuCI_EsFwL-QRLyoxCaI 8
distllm-1.0.1.dist-info/RECORD — —

top_level.txt

distllm

entry_points.txt

[console_scripts]
distllm = distllm.cli:main