Wheelodex » Projects » furiosa-llm

furiosa-llm

View on PyPI — Reverse Dependencies (0)

2024.1.1 furiosa_llm-2024.1.1-py3-none-any.whl

Wheel Details

Project: furiosa-llm
Version: 2024.1.1
Filename: furiosa_llm-2024.1.1-py3-none-any.whl
Download: [link]
Size: 193096
MD5: cedbccdcaeaf5c46c9ce06f728a94753
SHA256: 93909750348926ae21601c548fa84ca17607aafd1a67e1b8a60da7739d181914
Uploaded: 2024-10-28 04:10:02 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: furiosa-llm
Version: 2024.1.1
Summary: "Furiosa LLM
Author-Email: "FurioaAI, Inc." <pkg[at]furiosa.ai>
Project-Url: Bug Tracker, https://github.com/furiosa-ai/furiosa-sdk/issues
Project-Url: Documentation, https://furiosa-ai.github.io/docs
Project-Url: Home, https://furiosa.ai
Project-Url: Source Code, https://github.com/furiosa-ai/furiosa-sdk
Classifier: Development Status :: 4 - Beta
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: System Administrators
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.8
Requires-Dist: furiosa-torch-ext (==2024.1.0)
Requires-Dist: furiosa-llm-models (==2024.1.0)
Requires-Dist: furiosa-model-compressor (==2024.1.0)
Requires-Dist: furiosa-smi-py (==2024.1.0)
Requires-Dist: furiosa-native-runtime (==2024.1.0)
Requires-Dist: furiosa-native-compiler (==2024.1.0)
Requires-Dist: openai (==1.44.0)
Requires-Dist: fastapi (==0.114.0)
Requires-Dist: uvicorn (==0.30.6)
Requires-Dist: pydantic (==2.9.0)
Requires-Dist: torch (==2.1.0)
Requires-Dist: transformers (==4.31.0)
Requires-Dist: ray
Requires-Dist: PyYAML
Requires-Dist: accelerate
Requires-Dist: mpmath (<1.4)
Requires-Dist: gitpython
Requires-Dist: more-itertools
Requires-Dist: mnist; extra == "test"
Requires-Dist: mypy; extra == "test"
Requires-Dist: pytest; extra == "test"
Requires-Dist: pytest-cov; extra == "test"
Requires-Dist: pytest-mock; extra == "test"
Requires-Dist: ruff; extra == "test"
Requires-Dist: tabulate; extra == "test"
Requires-Dist: types-tabulate; extra == "test"
Requires-Dist: types-protobuf; extra == "test"
Requires-Dist: types-psutil; extra == "test"
Requires-Dist: types-PyYAML; extra == "test"
Requires-Dist: sentencepiece; extra == "test"
Requires-Dist: pydot; extra == "test"
Provides-Extra: full
Provides-Extra: test
Description-Content-Type: text/markdown
[Description omitted; length: 265 characters]

WHEEL

Wheel-Version: 1.0
Generator: flit 3.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
furiosa_llm/__init__.py sha256=VO3p2iEQf9n1sJn41YwrnoVKCYV99Sg900TYdCqMHYM 964
furiosa_llm/_llm_testcase.py sha256=5nl3KIHIHQ9-8xbP8AyLanMPbz_IvKtEc1DNPYRg8wY 7161
furiosa_llm/api.py sha256=N6uKukILbZR-sQ80z1dYDbF1MtzxIg417jr_AlgZoIs 110664
furiosa_llm/compiler_config.py sha256=vappqAyUqavGjip2NVpZLYXNdUaTGumKvzuwY_rbaTc 6121
furiosa_llm/device.py sha256=O-Yu6LjbH70IbksxfraDeBbJQaZxsvD8m2mjFgyxJv8 2757
furiosa_llm/git_version.txt sha256=BcW6G1lWUgI8lSWuIWshqHX6cwnhkMRZmRTC2hejUdA 33
furiosa_llm/hash.py sha256=XtxWSIZdA9pdtZWZVlZVsfXeisWBsYQxpohfjghw4js 3163
furiosa_llm/models.py sha256=xEoBlk5VFR8tR3Etw5Jf3tgpOw8JUQu99VdQ5czirgE 48087
furiosa_llm/outputs.py sha256=nlhRHhq-6nW1Qu1BiEHHiwCp5F1g3gK73H3IV64hCOs 1594
furiosa_llm/py.typed sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
furiosa_llm/quantized_models.py sha256=yHpYZXy_kt7A7Q3SNF_qHUrYH1xJErT_Y1cuNOcBA_4 20598
furiosa_llm/sampling_params.py sha256=-hdUm346rAH8-bMhQQd5E5XUlINbO7qm9LnjmlX0xBM 8762
furiosa_llm/utils.py sha256=DrQVMK24J1Mp5Xan3KYy0bakyWRAEepFaMdIrDpLHSk 15262
furiosa_llm/version.py sha256=SLKssYQwaabU22oper1JU2MdWZDu7I0Tys17Wl_qfLQ 1543
furiosa_llm/cli/main.py sha256=JMHGndDcl9LGyh-_e0tVxOzUBfQDJzLumDNvRFlXXFk 495
furiosa_llm/cli/serve.py sha256=SFmBSDoMiSeN8kEjbfhoYK2_XVz9aI9w8a7RaOhtfTA 1817
furiosa_llm/model_configs/LLaMA3.1-70B.json sha256=8ysmbnfPcWog1r4HeeE7dDgaZgZokdDBKqdtim9pZRs 882
furiosa_llm/model_configs/LLaMA3.1-8B.json sha256=lPKSU6I1sJvV9YtOb24u7i99e_N-h5eMxw_Gnv1iX10 881
furiosa_llm/parallelize/__init__.py sha256=NRcnO8I1VS5q4WI9ZBmEfviEedpF2bJciZKBkq34J5M 136
furiosa_llm/parallelize/block_slicer.py sha256=SCQ3jZNCtMBYTxrzZRfrbGOaPIysXxEzVBFaey4Bh2U 21874
furiosa_llm/parallelize/config.py sha256=BsyFf8DuUO3WKly_5FT2-n2IVLPqCaUk-3QGwHGYWNo 7745
furiosa_llm/parallelize/custom_drawer.py sha256=HbP5edKKhNbcqMvuK2yc3GBKZqEpgdInF9ZSo4rjYWA 8871
furiosa_llm/parallelize/node_meta.py sha256=N1ouZHSnqt_vPOLvl3wJk0E3YuPBuD97IEeEQBxXtHk 5039
furiosa_llm/parallelize/utils.py sha256=tvcYWIg89lA1iYYdUTE8Cn96n-WXY9hZvEs03yiRR2Y 18961
furiosa_llm/parallelize/model_rewriter/__init__.py sha256=ncXZ0nbCxbCS79t556XaGsFu9U0qf7waHAMNpBfZvXI 71
furiosa_llm/parallelize/model_rewriter/cc_calculator.py sha256=GxbNTy9LN84RqCOTkIlkyDX97VHL9CYSVmMybA7jr9k 15157
furiosa_llm/parallelize/model_rewriter/cc_inserter.py sha256=8e8KOpUmRqxIQ2Zo4R16Ncbxsut7wZ-68nESHZ9SZ_w 5309
furiosa_llm/parallelize/model_rewriter/model_rewriter.py sha256=5uLD43gtGb-T3xIKl7X-EOleO4fLlx8qwibdZ1xJywQ 6081
furiosa_llm/parallelize/model_rewriter/mppp_config.py sha256=PDGgPO9NrXHzUBqItWfWkKzV-fFc01utverZZCZaaM8 9736
furiosa_llm/parallelize/model_rewriter/replicator.py sha256=5C29MQcSXSdEvwDvxM5p7OUb7khEdBivsiBc62evdew 15134
furiosa_llm/parallelize/model_rewriter/utils.py sha256=MIAEa-Hh85_9D_yLr6L9EXvF6pH6BhlB0lOiNJn7PG4 7981
furiosa_llm/parallelize/model_rewriter/ops/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
furiosa_llm/parallelize/model_rewriter/ops/comp.py sha256=TH57MG1yW-a1OAURrxz6VnibMupjked-gZpFjC5fTg8 883
furiosa_llm/parallelize/model_rewriter/ops/custom_ops.py sha256=_R3-E3vh-aM68cTD4yvrb1rIfiWX5h4bR3a1cQQmI1U 2151
furiosa_llm/parallelize/model_rewriter/ops/multi_device_comm.py sha256=ZjPigjCcJOhI0xo9hCNNvLF1sHW0qgHa6l5Myj-pW_c 10834
furiosa_llm/parallelize/model_rewriter/ops/single_device_comm.py sha256=uTwxIpL07i7UaIl9lR2gCLaxPVnF2zcxhYc4p6O2uUc 7217
furiosa_llm/parallelize/model_rewriter/ops/types.py sha256=pgodnE91d-4FYWTBnsXB9LtSnAESUzsP0XCUymjzFlU 3524
furiosa_llm/parallelize/model_rewriter/ops/utils.py sha256=bF4ZL8OGMyqowBk9kpYkmtc1UMioIA_6VNS_lGU8q3s 355
furiosa_llm/parallelize/model_rewriter/sharding_prop/__init__.py sha256=A-zh5_52wmoJFwEYM_T5JBTuo53C90WJIXU0OSitJcM 86
furiosa_llm/parallelize/model_rewriter/sharding_prop/embedding_op_strategy.py sha256=B3DXctpnJP67XcU-kY1R_A_kTqXajSY-j6yfmayLhXc 7567
furiosa_llm/parallelize/model_rewriter/sharding_prop/matmul_prop_rule.py sha256=frw1aRSZV3gfwRZWIf_Tm3F0ZNqLIL7kuyz6gMPbFAc 7910
furiosa_llm/parallelize/model_rewriter/sharding_prop/prop_rules.py sha256=lCzsPyWiNfAWtxuoPZD3AsUdlIQRB016GkTLxgjOqsU 3434
furiosa_llm/parallelize/model_rewriter/sharding_prop/sharding_propagator.py sha256=rl8PQ2sQGuopkXQjACRtqrDVryoWfZYr0gW6OJEQ7e8 24995
furiosa_llm/parallelize/mppp/__init__.py sha256=C48A_99SKfwsCBSVsAOt383uXbw90tm--z4AnY3nKRo 95
furiosa_llm/parallelize/mppp/mppp.py sha256=UBRPMpHq0Jp-jhrr1W3CfRLEcCyKoFp1CX_RyU3GBh4 6027
furiosa_llm/parallelize/pipeline/__init__.py sha256=OLeQnbivjzUCi4GiEPsvvmSgbdV5tuQ4_1PmHb50tus 52
furiosa_llm/parallelize/pipeline/pipeline.md sha256=gSX7ECxbf1bfDh_LIQRR9W1jmxHl48JIRyDE54bpUo4 17389
furiosa_llm/parallelize/pipeline/types.py sha256=FrebVfV01WABWkZloW_wlARDk3xhXrhFQGZxMfMf7JQ 13706
furiosa_llm/parallelize/pipeline_builder/__init__.py sha256=xrMJlNiSUMire1R67G6GpRq1Gq9CLrV0mZaWxYhmQBA 68
furiosa_llm/parallelize/pipeline_builder/builder.py sha256=div-WxIckGQcU89Grjw-70JEBzFxoSvVK9lhoWj2msc 31376
furiosa_llm/parallelize/pipeline_builder/converter.py sha256=QAjSct9bBn_hYPdSXstqLaktGDHDB_7x95uC-5Wn67o 47660
furiosa_llm/parallelize/pipeline_builder/export.py sha256=-ymGP2B1GYByxPBe7rRNeDHLrGX7cid_5S9R4BukvUs 3595
furiosa_llm/parallelize/pipeline_builder/model_creation_info.py sha256=NE1ZLc30GJkYe1us50VT9bJ_YjYpTprkEc3iHwNgA5Q 1620
furiosa_llm/parallelize/pipeline_builder/original_node_mapper.py sha256=qH9sONc9mmQO-eeHh8ec13J9w1XBblryIvgulDEVcOc 8482
furiosa_llm/parallelize/pipeline_builder/serialize.py sha256=HYTZXt-k-riei45r9mRFLkJRdJZZ7VUQSOmlvqEEbBo 12992
furiosa_llm/parallelize/pipeline_builder/single_device_comm_op_converter.py sha256=su-woJNU4yHJOGlYTRLVqR8YB9Thefh45uyPHtlWCwY 5128
furiosa_llm/parallelize/pipeline_builder/trace.py sha256=OD9vDoM_BXOhyU8ETKvl1KzP0taiKQjCZC_5hcCGTtY 34834
furiosa_llm/parallelize/pipeline_builder/transform.py sha256=zTfqwZJOwIBq9TDI1YkChw-99oH4--dnIu-8ouFnsAw 17914
furiosa_llm/parallelize/pipeline_builder/utils.py sha256=iju39hIKuMDNGFNmBVprJDss6ZzD-CRawNkOeswqTxo 5070
furiosa_llm/server/app.py sha256=CtUVdnDojcVWtznvsODXPWrP5VYjGm5OD3kVyAKVKME 2970
furiosa_llm/server/models.py sha256=9f9sR6_lAdAgcLXNxqwu2mDnwGQ1HNLca5h7z2FUex4 5061
furiosa_llm/server/parse.py sha256=jg4cZwmpgtKCUQeFIgfLoGAAlcaAqULfXPF5VRjOJCo 2682
furiosa_llm/server/protocol.py sha256=ChQHk2vyA4hP2eMCZA5A5YHBDsnDTeFN5ua7mcTBlSc 8154
furiosa_llm/server/serving_base.py sha256=rwgrgdEY4w2BBx4gR69jz0b3cq93x-Zp4vv1Ih_fh6U 845
furiosa_llm/server/serving_chat.py sha256=bto0W6e6xnbkNHJ-GPstGDtMUKsRru99lkg-BpC0GT8 8186
furiosa_llm/server/serving_completions.py sha256=OPYd0Y08xqcwL8aWsALsFo4Tc8FDEF0oRwP-yjpW4IY 7435
furiosa_llm/server/utils.py sha256=UIa3Eml0CMnseXxFUURC6Yc0oyWWJhJZewGN0e8Ep_U 2551
furiosa_llm/server/chat_template/Llama-3.1-70B-Instruct.tpl sha256=4QyjgbHMxc-dtS43HztmUVdsruCmMLRS4oFrLUBNS2U 4614
furiosa_llm/tokenizer/__init__.py sha256=gIfgg75S_WGBKWTQhDURnGkP-AVGFq0fW2fj8_hlNl0 94
furiosa_llm/tokenizer/tokenization_code_llama.py sha256=bRlqPTo1IfJaH0Yp4p5MnA_egLn6alJr5U356jnB-hI 19880
furiosa_llm/tokenizer/tokenizer.py sha256=Ju-oAwKvDxlBKjqoYW0Yik2X0E7CNpRt4T2PvuD30OQ 4978
furiosa_llm-2024.1.1.dist-info/entry_points.txt sha256=b5ri7tk9uct0PU1MJd3Gxdk_YES-Dn0wnLZzLqTVrJk 57
furiosa_llm-2024.1.1.dist-info/WHEEL sha256=EZbGkh7Ie4PoZfRQ8I0ZuP9VklN_TvcZ6DSE5Uar4z4 81
furiosa_llm-2024.1.1.dist-info/METADATA sha256=OqrKhwYp2gt6pTbOyXCK4O_4-xvwBAdgojfmP-yrri4 2521
furiosa_llm-2024.1.1.dist-info/RECORD — —

entry_points.txt

[console_scripts]
furiosa-llm = furiosa_llm.cli.main:main