Wheelodex » Projects » sharktank

sharktank

View on PyPI — Reverse Dependencies (0)

3.0.0 sharktank-3.0.0-py3-none-any.whl

Wheel Details

Project: sharktank
Version: 3.0.0
Filename: sharktank-3.0.0-py3-none-any.whl
Download: [link]
Size: 252947
MD5: 6f24462d39e0d55afee80cc751e313b3
SHA256: d14ec5e51e8835babe141a427a5facfcf484345568a6cd134c38846b897e5206
Uploaded: 2024-11-18 22:17:58 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: sharktank
Version: 3.0.0
Summary: SHARK layers and inference models for genai
Author: SHARK Authors
Project-Url: Repository, https://github.com/nod-ai/shark-ai
License: Apache-2.0
Classifier: Development Status :: 3 - Alpha
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Requires-Dist: iree-turbine
Requires-Dist: gguf (==0.6.0)
Requires-Dist: numpy (<2.0)
Requires-Dist: huggingface-hub (==0.22.2)
Requires-Dist: transformers (==4.40.0)
Requires-Dist: datasets
Requires-Dist: torch (>=2.3.0)
Requires-Dist: fastapi (==0.112.2)
Requires-Dist: uvicorn (==0.30.6)
Requires-Dist: datasets (==3.0.0); extra == "testing"
Requires-Dist: parameterized; extra == "testing"
Requires-Dist: pytest (==8.0.0); extra == "testing"
Requires-Dist: pytest-html; extra == "testing"
Provides-Extra: testing
Description-Content-Type: text/markdown
[Description omitted; length: 2082 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.5.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
sharktank/__init__.py sha256=jEqgKQGY2S9SsaKVFQGOfbKQ-Sv7Lf-9JHA1pOAa5Ws 229
sharktank/export.py sha256=nlb5vO61uGh9Xg4fW3uI7SOWsTRNCKKxCHMebljA1LU 5745
sharktank/py.typed sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
sharktank/evaluate/perplexity_prefill.py sha256=XKqZ82EP--ddZbSqFKm9CXMkTNz5NkqPxc5OHK_qpuY 8493
sharktank/evaluate/perplexity_torch.py sha256=ffBo5MQRJ5Pk7NgGKeTMnJFjlHsYIvlWUrZZtcdVlkc 10591
sharktank/evaluate/perplexity_vmfb.py sha256=L-_T7fYwCAxT1mOMcmPEgEF7ub1XqUiHJEET_Af_wSk 14810
sharktank/examples/export_paged_llm_v1.py sha256=PJBZ1jFinzxP9x1C2ZK4igP_p3EAplaTc7L6wOC-3rg 11558
sharktank/examples/paged_llm_v1.py sha256=KzMJITyx5G2CdPPsqIoYmeDWCU1FVvCoQEnn6WR9VsU 11538
sharktank/examples/validate_direct_llama_model.py sha256=IwYz1BT2v5DMk2N1mVsvNyIQY0hMGzVoGJFYCQ00ktg 5033
sharktank/examples/validate_direct_mixtral_model.py sha256=lDrYY3sdVCIMzsZFQLN7O2vwHxVgyTXFsKYgKqcBeUY 4166
sharktank/examples/validate_llama_ref_model.py sha256=jpqTmUWaRCw2YyUNpyWDSNkC2LdjbQEODd2XmO84-Zk 1453
sharktank/examples/validate_mixtral_ref_model.py sha256=ATfGIcvSAK3DphWgR4-4JBxcFBCa_cvNyjRlEzLH128 1458
sharktank/examples/validate_paged_llama_model.py sha256=HZ2MH-kWnxkWfSGU4U1rujEDligtlmj2qMrU29m4g3Q 5546
sharktank/examples/sharding/export_ffn_net.py sha256=mJ4IMEucX687QRYT8-BZjSNMrxmUP5OOjR_7_CoAqIk 3496
sharktank/examples/sharding/export_gemm.py sha256=-7xDt65NuyapJqsZgExBYzOZZHTOmHmjb4GwloECWCQ 3345
sharktank/examples/sharding/shard_llm_dataset.py sha256=Cvam4J5ERYjmqmQPy861LmCV6U2XNkkaEt1wFmDe3kU 1726
sharktank/export_layer/export_kv_cache.py sha256=pWaPssh6a2Jwf_8gPtsJBNvkA_8M4ghiGCIXnAqp9VU 3698
sharktank/export_layer/export_moe.py sha256=lsFfDHMc0xurQ6TWCAobasOSFnGSzAr7EL_2D191vyY 2223
sharktank/export_layer/export_paged_attention.py sha256=kqH6Kmw4uqEKpRNlQ_EMJ8RTaWTom9b47ZEuzbTr1MA 13695
sharktank/kernels/__init__.py sha256=wf-adKWahrNDs4XA-90VM7flcgKpUNzt9NxKsN7k0gg 580
sharktank/kernels/attention.py sha256=h1EEb7pzaVdHatvZWPQfTmIzyB-5S_TuS38cbat9XVA 3239
sharktank/kernels/base.py sha256=03if9G2L4HkWj1joGgADGVpodaY_ZSW51V8InDqe5mg 5000
sharktank/kernels/batch_matmul_transpose_b.py sha256=VKwSz9KpJl1v_nJv5fMtbqZqjbuTHlv7r0faXhI1oHk 3431
sharktank/kernels/bitcast.py sha256=r_3api59Kn7JY5u-p_zAu9f7MhFYWTo0wBh6CrL1f50 4133
sharktank/kernels/conv_2d_nchw_fchw.py sha256=quh0_TIBJY-SZDJ4C1F7ZOxlU7vgfi6yxOlrPSKKt9k 6653
sharktank/kernels/einsum_2args_q4.py sha256=xvKPo55bsylxa7ANsO24sxMmRrY3eMv_yyqH_6Ox5is 9138
sharktank/kernels/mmt_block_scaled_offset_q4.py sha256=KuruJsYoCfNby_nUpSk89yqPtJsigFjlJlhHf6GEl1I 4934
sharktank/kernels/mmt_block_scaled_q8.py sha256=vxFmmazWPJWBUwhJ_OE8MQDr-xZv-o9jihwPn63S7x4 3410
sharktank/kernels/mmt_super_block_scaled_offset_q4.py sha256=K8EUpuWTWUCGOqTnuRCBUf89CKN-gpN_zKJhvFM_J-4 6223
sharktank/kernels/mmtfp.py sha256=x5qL1otvKkjVMOUzPTqKAMfJOdeJ1W4qhC9lW8uustI 3312
sharktank/kernels/pooling_nchw_sum.py sha256=XmYyMtdN-mtTF_7nmaZ-KEDC-col4qALdUO0-WF_5-Q 3176
sharktank/kernels/templates/batch_matmul_transpose_b.mlir sha256=1U-74MyxtDtuZmy-JFulxhiFQ-YvQs2az158mbg5iK8 1308
sharktank/kernels/templates/conv_2d_nchw_fchw.mlir sha256=AZ5uRRYhO40Xb0KFZ-Rlp2X1oEM3xcN0pi7IDYZ7nDU 2224
sharktank/kernels/templates/einsum_2args_q4.mlir sha256=KHsP9xTmb0QALgnV_qp7shx6Z0OV4Y92pIr2R672TQA 5003
sharktank/kernels/templates/flash_attention.mlir sha256=yiExx249uB4dcbvdtF1X4lnwdkoMkmOmlc696Cs0-OU 1928
sharktank/kernels/templates/mmt_block_scaled_offset_q4_unsigned.mlir sha256=flk-5izTHMJYWgCpEjSCHdHC1ZwOeCemGJDp_pfP0qE 5415
sharktank/kernels/templates/mmt_block_scaled_q8_3d.mlir sha256=Jae0aWyahki_8LWJNbjxlNHt1eUHZBnopV1nZguuqCE 3784
sharktank/kernels/templates/mmt_super_block_scaled_offset_q4_unsigned_3d.mlir sha256=VFM6vT0wyEuY5Vwrc9GwxeV8ggQc4zs7ZprIkM7JiqE 7136
sharktank/kernels/templates/mmtfp_2d.mlir sha256=xyLnip6JkyxbE4n99L9TYJvH9YsG88lk0eJjkHjGZtc 1399
sharktank/kernels/templates/mmtfp_3d.mlir sha256=BNIFNx0FntcZIFPJ3wAf1iG6uWRZwH1rmo4nljWDZq8 2042
sharktank/kernels/templates/pooling_nchw_sum.mlir sha256=a-qh1H8SC5j1WUfREDb3wAGPEST9tDjKDA40OEdq_2g 1660
sharktank/layers/__init__.py sha256=iJq8VvlY1hlejL8rqPpOM-TgC4X-gCtI0dXczf1YXGw 821
sharktank/layers/base.py sha256=5qtQ5BHmokaTgukGsyDqx9Re4g5lINceRWMltbhsYa4 2001
sharktank/layers/causal_llm.py sha256=WoQ-mMfKF2CNksR9R1JzhfBrjeWEEfROL-kcwLm_5t4 5497
sharktank/layers/conv.py sha256=omxrklW3w65zmDiY2SARaNMH3GDkw0T6dcDZUvm6M0c 2371
sharktank/layers/ffn_block.py sha256=Xm8iW8eLCRyAbyv7TDsdme2X9bRcAdh9Fb9jJHgUL2c 969
sharktank/layers/ffn_moe_block.py sha256=YP9mnphp_ylVc5_YcefZbDZDuMXO3c3C7liZBcoclX4 4446
sharktank/layers/kv_cache.py sha256=5fdx1WRLdLIqd9Cl9hBZnrtbFrEGbC8oa_qwF0b_6PQ 19637
sharktank/layers/linear.py sha256=8D_wGQBUcQXUYRW5xgQIWxSfi0eQMtlWPCY9NFMj7Qg 3116
sharktank/layers/llama_attention_block.py sha256=7CMMyrF2XRKNpLMjihnsk0MR9Ws3onxnstXgXCogGjY 4361
sharktank/layers/mixture_of_experts_block.py sha256=PYHp8DPsynUIkUntCK7QAzdJ9Fw1H8097LsIP39TL-0 2856
sharktank/layers/norm.py sha256=AA7can3WbHJ67EOtexLh5U4WBjbIvSFOKkP43LhtKTY 1312
sharktank/layers/paged_llama_attention_block.py sha256=sm_dfywLfR-wA21FRxwWHUWbj2gULzV2qGmhkytPR14 11087
sharktank/layers/rotary_embedding.py sha256=-GZhl-80EwsKH18rXVCwrXm7hWBGh0bu-79NK3iAboQ 9236
sharktank/layers/testing.py sha256=qWvvuB8nZJXU_I4ZSiid3I8CrmtHxhmJMOKDGNx9hEo 1507
sharktank/layers/token_embedding.py sha256=wbvDt0mfaHjh_IkimbEC49nDOy3s8H4R_UE6_k0S2E0 724
sharktank/layers/configs/__init__.py sha256=wMdf7_C-aR7u2VbhO59DfjSXD0_Vb4UlHTJtuLXBjU8 257
sharktank/layers/configs/llm_configs.py sha256=Le21MsRdvBYA4wbymBMo_Wq6Ly_6gwKF_SBivaufQhA 7052
sharktank/models/grok/grok.py sha256=H_xBC0xda6YGU90VNfaqT3BHia9zZU5DduMTXiD1TSg 8205
sharktank/models/llama/llama.py sha256=gqr_BvF_yvAjcs2WpKOVAnPmozZRzVBdfoU6Fyz7L9w 12778
sharktank/models/llama/llama_ref.py sha256=QwrVDvoJRtb7qoMCfGrOkrqzkzzeVXSsrhwhobXgj-0 8704
sharktank/models/llama/sharding.py sha256=EFcooBp4fQsMCTnVuqf5d1-1Qet4X4O5JNxXrlYfBTE 4319
sharktank/models/llama/testing.py sha256=6qjiSnEY9CbdxvYQLj0J_-O2fzilRf6xuVrZ-Ln4eNg 5360
sharktank/models/llama/tools/data_utils.py sha256=kGcPBK64v6boNn_OBJ2Twp_W-DHvFJnRAw29PdLPZA0 1205
sharktank/models/llama/tools/generate_data.py sha256=OkR8Ap5DAjzrvFpmzUrOctXqY8PHk6Zn7259wyHCdBY 4152
sharktank/models/llama/tools/import_quark_dataset.py sha256=0ziaaxnmRdb5yMGik2eEt47PfAzntVhaKaXtjXl1O7Y 13145
sharktank/models/mixtral/mixtral.py sha256=GJygyvgM3Wn-X6WnwXfc7_XLIe-5t0-_dPZBrswKTp8 7965
sharktank/models/mixtral/mixtral_ref.py sha256=OLDvttsQuC4thw5-Yn-1jM8LY0n15NXucULAhTG2R6M 5555
sharktank/models/punet/config.py sha256=jTPfu-BIsj391itphZ0oL6bykW8XLlRTY-7ejJenRM4 4803
sharktank/models/punet/layers.py sha256=eG2N5MBQ5-v3xNr0qX72zUnXkz1fqtnfNUL0RFlKkrM 26719
sharktank/models/punet/model.py sha256=O1WpCNV05cA7y39ArR9B25sx2Q8Oxmyyt33u4W-gMN4 14410
sharktank/models/punet/sharding.py sha256=nndlO2VQJ3VIQIUf9dlESmUzLfSHcnw5qf-CEriDbuU 3499
sharktank/models/punet/testing.py sha256=IVkE21IJjmd6DGtTBDrrFPV4CzNuwu1UCz6yYa0xdgg 4271
sharktank/models/punet/tools/import_brevitas_dataset.py sha256=nb7gOQstrjwSglPeYOwoxqLI0BdoO6brlglmWjSVbV0 14159
sharktank/models/punet/tools/import_hf_dataset.py sha256=xa2tv_-Xow2YLV_hN1-OGL9yB5RaTmaWW-joSxrqGJw 2613
sharktank/models/punet/tools/run_diffuser_ref.py sha256=i0ctLCHD2QcgRSPso5lzalXoAGE6QZdZKgVeqwdB1uo 3447
sharktank/models/punet/tools/run_punet.py sha256=jV_NDSE0bT1Rhtr_prDu9i-lSE5x98bYkRLC31YNpco 2770
sharktank/models/punet/tools/sample_data.py sha256=iKFs-3QlvoglxAByvm4vbHTtLVKgBQO-umpi1TvY5vQ 1868
sharktank/ops/__init__.py sha256=2j8qHNe9YXYmYVHqPGkqbAQV1JdEo1Zm2R1TJn4OEdE 1342
sharktank/ops/_registry.py sha256=lewJxsiQmG8c80xCxQncjfIthv2zOM5LGqZJd3nMDCo 10018
sharktank/ops/attention_impls.py sha256=btLiDfFztWPoMqNb2ESYocZHKRoNYXmjAW4rPGycbEA 1880
sharktank/ops/custom_impls.py sha256=-ZIXRG5hgI3S9dBhafDsGsmCEjy5JEGs22y8PYymVrc 4216
sharktank/ops/default_impls.py sha256=12t1PRg9-y0M_08Un4W-WF8Jf9FG2AvNizRS0orzggs 15658
sharktank/ops/qconv_impls.py sha256=__n7Q-Aenj2kPVpFjh7GLWC__d0qp6fIrycXkrZq7f0 10954
sharktank/ops/qlinear_impls.py sha256=WuLbQ5At1x9WwBbv5JFUAraVMYTg67tW9Lu3Pchlf9Y 7151
sharktank/ops/shape.py sha256=5Q1bgZ89B034ERaRBJuyVklDpNsJln4Jw8N71Hh1kRo 2051
sharktank/ops/sharded_impls.py sha256=Lzu7yv4qt6z2lMSDy1nNrUP4xpXoZ-hK1E0rcX-mVeY 45719
sharktank/ops/signatures.py sha256=UXxfRhHFxgZopAG277ywz81rebXRW2lgHNUvcRZrDb4 29804
sharktank/serving_poc/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
sharktank/serving_poc/py.typed sha256=jnEa4Z-6470oR8rRQKiom2ZEP9BiEWxjxaf3QgZPiLo 48
sharktank/serving_poc/framework/logging.py sha256=ZtIaOjkhNtLLq8OodpLG_kGQAZJqT3icf6kxErvSyVs 1350
sharktank/serving_poc/framework/session.py sha256=__2CJh39uAkkfwSLNtumaKg6zbrSZBqEkfgzb3h7Qn4 20098
sharktank/serving_poc/llm/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
sharktank/serving_poc/llm/attn_block_cache.py sha256=IdF7z1z1ZSDFOBMg9ThcCXbQx_pdwFy3GPX4sDgaCGs 4367
sharktank/serving_poc/llm/config.py sha256=ps5LdYckwap0Q_dyHDycnSigkP185hCJljoh5W9sOEQ 6129
sharktank/serving_poc/llm/service.py sha256=UBdWtqcVxs8PVU8F9zWrKfp9EW7qa5FH8DM8o8UPLCY 5451
sharktank/serving_poc/llm/api/rest_server.py sha256=Q0Cot25msMy3vGMUQ4rZ43AjqKbue1gjjXdL9GNBNLY 3629
sharktank/serving_poc/llm/impl/service_v1.py sha256=vnDOEUyEjoyqqX_Ha2GaYMfTRQMH0afctH4-UYKpA0E 18148
sharktank/serving_poc/llm/impl/service_v1_cli.py sha256=5AcB974iX0L4--9kIJbDHcgcGcMElQtt6msOCNM1GD8 4111
sharktank/serving_poc/llm/testing/fake_v1_module.py sha256=TSF_A4ywxMJCxln2ZwRYY6PqVObF-2I0nhWzmQaV9cI 3850
sharktank/tools/compare_safetensors.py sha256=8scmjF-ep8rUz3PclnGMs4Yn7UEqo1X5uksa8HJ_uE4 5070
sharktank/tools/dump_gguf.py sha256=9cJFnnYk3RXs39qXnDWC7hHJR1iSxQAouxWLa2Cgpq0 2850
sharktank/transforms/dataset/__init__.py sha256=KTcEykXpqSvCuNYa-ZoWGkxvLxjezEOHViNH6SKst4g 254
sharktank/transforms/dataset/sharding.py sha256=UaL3NV3Dd9VrRnuKyRmFuWPWwBn-wfJZp7LFK7oIB2k 2217
sharktank/types/__init__.py sha256=e13dL8t-7WSsbxYaz5ooRiynjJ-4zJ9BhQc8sFdo1PY 351
sharktank/types/layout_utils.py sha256=02FaIXaTvwUJtyUar5fttgd2iMSkeTM9t9ZttE2cbxE 6220
sharktank/types/layouts.py sha256=O5Icp_Cc2MF2Fdq_4y-MNwtocOb0pMf6wcP6wdvOLc8 16224
sharktank/types/quantizers.py sha256=BMQL5nsx0WTaisEPoE7l69lEI3XjNXxzOW8CTtMltqk 16515
sharktank/types/sharding.py sha256=L6F3KrDHWjRpQYfvmGUBWZ0JxfMR-o6CPxySlGCZNTE 6379
sharktank/types/tensors.py sha256=8tJvvEKPLRJOpSHO5oIyaFoqpszKKPw_JxnKhcEsk3w 46288
sharktank/types/theta.py sha256=cTTwWkzNsjtI9cj2A3S-JoQPUG7kWfrDDO8Fy6p_yWk 18665
sharktank/types/gguf_interop/__init__.py sha256=vTCwrHjS5BoccEO1h8J0_6s2ZMs3Zg5vVhoX90U1PYs 281
sharktank/types/gguf_interop/base.py sha256=72SlirCqW-bCEKxH-3YoXgXFAiZlQa3FU011vGnS3tE 4060
sharktank/types/gguf_interop/layouts.py sha256=QmvZcBU0nEFo9tuDjtynfNKsNoxcmX2jNZCWLYv6Aeo 10232
sharktank/utils/__init__.py sha256=0NS61IAuI1tkCEHna7eKCAf0Dm87po9ed5Bdnec56QU 250
sharktank/utils/cli.py sha256=y4PxwuzdzrxmgIGaQfWX-KSsGpLpQbVjd_gDz55nV5Y 4847
sharktank/utils/create_cache.py sha256=7gJn0_B0moyE_tB206HwHxSACzDehVud1o7ePSxGgPM 1308
sharktank/utils/debugging.py sha256=8_rH0p2SklPlqBf6NYbTBJoWV0bBBGwTTy8SX9ryCGc 3825
sharktank/utils/export_artifacts.py sha256=U2qCPoW6lK58wTjGlyzE3eErooHOQMtl4hXPuEu_KWE 10630
sharktank/utils/hf_datasets.py sha256=OF3h0oXL6Zib1W_CqGU-gjagaD4njaQEwYj3duHEzVQ 9055
sharktank/utils/io.py sha256=vpBnMgFKJJTs1zY_xosjsf9RyYhLjxvm-C0f5auqPFw 1756
sharktank/utils/iree.py sha256=6BFX4fjNleUhmaUyJunnwqFGDFjmtv0uXCsgIpcUpFI 7604
sharktank/utils/load_llm.py sha256=6XiAlYeMiYjSbSDQB_cYDtHy3nCPj3jFG9xL_-iehLo 7635
sharktank/utils/logging.py sha256=Bsf1mUsyXT0a8p5tfpe9flsjajfHgAX-G_nTGKQV-Ss 370
sharktank/utils/math.py sha256=efSVwoXXO8NnggJYhsR6tytTIwzPojSo7I2qXxiWCHc 442
sharktank/utils/misc.py sha256=YFxRf_LPNBexPkUef-qJROLM6mo_-onXxPvJw2hRV2A 965
sharktank/utils/patching.py sha256=TKo9vzS5XbQ58nZlZ6XLm-oKC1G8Lo9ey6ZM0oBx1HQ 2785
sharktank/utils/testing.py sha256=YUc4HVFTkx7z1KTG7PgrryTuKHkpiWwRp7zE4GgQff8 6112
sharktank/utils/tokenizer.py sha256=CTbwvtQPsMbJaZ6uMNP0T0E6urwm4bz-Lui-K3HXcHQ 3744
sharktank/utils/tree.py sha256=XcwDU0yBO2JN6P_5SvofyDOdKD8PNji6kAp5uZXW9FY 1628
sharktank/utils/vmfb_runner.py sha256=n0X0uynZ2WOpWS5J8Hx-mf2ywXDqt0RV-7o_VwjOCcY 3108
sharktank-3.0.0.dist-info/METADATA sha256=yAlk3knoiuzKcjBjsjxX753DA2ya82K7SWHUh2hKseo 2976
sharktank-3.0.0.dist-info/WHEEL sha256=R06PA3UVYHThwHvxuRWMqaGcr-PuniXahwjmQRFMEkY 91
sharktank-3.0.0.dist-info/top_level.txt sha256=oSoFZzz1TWh9sLGFIiy1n6ARmNjGTARk5_Tagz9vzKA 10
sharktank-3.0.0.dist-info/RECORD — —

top_level.txt

sharktank