Wheelodex » Projects » sglang-router

sglang-router

View on PyPI — Reverse Dependencies (0)

0.0.4 sglang_router-0.0.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
sglang_router-0.0.4-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
sglang_router-0.0.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
sglang_router-0.0.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
sglang_router-0.0.4-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
0.0.1 sglang_router-0.0.1-py3-none-any.whl

Wheel Details

Project: sglang-router
Version: 0.0.1
Filename: sglang_router-0.0.1-py3-none-any.whl
Download: [link]
Size: 443095
MD5: 34c09f9158075a76f238893746f8f5b3
SHA256: 1d4e75ab9681883127de56c539d0ff8cabc825f76862aa47955754599ce315bd
Uploaded: 2024-11-10 19:52:10 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: sglang-router
Version: 0.0.1
Summary: SGLang is yet another fast serving framework for large language models and vision language models.
Project-Url: Homepage, https://github.com/sgl-project/sglang
Project-Url: Bug Tracker, https://github.com/sgl-project/sglang/issues
License: Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION 1. Definitions. "License" shall mean the terms and conditions for use, reproduction, and distribution as defined by Sections 1 through 9 of this document. "Licensor" shall mean the copyright owner or entity authorized by the copyright owner that is granting the License. "Legal Entity" shall mean the union of the acting entity and all other entities that control, are controlled by, or are under common control with that entity. For the purposes of this definition, "control" means (i) the power, direct or indirect, to cause the direction or management of such entity, whether by contract or otherwise, or (ii) ownership of fifty percent (50%) or more of the outstanding shares, or (iii) beneficial ownership of such entity. "You" (or "Your") shall mean an individual or Legal Entity exercising permissions granted by this License. "Source" form shall mean the preferred form for making modifications, including but not limited to software source code, documentation source, and configuration files. "Object" form shall mean any form resulting from mechanical transformation or translation of a Source form, including but not limited to compiled object code, generated documentation, and conversions to other media types. "Work" shall mean the work of authorship, whether in Source or Object form, made available under the License, as indicated by a copyright notice that is included in or attached to the work (an example is provided in the Appendix below). "Derivative Works" shall mean any work, whether in Source or Object form, that is based on (or derived from) the Work and for which the editorial revisions, annotations, elaborations, or other modifications represent, as a whole, an original work of authorship. For the purposes of this License, Derivative Works shall not include works that remain separable from, or merely link (or bind by name) to the interfaces of, the Work and Derivative Works thereof. "Contribution" shall mean any work of authorship, including the original version of the Work and any modifications or additions to that Work or Derivative Works thereof, that is intentionally submitted to Licensor for inclusion in the Work by the copyright owner or by an individual or Legal Entity authorized to submit on behalf of the copyright owner. For the purposes of this definition, "submitted" means any form of electronic, verbal, or written communication sent to the Licensor or its representatives, including but not limited to communication on electronic mailing lists, source code control systems, and issue tracking systems that are managed by, or on behalf of, the Licensor for the purpose of discussing and improving the Work, but excluding communication that is conspicuously marked or otherwise designated in writing by the copyright owner as "Not a Contribution." "Contributor" shall mean Licensor and any individual or Legal Entity on behalf of whom a Contribution has been received by Licensor and subsequently incorporated within the Work. 2. Grant of Copyright License. Subject to the terms and conditions of this License, each Contributor hereby grants to You a perpetual, worldwide, non-exclusive, no-charge, royalty-free, irrevocable copyright license to reproduce, prepare Derivative Works of, publicly display, publicly perform, sublicense, and distribute the Work and such Derivative Works in Source or Object form. 3. Grant of Patent License. Subject to the terms and conditions of this License, each Contributor hereby grants to You a perpetual, worldwide, non-exclusive, no-charge, royalty-free, irrevocable (except as stated in this section) patent license to make, have made, use, offer to sell, sell, import, and otherwise transfer the Work, where such license applies only to those patent claims licensable by such Contributor that are necessarily infringed by their Contribution(s) alone or by combination of their Contribution(s) with the Work to which such Contribution(s) was submitted. If You institute patent litigation against any entity (including a cross-claim or counterclaim in a lawsuit) alleging that the Work or a Contribution incorporated within the Work constitutes direct or contributory patent infringement, then any patent licenses granted to You under this License for that Work shall terminate as of the date such litigation is filed. 4. Redistribution. You may reproduce and distribute copies of the Work or Derivative Works thereof in any medium, with or without modifications, and in Source or Object form, provided that You meet the following conditions: (a) You must give any other recipients of the Work or Derivative Works a copy of this License; and (b) You must cause any modified files to carry prominent notices stating that You changed the files; and (c) You must retain, in the Source form of any Derivative Works that You distribute, all copyright, patent, trademark, and attribution notices from the Source form of the Work, excluding those notices that do not pertain to any part of the Derivative Works; and (d) If the Work includes a "NOTICE" text file as part of its distribution, then any Derivative Works that You distribute must include a readable copy of the attribution notices contained within such NOTICE file, excluding those notices that do not pertain to any part of the Derivative Works, in at least one of the following places: within a NOTICE text file distributed as part of the Derivative Works; within the Source form or documentation, if provided along with the Derivative Works; or, within a display generated by the Derivative Works, if and wherever such third-party notices normally appear. The contents of the NOTICE file are for informational purposes only and do not modify the License. You may add Your own attribution notices within Derivative Works that You distribute, alongside or as an addendum to the NOTICE text from the Work, provided that such additional attribution notices cannot be construed as modifying the License. You may add Your own copyright statement to Your modifications and may provide additional or different license terms and conditions for use, reproduction, or distribution of Your modifications, or for any such Derivative Works as a whole, provided Your use, reproduction, and distribution of the Work otherwise complies with the conditions stated in this License. 5. Submission of Contributions. Unless You explicitly state otherwise, any Contribution intentionally submitted for inclusion in the Work by You to the Licensor shall be under the terms and conditions of this License, without any additional terms or conditions. Notwithstanding the above, nothing herein shall supersede or modify the terms of any separate license agreement you may have executed with Licensor regarding such Contributions. 6. Trademarks. This License does not grant permission to use the trade names, trademarks, service marks, or product names of the Licensor, except as required for reasonable and customary use in describing the origin of the Work and reproducing the content of the NOTICE file. 7. Disclaimer of Warranty. Unless required by applicable law or agreed to in writing, Licensor provides the Work (and each Contributor provides its Contributions) on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied, including, without limitation, any warranties or conditions of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE. You are solely responsible for determining the appropriateness of using or redistributing the Work and assume any risks associated with Your exercise of permissions under this License. 8. Limitation of Liability. In no event and under no legal theory, whether in tort (including negligence), contract, or otherwise, unless required by applicable law (such as deliberate and grossly negligent acts) or agreed to in writing, shall any Contributor be liable to You for damages, including any direct, indirect, special, incidental, or consequential damages of any character arising as a result of this License or out of the use or inability to use the Work (including but not limited to damages for loss of goodwill, work stoppage, computer failure or malfunction, or any and all other commercial damages or losses), even if such Contributor has been advised of the possibility of such damages. 9. Accepting Warranty or Additional Liability. While redistributing the Work or Derivative Works thereof, You may choose to offer, and charge a fee for, acceptance of support, warranty, indemnity, or other liability obligations and/or rights consistent with this License. However, in accepting such obligations, You may act only on Your own behalf and on Your sole responsibility, not on behalf of any other Contributor, and only if You agree to indemnify, defend, and hold each Contributor harmless for any liability incurred by, or claims asserted against, such Contributor by reason of your accepting any such warranty or additional liability. END OF TERMS AND CONDITIONS APPENDIX: How to apply the Apache License to your work. To apply the Apache License to your work, attach the following boilerplate notice, with the fields enclosed by brackets "[]" replaced with your own identifying information. (Don't include the brackets!) The text should be enclosed in the appropriate comment syntax for the file format. We also recommend that a file or class name and description of purpose be included on the same "printed page" as the copyright notice for easier identification within third-party archives. Copyright [yyyy] [name of copyright owner] Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: Apache Software License
Requires-Python: >=3.8
Requires-Dist: requests
Requires-Dist: tqdm
Requires-Dist: numpy
Requires-Dist: IPython
Requires-Dist: sglang[srt]; extra == "all"
Requires-Dist: sglang[openai]; extra == "all"
Requires-Dist: sglang[anthropic]; extra == "all"
Requires-Dist: sglang[litellm]; extra == "all"
Requires-Dist: sglang[srt_hip]; extra == "all-hip"
Requires-Dist: sglang[openai]; extra == "all-hip"
Requires-Dist: sglang[anthropic]; extra == "all-hip"
Requires-Dist: sglang[litellm]; extra == "all-hip"
Requires-Dist: sglang[srt_xpu]; extra == "all-xpu"
Requires-Dist: sglang[openai]; extra == "all-xpu"
Requires-Dist: sglang[anthropic]; extra == "all-xpu"
Requires-Dist: sglang[litellm]; extra == "all-xpu"
Requires-Dist: anthropic (>=0.20.0); extra == "anthropic"
Requires-Dist: sglang[all]; extra == "dev"
Requires-Dist: sglang[test]; extra == "dev"
Requires-Dist: sglang[all_hip]; extra == "dev-hip"
Requires-Dist: sglang[test]; extra == "dev-hip"
Requires-Dist: sglang[all_xpu]; extra == "dev-xpu"
Requires-Dist: sglang[test]; extra == "dev-xpu"
Requires-Dist: litellm (>=1.0.0); extra == "litellm"
Requires-Dist: openai (>=1.0); extra == "openai"
Requires-Dist: tiktoken; extra == "openai"
Requires-Dist: aiohttp; extra == "runtime-common"
Requires-Dist: decord; extra == "runtime-common"
Requires-Dist: fastapi; extra == "runtime-common"
Requires-Dist: hf-transfer; extra == "runtime-common"
Requires-Dist: huggingface-hub; extra == "runtime-common"
Requires-Dist: interegular; extra == "runtime-common"
Requires-Dist: orjson; extra == "runtime-common"
Requires-Dist: packaging; extra == "runtime-common"
Requires-Dist: pillow; extra == "runtime-common"
Requires-Dist: prometheus-client (>=0.20.0); extra == "runtime-common"
Requires-Dist: psutil; extra == "runtime-common"
Requires-Dist: pydantic; extra == "runtime-common"
Requires-Dist: python-multipart; extra == "runtime-common"
Requires-Dist: torchao; extra == "runtime-common"
Requires-Dist: uvicorn; extra == "runtime-common"
Requires-Dist: uvloop; extra == "runtime-common"
Requires-Dist: pyzmq (>=25.1.2); extra == "runtime-common"
Requires-Dist: outlines (>=0.0.44); extra == "runtime-common"
Requires-Dist: modelscope; extra == "runtime-common"
Requires-Dist: sglang[runtime_common]; extra == "srt"
Requires-Dist: torch; extra == "srt"
Requires-Dist: vllm (==0.6.3.post1); extra == "srt"
Requires-Dist: sglang[runtime_common]; extra == "srt-hip"
Requires-Dist: torch; extra == "srt-hip"
Requires-Dist: vllm (==0.6.3.dev13); extra == "srt-hip"
Requires-Dist: sglang[runtime_common]; extra == "srt-xpu"
Requires-Dist: jsonlines; extra == "test"
Requires-Dist: matplotlib; extra == "test"
Requires-Dist: pandas; extra == "test"
Requires-Dist: sentence-transformers; extra == "test"
Requires-Dist: accelerate; extra == "test"
Requires-Dist: peft; extra == "test"
Provides-Extra: all
Provides-Extra: all_hip
Provides-Extra: all_xpu
Provides-Extra: anthropic
Provides-Extra: dev
Provides-Extra: dev_hip
Provides-Extra: dev_xpu
Provides-Extra: litellm
Provides-Extra: openai
Provides-Extra: runtime_common
Provides-Extra: srt
Provides-Extra: srt_hip
Provides-Extra: srt_xpu
Provides-Extra: test
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 4919 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.3.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
sglang/__init__.py sha256=b_pqO9bR2fjK9En_tigfzKTiQzE8b_hUizY0DAKVk1M 1616
sglang/api.py sha256=3I9YUJNOeCqwKymZec2JR_agjTyKIx4XoT6IGdZ4_Cs 6953
sglang/bench_latency.py sha256=SSqZjcCNO88ExpT94qBZ5CmuA5o0T8wMTBnxLsNMqik 18259
sglang/bench_server_latency.py sha256=N1MODIzcMk74yOWmY19d36aih3ewtHOemLxoieKtdhw 5866
sglang/bench_serving.py sha256=0RR0RsrQqLWqcIPENfrS97F9HJiVXIZvGOWy4R2GvDA 43680
sglang/check_env.py sha256=rGRABCgt-0SfUrow4px28b2P59aMn8eVTnN5eZc_a8s 5397
sglang/global_config.py sha256=fnT0U9vlHdGaQFKN9tYTnUF4-eVW4HYQURd5zvPtrg0 1286
sglang/launch_server.py sha256=_XIqBcXArYtHTqilOFkYWKZBYXGCMHAxbYOST08LGj0 415
sglang/launch_server_llavavid.py sha256=tGc17S1vUfLwbi1GB26oOdXxTWr7gjlqpTrPnrMRNO8 1007
sglang/utils.py sha256=eCvD3fZCALr-MuyZxJL7HAeeqqpxAxf4LJrf7OiCbco 11547
sglang/version.py sha256=ThnCuF3X7rsQSd5PAea_jfYA70ZmhLvkFcLBxBPwZnY 22
sglang/lang/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
sglang/lang/chat_template.py sha256=jprS3-In2FTUoedKwZg-HYvDwU8RTIYntOlf2zoN2sU 14814
sglang/lang/choices.py sha256=-W1DVw9N9ZliVpvmWrzIXG4cswAah8eMQrHWzkS3D8o 6234
sglang/lang/compiler.py sha256=o1C6G3TzhjSlsH-doTPy5oiVehr57dxNTa5oZw5TTAI 7639
sglang/lang/interpreter.py sha256=SBjejhLhTKzNM0HbjtTg5r17WPJ64WFSk6lcM_SCWKs 30717
sglang/lang/ir.py sha256=zpzzAO1YVldhE95Vwz5hU_TQltu-xt8A6rfFr0PuIDA 18410
sglang/lang/tracer.py sha256=borJmlSJOhg1RUndGRnilnR60eEZz2Y9aU7BpftsOxU 8287
sglang/lang/backend/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
sglang/lang/backend/anthropic.py sha256=EXRX7xJgA5KZszX7toSLVnKzFQ5EO0Loj-YjHFtxSxg 2081
sglang/lang/backend/base_backend.py sha256=Q5HdiDtyBewQeoYH0kDtBRVL8KFiEPNq9dw7XmauHQ8 1985
sglang/lang/backend/litellm.py sha256=ugmL7sfUxkUHVbHtwNzHgdQAEd4UCjNQboFuE3KThcY 2450
sglang/lang/backend/openai.py sha256=qM7eVH_kMxnDd2rpxOH0v76KxtOJFlAwgLgWIKvFGCI 15060
sglang/lang/backend/runtime_endpoint.py sha256=iVb7SlrpJ1ic92QG5kQUphZUb2EaVWY43dkmAO5pju4 10514
sglang/lang/backend/vertexai.py sha256=O-iBLD-y3vq80UxnrAoJri7bxpgd-_eakZ88Cf8bEGA 4855
sglang/srt/conversation.py sha256=erz6wEXMcSmBlskuUhX2c-MT0EMyqyFpTem9PgastEE 21107
sglang/srt/hf_transformers_utils.py sha256=QbYVTnz0UdaXESPMAaq1OMzzznn95J_l08eXJuB68aU 6618
sglang/srt/mm_utils.py sha256=ml68nWUJhs_FS2FU1oB9UPHKZmF7P2DQHl1ddywn4ao 12272
sglang/srt/server.py sha256=Dge6wRzZG41IFegXwQ9HECZHk_Tx3dfXFcb7ThG-M1w 28420
sglang/srt/server_args.py sha256=K-9HXFKEjgo_WGU6iNxEjzxDaLxkSHLsXycQoZLKYlo 29544
sglang/srt/utils.py sha256=WtUZafw6WjAbjtRn_rTW5i2HgYJ65rrtZGpob3ngeuA 26016
sglang/srt/configs/__init__.py sha256=_usVIXHQjft4PAJ1Y-yGQOn2QNOv501GYMlQwpGXbns 208
sglang/srt/configs/exaone.py sha256=Duxd4yQoKy8GWEzZD_kCY_OzmN_67CTJL_Kgn0eXk3g 10731
sglang/srt/configs/model_config.py sha256=VppwJSbW7-8wYYIYH3dmGImFCIPuE8F_qqiNejlOs2E 9410
sglang/srt/configs/qwen2vl.py sha256=AYHuFgJ0bwhWYkD7S6fvP7yJejJnuhy4xp5Q2W-O6ps 4424
sglang/srt/constrained/__init__.py sha256=VXEY9K8HrEBv6QHe3X7J5ingiDugSF9_cpEbEcpBId4 2466
sglang/srt/constrained/base_tool_cache.py sha256=5sazBMHHDpHMoqOjuY6itCxwTmIFCflIWEDXMtmrPVs 2006
sglang/srt/constrained/bnf_cache.py sha256=c8msJ57Gj7aMy1ccTRERLgVuovEeDJx-wVPOhYF0w9k 2057
sglang/srt/constrained/fsm_cache.py sha256=CWwtOHTU3sHmw71OhWxl05YgU7cNNVWohlUt71rG230 3536
sglang/srt/constrained/grammar.py sha256=kvfyP2E53xo8jVWVZ_qHlJn0U4Qi2WaNi2yMZPKgI_0 6952
sglang/srt/constrained/jump_forward.py sha256=o-CzJu3DEs0eFKlLzsQVYMSo4vBKpffs25sXLOJd6jc 6997
sglang/srt/layers/activation.py sha256=7VEkCrx2dvl629Lz0fkJcJfVoZA-ykEdkpTzKEc_drQ 5225
sglang/srt/layers/layernorm.py sha256=HCj8Y_X6MNNdtQU2sWKgyjIqVERxl9dqrmjbBbyJjpE 3796
sglang/srt/layers/linear.py sha256=EOdlpAf6srqxzvPpxcv10KFJKedNc22CGP1qEvpRbDg 46131
sglang/srt/layers/logits_processor.py sha256=1l-hJoeZUfrPPmCWcyscl0ThgKWpprUELiL1mVDfbPE 12556
sglang/srt/layers/pooler.py sha256=rj2lygvleBnyLCBZ8I11HGMgpfIDsT0l3PIkshJwdu4 1606
sglang/srt/layers/radix_attention.py sha256=i07VRXPDHj-zJ1TSrXEqCxumQwYSHwAvc8DoIg-Irtg 1964
sglang/srt/layers/rotary_embedding.py sha256=gfRKBB8FmsQKiDH0Crh_KRIGRUuvEgazH1p_n9D_m7E 3889
sglang/srt/layers/sampler.py sha256=3zfth1Kz24X4sUq7Z_cjZwHgPVivI-rgPtIeUbsiiWU 4589
sglang/srt/layers/torchao_utils.py sha256=1nzZkSzbF4qCAMeBKAeeDpMl_mK8imiY2RL3xFEgvAw 3340
sglang/srt/layers/vocab_parallel_embedding.py sha256=RmaZbgXbFnGKX1eGYxlmiko-6JwaJX6seHupUSCtAm8 21583
sglang/srt/layers/attention/__init__.py sha256=EL1o6Q5vLgViN3pOr2A7F6K9FlNEpMdBypFAVMeq_HA 2445
sglang/srt/layers/attention/double_sparsity_backend.py sha256=BlX7uXteQpnoOnKsdBKh8h20zMVMEiibB5F_PkZSlNI 10706
sglang/srt/layers/attention/flashinfer_backend.py sha256=843CbZsRfzWp5FTusNXXL1o4N3jd0hoCNpsoUR6Qjxk 23306
sglang/srt/layers/attention/triton_backend.py sha256=DKUEzxQE8iBvJPNHmQwP1pyx2wXmSsLqzBhLjJznIUk 6482
sglang/srt/layers/attention/triton_ops/decode_attention.py sha256=7cDNPMMkz7--ebNKUeSaLY_6hBbvr_NqDodYFtW9ahA 18433
sglang/srt/layers/attention/triton_ops/double_sparsity_attention.py sha256=1pSXfY3EEaM7iRN_uElHnAfsrJMhTFbu9fj8Z0O2PbE 21480
sglang/srt/layers/attention/triton_ops/extend_attention.py sha256=JKiDqyndNiLF8qUrG_rcdiyZvczXthO6WuSYTqd3fAo 11359
sglang/srt/layers/attention/triton_ops/prefill_attention.py sha256=LnuWqGAba03e25adxS_lFgjTV6nBWsVBUGUvrl-8alQ 5993
sglang/srt/layers/fused_moe/__init__.py sha256=bWCrDdOy2ANEXTb8CHYO63O3Iu3eZnn0PJbgl0z5vvE 75
sglang/srt/layers/fused_moe/fused_moe.py sha256=uRmDUleTaJKBbsTfum6RgHifUbgi6yKuB2dw_mIhw3M 23250
sglang/srt/layers/fused_moe/layer.py sha256=tbHnUJs3uvdDsl3VnwtyGA31VtFouNTPD7h7fPSCYOc 23613
sglang/srt/layers/fused_moe/patch.py sha256=B9cDtHqHfnWE0QqZAffvUi6cVRKcMBMKDGJWGIaKh3U 3898
sglang/srt/layers/quantization/__init__.py sha256=QilMNqgu3eOFUkEjXLSDa1NvoNdi_CAvC8a1hprOgN8 2979
sglang/srt/layers/quantization/base_config.py sha256=daK9p0aijMszLUm1W4Pc33FK87MdqYK1NoWFKif-j80 4599
sglang/srt/lora/lora.py sha256=meRL7oBUx8mxV_isc3Lp0EIsFQWC2PvaN-fE78BmMwg 14970
sglang/srt/lora/lora_config.py sha256=paVB7F7SIuxr_vodvKf8zzAlH2fdVYHhXxcXV62D0Vo 1411
sglang/srt/lora/lora_manager.py sha256=gzBwYXZEPYj56PkGTshTbWRfl_370wb6uTcRhDaLiF8 12801
sglang/srt/managers/data_parallel_controller.py sha256=_XB6Ianc8TiqwLTW-7DH6gGjVYBeBU_6WjjaDk0snIY 5686
sglang/srt/managers/detokenizer_manager.py sha256=pBCcK-wKgPk4Ty-vQFSGovEZEE_yKK1f7YVDW8vDcYw 7962
sglang/srt/managers/image_processor.py sha256=Pk_dtXzljTkFt7Acsv1RyDzEqvCvjc7BMngxGhtkpDU 13817
sglang/srt/managers/io_struct.py sha256=y3dzPIVc99hHSNTAAewf_1hv-0IhzUDDqPYU59-xV2I 12288
sglang/srt/managers/schedule_batch.py sha256=Bz2zLhi-WMgCh5pY0bK-LiEr3S0b5-W81m10a3cLBYQ 39407
sglang/srt/managers/schedule_policy.py sha256=LH0rh1PiI5LK-dSd3dar8_po6FidiBUuj0Xcp_yNQAA 12295
sglang/srt/managers/scheduler.py sha256=imwIQ47K4UeQQzP2_VT-xkfNifxcUsC7yAAXxxzgj4M 46156
sglang/srt/managers/tokenizer_manager.py sha256=n_XCsCOwLZWCLv1ZJLGjyKgrAWCAQDyEhjnkxOptSa8 24436
sglang/srt/managers/tp_worker.py sha256=S5oim5xrkg1j68hYq6LfC8T533JYmQX9Kabt6U8ZXn4 5726
sglang/srt/managers/tp_worker_overlap_thread.py sha256=j5J4yHyR7w2HgAbN7S__299ADvsoyap5HK63SWMNavQ 7546
sglang/srt/mem_cache/base_prefix_cache.py sha256=qEQwEkG4E5rab2ZoTqcesf5pR_J4nV2jBxIHsBJHtIM 924
sglang/srt/mem_cache/chunk_cache.py sha256=VcCpyrf5FOQ5xoKeOouCI5ZQLkZo_pgY1SPbDDkagGg 2492
sglang/srt/mem_cache/flush_cache.py sha256=GYcxmNXh4hsMpFfNOuCTpKilW7guZwTtAg_usVeM3J0 979
sglang/srt/mem_cache/memory_pool.py sha256=41fjuj_sD0yfJq-sy-X99cc2djBa6w4dy2y47V0WqNU 10934
sglang/srt/mem_cache/radix_cache.py sha256=DzLCO_gYQ7X_C2NJSEHzzMZhb5HzWjKF9wXJQsnzr8M 10427
sglang/srt/metrics/collector.py sha256=9kidVhr4ldbSntAYfzwJt_2CTUFnnej0OoQdxUUwUWA 6767
sglang/srt/metrics/func_timer.py sha256=xe9UT4bPP1mA4GRZLsCd708cmv1B00hMpUmF7hzAKB4 3344
sglang/srt/model_executor/cuda_graph_runner.py sha256=ZMkyfZpWgDXfBpJ4cenh1TxXtt1O2xqeiXhDkq6E5pU 12936
sglang/srt/model_executor/forward_batch_info.py sha256=61TVExbiXDQRvZ6oevNz9AIxG7e-KVddgj4I6MTivLg 9426
sglang/srt/model_executor/model_runner.py sha256=Zs-u9sJREJD-1omhaFjBYfgR_2_7Cj0O5mGgQ0NtR8s 26793
sglang/srt/models/baichuan.py sha256=RyvPQvi7wy9VUGvLwG17XttcTp43yRj6c3zNRImBToA 15005
sglang/srt/models/chatglm.py sha256=9hCXTqGX8DMvSPSn6wlK0YNNRWGS4UiS4-xjFsO9hYU 13135
sglang/srt/models/commandr.py sha256=leoQNn4VRqa9SXos6DcrkHVG6-Xp-kjBn2PUgqc9bs8 14051
sglang/srt/models/dbrx.py sha256=IiVIk_rVd0RlvfIJGIThPOPkoYT3U649PrduThiKRzg 14545
sglang/srt/models/deepseek.py sha256=DjW2B21isWE6A2C8A3VGZ-G0k1DkhWHO3dZZjcOVG50 15828
sglang/srt/models/deepseek_v2.py sha256=z6532MRN1tBltFNteFJfimnaGpyNmK6g_sdNmTzsVmk 28230
sglang/srt/models/exaone.py sha256=YMyH4zxyCaCB432vCcom800efPI19_vIQ3OXLkLiXxk 12984
sglang/srt/models/gemma.py sha256=D_zjG312BeOPeplGzo5Z8tSMH9xL7wZ4KIgczZ9yJ0E 12193
sglang/srt/models/gemma2.py sha256=iE56CYzPn-QCis4kcU7Yi0jvJ04KeU2deuZH2DaS2lM 14768
sglang/srt/models/gemma2_reward.py sha256=gdP1QE69u51dCNYFWkmzzZWwEVqklniei6TGZ2Td1WY 2541
sglang/srt/models/gpt2.py sha256=Th7_Dnkw82GFBOuMOTrHtA44JBPHRUtY3Qd73rQwzMc 9741
sglang/srt/models/gpt_bigcode.py sha256=f6vvxBFPhV6GIZrOEKjJPu41TyVYw5Knq4h9WDvyEeY 10040
sglang/srt/models/grok.py sha256=iSkvt7whYyMndUHBekM4vKHaDXnnmeJMErkklGpz624 14826
sglang/srt/models/internlm2.py sha256=HOVOXz3b7eLF2wpG_FEK5PYnYOEpHPGJ0pufvL7HPD0 12099
sglang/srt/models/llama.py sha256=X_LKJ02ofDfpgVVFexf_C6g4FikadfMikhuRVAuLN5I 16094
sglang/srt/models/llama_classification.py sha256=WcHYFez7qloTCpXLy1A6-dBGHWp22ebv6yG68jFVBjc 3318
sglang/srt/models/llama_embedding.py sha256=2ex2jrz31osaAd9V8sJeN0qyxmk-L5NgOBkXL1puGhI 3166
sglang/srt/models/llama_reward.py sha256=bRhezJIPM1nzYD4NMymJ7i_E2Uq6qjek3NWYgf_Lx1Y 4673
sglang/srt/models/llava.py sha256=ny3sK2sgYwrEhawSAc1tZeltcgukphSTdxsqyq-Epkc 24857
sglang/srt/models/llavavid.py sha256=ztS5He-NF4fmfujdoMnKljOG1fNfPvp-6bduT7B6EMU 12137
sglang/srt/models/minicpm.py sha256=hAzgBImQ1xDeRdaQt5hKcLl1h1T-1QFSerG2MOlLjt8 13722
sglang/srt/models/minicpm3.py sha256=O6092exfoq8iHLmyfpVCubyQEzcfp4SmqtZJs7x4A8s 25014
sglang/srt/models/mistral.py sha256=tiYoKjyYVzlQl52QUZ33odD2yCxj9dxcqln474VuZOw 744
sglang/srt/models/mixtral.py sha256=b6AqEgL4y9wQpKKAGnhgzBtUypYo3dca5UOpGNLEt_A 13949
sglang/srt/models/mixtral_quant.py sha256=2ND-aOHjcyeQMUvqLLqhXwOdlR_bEftMFk3hc3lnpvc 13969
sglang/srt/models/mllama.py sha256=pET1x8wY04yoS8HMCncKx0tFPqGp78K8rlA7Eq7XioE 37889
sglang/srt/models/olmo.py sha256=eWPmo5AAnBhNGdMwklh1of3JnRzAszgQp4opeiiYidI 11887
sglang/srt/models/olmoe.py sha256=fEWr-RmW6l6fVA8jM9KX8bumUWLNQQG8VxGpajlkhUs 15242
sglang/srt/models/qwen.py sha256=vQoq8Bv8A2zc-LE1i-E97A8i4ydtfxb2yt2JG6Tp9PQ 9851
sglang/srt/models/qwen2.py sha256=Y1f_PxZMTkSLgENbKl96VfNGBfvcU4cljpVe1a3vzVg 12328
sglang/srt/models/qwen2_moe.py sha256=RRuHLN1fIYFS4du4pUPNzGL-Rt2wLrjlgDfXiczZQ5c 16975
sglang/srt/models/qwen2_vl.py sha256=jb0RYMo0ShPIt4NtPCEcFGciZKstM-gYwVKND_LK7Ls 26052
sglang/srt/models/stablelm.py sha256=rIQOv9OS_Vb2nOT_AMx0yGG2onwmCbbxvXL_SPdZX7k 11256
sglang/srt/models/torch_native_llama.py sha256=d8gVNurlVVZ-tD3Uc_aHyGCVUUp1gR8awOH4fLRZHDE 19145
sglang/srt/models/xverse.py sha256=meyCCdrZRYNK70hnmydgwhHa1FTBhKekEdpG0_IGTWY 13564
sglang/srt/models/xverse_moe.py sha256=xlrhJBAlRzxhp5o0WQU_2V5Uvf8I9fwZLOZBh95o3to 15673
sglang/srt/models/yivl.py sha256=xcWqkuZ29FmBBJY6aKetwItWIPl-kfXK-QmgdLONles 4765
sglang/srt/openai_api/adapter.py sha256=nZOVjZ-q4eULl19oT97_u7z63SQiWW7IzbYzJeWE7os 53069
sglang/srt/openai_api/protocol.py sha256=EZ6G209rBEDP7cepO2kAYqE8wMe1ksYdN7to1iT97Lw 10248
sglang/srt/sampling/sampling_batch_info.py sha256=qrijXoMhF-V_x3g6lumsfXgsGaPiKLIJ2pUz6ii-O2s 7735
sglang/srt/sampling/sampling_params.py sha256=O8w5yTLP1dwuCdb8kMBBhMSdMWvWxSv3fz2Eq07Tm88 5192
sglang/srt/sampling/penaltylib/__init__.py sha256=5vQw0Y5DSzmsoFg1IdMIKLwFVhYZ5ArADHVBYbSmOec 513
sglang/srt/sampling/penaltylib/orchestrator.py sha256=kizcPnxtRawmDt6utRuhbk4yfNs5H5mx1DAlDVEZRv8 11328
sglang/srt/sampling/penaltylib/penalizers/frequency_penalty.py sha256=IvYioX53Vq_ji-0Zhcz_r5mUa3T3GaIydVS6K4FhWfE 2557
sglang/srt/sampling/penaltylib/penalizers/min_new_tokens.py sha256=MmfqRqJ-leSoY9iO5Hg_ILlX-M0M0tObYrxrb_quStg 3717
sglang/srt/sampling/penaltylib/penalizers/presence_penalty.py sha256=0PlANTrR959foTA3Nj5qBE7ndaOZgG-9X6LhzlmEUc8 2533
sglang/srt/sampling/penaltylib/penalizers/repetition_penalty.py sha256=v9jOgA0-I31WcrhIydiFbpy2ZJPLytFLGM98NRPd2sU 2820
sglang/test/few_shot_gsm8k.py sha256=ll-gNbcv829IwSPXAZt4JIEIu8IR3APCLcX3BHOFVp8 3968
sglang/test/few_shot_gsm8k_engine.py sha256=QQbrwOX6-cJDD3RZC_e7zPnt6aSo8JdF8X_lRHSjdDM 3886
sglang/test/run_eval.py sha256=9yO0hXZOcn4abEOs96T-XPguDEklK16Ltco0pGF3zCg 4020
sglang/test/runners.py sha256=JxfsGEW9L3cz87fHYmWqb3Vnbk6K1csLLLftR3LogxU 14297
sglang/test/simple_eval_common.py sha256=joqrGysuLnJFtzDRIgFkMsRyKUSyjVPFWp0_PHAL3Ik 12378
sglang/test/simple_eval_gpqa.py sha256=8Xt9Bw05c7SZTYrCZgB68OZUqUbLo69ywiyx0bTvSUk 3220
sglang/test/simple_eval_humaneval.py sha256=zmV3xWYc2OrpiT9Dy55RTKZL5DEROD1cJ0NA_-cU5zI 5685
sglang/test/simple_eval_math.py sha256=6kGKNwNbLN-Af3Wj8WTimWhH-Xp3enDmSvvSjsgWUpk 2550
sglang/test/simple_eval_mgsm.py sha256=rd7TSUyxdKbrXaVoewo24V8lCo_6kO8zxPhhmvylpw8 10259
sglang/test/simple_eval_mmlu.py sha256=FkwamjGMjueTixymkedF-YiPloSLiy4ftILFUrKZ9XI 4357
sglang/test/test_activation.py sha256=jkdNRzJnbd5OgZliQaIXpxovlcky17UrweomcOcMxoE 1442
sglang/test/test_layernorm.py sha256=IacByD5d-stXjzBz8Ypamc7povlcedpKPbb_4JLgo3c 3720
sglang/test/test_programs.py sha256=1Z0umrsUu9pagzyGH5SrXl_qhKSyTfUv_kWC2mcn0qo 18208
sglang/test/test_utils.py sha256=dIMIz6FPd9fM7zY1ug8AXrV1CarsmqejX0BpdyY_Z3s 22970
sglang/test/srt/sampling/penaltylib/utils.py sha256=q98pQDikkmvvvvAG-AXMYaYte1iHHW2TFhKGtAeGvdE 12802
sglang_router-0.0.1.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
sglang_router-0.0.1.dist-info/METADATA sha256=CZSI6J5Zw3ZQv3FsjUWh_7E3SdbfecfthLa59GE1tAA 21466
sglang_router-0.0.1.dist-info/WHEEL sha256=P9jw-gEje8ByB7_hXoICnHtVCrEwMQh-630tKvQWehc 91
sglang_router-0.0.1.dist-info/top_level.txt sha256=yxhh3pYQkcnA7v3Bg889C2jZhvtJdEincysO7PEB09M 7
sglang_router-0.0.1.dist-info/RECORD — —

top_level.txt

sglang