Wheelodex » Projects » osc-llm

osc-llm

View on PyPI — Reverse Dependencies (0)

0.1.5 osc_llm-0.1.5-py3-none-any.whl

Wheel Details

Project: osc-llm
Version: 0.1.5
Filename: osc_llm-0.1.5-py3-none-any.whl
Download: [link]
Size: 49678
MD5: 745aa2785c6bc8745f5fa3292f30db94
SHA256: b87436b972a9811e47e63c25520c8e338031bd4f9c26a04174a1feff9c5f184d
Uploaded: 2024-05-16 10:39:05 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: osc-llm
Version: 0.1.5
Summary: 大模型训练,评估,推理,部署工具
Author-Email: wangmengdi <790990241[at]qq.com>
Project-Url: homepage, https://github.com/di-osc/osc-llm
Project-Url: documentation, https://wangmengdi.notion.site/OSC-LLM-5a04563d88464530b3d32b31e27c557a?pvs=74
Requires-Dist: torch (>=2.2.0)
Requires-Dist: lightning (>=2.2.0)
Requires-Dist: jsonargparse (>=4.28.0)
Requires-Dist: wasabi (>=1.1.2)
Requires-Dist: confection (>=0.1.4)
Requires-Dist: catalogue (>=2.0.10)
Requires-Dist: sentencepiece (>=0.2.0)
Requires-Dist: tokenizers (>=0.19.1)
Requires-Dist: pydantic (>=1.10.8)
Requires-Dist: fastapi (>=0.110.2)
Requires-Dist: uvicorn[standard] (>=0.29.0)
Description-Content-Type: text/markdown
[Description omitted; length: 1599 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
osc_llm/__init__.py sha256=VLAXrNq0me4YYBXpPbH--YWss8HZufpuoR36DiCmQvk 267
osc_llm/__main__.py sha256=FeLFyNefvAObxFfGJr-rO9fOvhRWUCJcsqAVs-YhKSI 6554
osc_llm/chat.py sha256=HJJbBq5FK_5slUo4gXM7JvCk2feCri7up70Pr69U7tA 4442
osc_llm/config.py sha256=t-b7rJo2Lsp30wpeYUxcSyrzB8gEARFdFNeuMgEKRzE 1040
osc_llm/tokenizer.py sha256=12Ov9jDf0EJeX1AAygYtXfs8WWkEdZiR9spFpJ9zN_0 8816
osc_llm/utils.py sha256=G3VystZpESnDvG9OtJJHPxAYq1NuCLcd3xRxtfe02tc 6842
osc_llm/architectures/__init__.py sha256=pXCINyXpOGgWOJVbcOeAVqIWKumxXM4gDqEoUx3vctg 87
osc_llm/architectures/transformer_decoder.py sha256=XGnkuSO_IvwGFZQ98tvJAC3hHw7F88sFFZT6XZHGnNg 8920
osc_llm/chat_templates/__init__.py sha256=Ghg6SCEtV5s6V_6ttLvOBUCO-1HEBc7eSSzARV-ngEM 335
osc_llm/chat_templates/base.py sha256=yVucm2iK8GmXwttBetXavgwJDPIYqMrfnx1_5mn0BOI 2352
osc_llm/chat_templates/chatglm.py sha256=3lyo-JNTltASSbCUGMX8_xKV5ebhazzlp13M0MDR8Pg 1221
osc_llm/chat_templates/chatml.py sha256=JMJtK9gUDjERUaKJEtbbi1lt_qXCaObf8mffxYAMa8Q 1043
osc_llm/chat_templates/llama.py sha256=-5hkkzB9SBxHA-N9GQ15WURVbSrIKErq8MlDEHZMIw8 2961
osc_llm/engines/__init__.py sha256=lRyZUHNJlR1UJsBM2jltAhhHvlJUIbPWZ_fHiqr8FHM 139
osc_llm/engines/base.py sha256=g5V3WkDP9hxbxgBZqv20eUTrWPiqWIIMdj23doKrDcw 1996
osc_llm/engines/v1.py sha256=1f_u7kpFpUx5ykMvfeC2whdtPkzbixDRMhpeC8NEfn0 4378
osc_llm/engines/v2.py sha256=dVLjMGilIzpEldGWLVcboWux2jRgQ7O5hB8tw_3qeg4 4907
osc_llm/engines/v3.py sha256=CReIBJfdMTFY1h1rPshbmy_nGsKd5Gtyrx09AJxWz0U 5866
osc_llm/layers/__init__.py sha256=GSYI5A30rtE1Pci2y9g_9XY7WLc33ZtXmX4-L4FOx18 744
osc_llm/layers/activation.py sha256=o5n4T2tDScpNYO6r_k1WFgaGv3O1NhVbLcAsHqA1epo 649
osc_llm/layers/attention.py sha256=iOVODoVk5ycGmDPETGB4uY09lU7952yG0lRuStUMJNQ 7321
osc_llm/layers/dropout.py sha256=bfLHujq3WkHCXNUbS7-MZrlQWKb5_6BzQntIkAuqnJs 187
osc_llm/layers/embedding.py sha256=gnvsjArFeUFdvcztjBpoxis_YyZMKlzV-nAckVfGm10 2213
osc_llm/layers/feedforward.py sha256=rkmai4tVn80NUXUJ4rs4UIpB1S1A9F__wxAdl3EBjc4 7529
osc_llm/layers/head.py sha256=2Na5-sXl_SbRne8NQ6fJ6a84unhXENW_exY_vh__NK4 328
osc_llm/layers/kv_cache.py sha256=Fbk12JPBdGJgHSHKrqZxCJq8fY_EwfGkd7YqGwVheeo 2919
osc_llm/layers/linear.py sha256=WbArl-JMawEgdpcMfhe_usclcVMOrhvq6dn-u21e1Eo 5855
osc_llm/layers/normalization.py sha256=i8NzOBLX78TDTCa_fxzyYmk9zIN0KMSXQh441oy9MFg 762
osc_llm/model_helpers/__init__.py sha256=jTGEhVov0agzcb6McHGPZp0rxTB6d_KjGqDFrRy_-h4 475
osc_llm/model_helpers/base.py sha256=9t4Ruqq1RbFwT5d5Fc4nc_mhFjvYLVci5okxZBpKU1s 5375
osc_llm/model_helpers/chatglm.py sha256=gC5nldQmwuawh5npvTKHEB6HIoOQ4-qzEFOrg7URMZE 2840
osc_llm/model_helpers/llama.py sha256=2vO6Rawwf4l31OckTCuoypOfttasuLQdYF3k511FE-U 3020
osc_llm/model_helpers/qwen.py sha256=nvgHx0c2hIK2n7v99BaFhCv3WY-9-pg5hZmq2Pkx2qE 8293
osc_llm/quantizers/__init__.py sha256=1aFHbxXdtuC18z8EXlk0Mf9LrgnizpXYA2Vh87hkDu4 130
osc_llm/quantizers/base.py sha256=Gw9RgVu89EJCxtdHSdT5hVo-yiaSY0s2RJe1N8V61ow 690
osc_llm/quantizers/int4.py sha256=T8Qvflt1Cw3xBJ78A91naAdOMlkWwvcpSoY4AG8dBB8 8791
osc_llm/quantizers/int8.py sha256=vAJBPt2kIWsNRz227_icUVXBQr9odTOXDF2yFVOKhT8 4185
osc_llm/samplers/__init__.py sha256=z_1DEwB7yFd_eVvqRMnqAGqbW3xidZYHfWW5MhU7Ep0 114
osc_llm/samplers/base.py sha256=ZOOnvH4ChGdkJ3rhg5xuGjK8rXHOMiPAudgy5P58rJc 884
osc_llm/samplers/top_k.py sha256=V_iQu5REjGlwCT6-Su-D6Y4X-xmmV7K4NjmFh23Vyvk 1102
osc_llm/samplers/top_p.py sha256=TudqhcrMwwNP2n1pUjPzHH92kelp98x2T95_wRALg9E 1184
osc_llm/servers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
osc_llm/servers/openai.py sha256=VKLTZXWmQZ6tOxOqeOY3usqARv7_7gne6Pt0m9kuDMc 7751
osc_llm-0.1.5.dist-info/METADATA sha256=IlE3rwynY-eysoETCfxs8SJFxZf6cHQizJlDtPW2A-c 2724
osc_llm-0.1.5.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
osc_llm-0.1.5.dist-info/entry_points.txt sha256=Wjt6ZrgmgIgrSVMx1SdROtD-PZDU_p9WuL9HgKxwekg 45
osc_llm-0.1.5.dist-info/top_level.txt sha256=5v7CvJCpatCS0MJ7TvyCYA82IW8JVRGiohVfOsg2wCE 8
osc_llm-0.1.5.dist-info/RECORD — —

top_level.txt

osc_llm

entry_points.txt

[console_scripts]
llm = osc_llm.__main__:run