optillm

View on PyPIReverse Dependencies (0)

0.0.16 optillm-0.0.16-py3-none-any.whl

Wheel Details

Project: optillm
Version: 0.0.16
Filename: optillm-0.0.16-py3-none-any.whl
Download: [link]
Size: 75702
MD5: 342843af20dcc50c6c6396caf3ee0c7b
SHA256: 1c1211b19403416ebe9b9957515fc8248ad75c558c83e7d21fed9ebd9b25d4e3
Uploaded: 2024-11-29 07:14:14 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: optillm
Version: 0.0.16
Summary: An optimizing inference proxy for LLMs.
Author: codelion
Author-Email: codelion[at]okyasoft.com
Home-Page: https://github.com/codelion/optillm
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.10
Requires-Dist: numpy
Requires-Dist: networkx
Requires-Dist: openai
Requires-Dist: z3-solver
Requires-Dist: aiohttp
Requires-Dist: flask
Requires-Dist: torch
Requires-Dist: transformers
Requires-Dist: azure-identity
Requires-Dist: tiktoken
Requires-Dist: scikit-learn
Requires-Dist: litellm
Requires-Dist: requests
Requires-Dist: beautifulsoup4
Requires-Dist: lxml
Requires-Dist: presidio_analyzer
Requires-Dist: presidio_anonymizer
Requires-Dist: nbconvert
Requires-Dist: nbformat
Requires-Dist: ipython
Requires-Dist: ipykernel
Requires-Dist: peft
Requires-Dist: bitsandbytes
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 22820 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (75.6.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
optillm.py sha256=K-2uFq_hszrekHeTqj94WNgRHQtmx_s6pjy-XBhJHlc 26234
optillm/__init__.py sha256=eVwRCnVEvoDZ7pjw8vFk4A_yrZWJ75vDyoehso1mo4g 1570
optillm/bon.py sha256=MUFm6HOzM7Ep4e7Cuf6HRhaBkjvL3JgEXtWWgVA4IcM 1926
optillm/cot_decoding.py sha256=EGABqN-LetKqv_6uVMo-Mf4DkdkkzRqNd7QvWkbleN0 6412
optillm/cot_reflection.py sha256=bn6F3AVPZzJOX1R4tIfc8yPmU7qwMeStF5xVPUnA8XM 2636
optillm/entropy_decoding.py sha256=3nmR5CPVnQIuznp0G1vxOwGqoTcnMGZ_QyHCFIoH1NI 11422
optillm/inference.py sha256=gcV8zTraVaAIzLICQuvJK2g53VshU0_FxJHCxyxbbFQ 62261
optillm/leap.py sha256=gjinFGHaGVHpnEGCa0rDJlHMAoratAAVRV6j5ZpuLWM 8833
optillm/litellm_wrapper.py sha256=Qn7ln3sfSGm_12hUHof9paTXJ5W0W07gdu4iEkBUB4s 1689
optillm/mcts.py sha256=9_Q2iQz8pga95ml0DTP_HkHSof4NKhMZXPBBZJvmlqY 9008
optillm/moa.py sha256=3f7cA_0IHu3MkujAAvmRHEjO9Cbt2mCEQlyZWqwKEs8 3078
optillm/plansearch.py sha256=L7xHK2JpaFI7nUHIRfEzybkFxB3to6zi1HSp5CBJlCQ 6308
optillm/pvg.py sha256=MuyRT08PzklS3PW9rCVj7eVqrPvcWPNIFm5JPXfS9y0 8261
optillm/reread.py sha256=abkkeVIzA1Rd6m1lz95Bx4znHjKJWH9AuHgv5iIwCxg 1417
optillm/rstar.py sha256=XqxtrAHy_YdVZ_WMnBc6C-_i9OgcmrkRmcTUsoUjcbg 14949
optillm/rto.py sha256=Bt3bKwfRlZ31I7M41z7D8hoPovrVZwva86rLV8xalLY 2845
optillm/self_consistency.py sha256=4yxfQcMo1apIzOww7G5TK49HBSjecbrz5O7JGi5iLAU 3853
optillm/z3_solver.py sha256=UZmqAxnlkR8ExwXSfUu2EGZZv0Qg7hXobAfDL02FUQ4 10109
optillm/plugins/coc_plugin.py sha256=tNbcZFb2HSrnPnnwOsWrt-gstSmgdfpcxp6JWiuYmSE 8790
optillm/plugins/executecode_plugin.py sha256=kLW2BmfLg6j24iqIoCqv9HqCv40Oh_txK-OjAfZuBtc 4522
optillm/plugins/memory_plugin.py sha256=REhNNy0na43biQXrIVVmApybFNib6yJs1z0rhphS13s 4598
optillm/plugins/privacy_plugin.py sha256=UhsJkBpv9yT7uIF1lrK48F-cqTcGhi1Xh-33zJtFz-I 4532
optillm/plugins/readurls_plugin.py sha256=ZSkShbo0c9XwsDCBebjWgbpyAVFhrhJxdeDT6t5YsXg 3790
optillm/plugins/router_plugin.py sha256=PMLErl8VSiQuSYcB7wTeP071BI0qWIk1dW2s0eC1BvY 7012
optillm-0.0.16.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
optillm-0.0.16.dist-info/METADATA sha256=cv06Yzd3CCIdZhviTelkNfoCg-1pVjrXkAcTGra2ibQ 23843
optillm-0.0.16.dist-info/WHEEL sha256=PZUExdf71Ui_so67QXpySuHtCi3-J3wvF4ORK6k_S8U 91
optillm-0.0.16.dist-info/entry_points.txt sha256=teDqjOK81BVz5VZQ-PAbKRqXkT-AYJ-tqew2MaH9cO4 41
optillm-0.0.16.dist-info/top_level.txt sha256=u4p-MRKWVHdtqBlRrGnMnc34VbDWmty0-JhUqi5rT20 8
optillm-0.0.16.dist-info/RECORD

top_level.txt

optillm

entry_points.txt

optillm = optillm:main