flexgen

View on PyPIReverse Dependencies (0)

0.1.8 flexgen-0.1.8-py3-none-any.whl

Wheel Details

Project: flexgen
Version: 0.1.8
Filename: flexgen-0.1.8-py3-none-any.whl
Download: [link]
Size: 121877
MD5: 635be77ab9223ed5eecc9d2ffc582316
SHA256: d08f916bfb9ef295123c40d46ea14a26540600047fb0c02c146a8b5ef40e02c5
Uploaded: 2023-10-09 22:03:40 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: flexgen
Version: 0.1.8
Summary: Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput large-batch generation.
Project-Url: Homepage, https://github.com/FMInference/FlexGen
Project-Url: Bug Tracker, https://github.com/FMInference/FlexGen/issues
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: Apache Software License
Requires-Python: >=3.7
Requires-Dist: torch (>=1.12)
Requires-Dist: transformers (>=4.24)
Requires-Dist: numpy
Requires-Dist: tqdm
Requires-Dist: pulp
Requires-Dist: attrs
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 12508 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.41.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
experimental/cost_model.py sha256=43hmWFDiJPZx1cCyaXMFl82JNE-W-6wPzgRFI1lB2cE 22001
flexgen/__init__.py sha256=AbpHGcgLb-kRsJGnwFEktk7uzpZOCcBY74-YBdrKVGs 1
flexgen/compression.py sha256=iFarmwKt3TMcqFdfRY1CEjL1G2vvPf_FKJ7UYUs1rfI 13405
flexgen/dist_flex_opt.py sha256=2UNWydUMT59wgNhN3NdksJOW2QzuXf3q1FD3Ykd2S3M 28665
flexgen/dist_utils.py sha256=TK8ijjnETshpSoaM6yjmzIEPwt-8QEfBe31OOHajrxk 2167
flexgen/flex_opt.py sha256=1VgzpqYawPerA6qTcgFWp1IJ7WiykGIYuiZwG43Rba4 50747
flexgen/opt_config.py sha256=s4arrlGHUoqO2ZR-zO39BPbs7BAwlXBa8tpKlvgtWI8 9540
flexgen/profile_bandwidth.py sha256=aeSTzwTL-_ZSROdCwnuIYsjH5UjdBywU4gpH_ntEnsE 2852
flexgen/profile_matmul.py sha256=8ByQsZgkMVtbewzijBtGtzBgCdSo5XicX31k467neRA 800
flexgen/pytorch_backend.py sha256=bzhJggoqIqYhEwZlUDIAJrbey9qvnJG8pX3yCkZN3lU 35101
flexgen/timer.py sha256=U4INN8IeXFolz8C2C6T6fJRsYxzA7znumbRVcMBk6PI 2345
flexgen/utils.py sha256=p58w3sNTCGc76WXYLlCecKW0P3L41FRmQyyAie1fWU8 8174
flexgen/apps/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
flexgen/apps/completion.py sha256=HXEEjmB8xLeGlrMWOFQaSYIU3coPGbTgnaM23lZ71kA 3833
flexgen/apps/helm_fast_test.py sha256=OMe6Mi9-KYprdlkCRD5HBIUCqtPWtuTtki50PCHOlBE 4103
flexgen/apps/helm_run.py sha256=p5X4vQr9jNYgRgftc-FzGhUxOn94oKVRvCc0NE9ddW4 17097
flexgen/apps/data_wrangle/data_wrangle_run.py sha256=eOqHXzyza06_tIH5IpQeCemMcWi2-VQRmOJbURMFqkI 21270
flexgen/apps/data_wrangle/utils/constants.py sha256=XQbbkjaHWVNhdpV51evn1VWZmJFw2L87reP2Az1xvQM 426732
flexgen/apps/data_wrangle/utils/data_utils.py sha256=6jwbCIMunKiwundLf02gIXZDQ4qTxl2saG9LsK1O680 15330
flexgen/apps/data_wrangle/utils/prompt_utils.py sha256=dnG5r3J3PEQgK4yKnzEdCz7K2E2nJgsLPI1X7YS_H4s 5861
flexgen/apps/data_wrangle/utils/utils.py sha256=gxHaEBuBXfM3xLwcfJ8PCBJyASw76c0LAHrUKV9bxC4 2076
flexgen-0.1.8.dist-info/LICENSE sha256=pPS46TvMWL3eP1mT9H7gjswNZCS_JHwqSOC6Ov4y7SY 11415
flexgen-0.1.8.dist-info/METADATA sha256=8w8gsW4zCFHKrMGqTh9W8epotD3EfBuaXlfZhnnC3vE 13165
flexgen-0.1.8.dist-info/WHEEL sha256=yQN5g4mg4AybRjkgi-9yy4iQEFibGQmlz78Pik5Or-A 92
flexgen-0.1.8.dist-info/top_level.txt sha256=pkhlnR6Qm1knehP3zpBw-Mk9wFcJVfDQnMLu_WPzFRw 21
flexgen-0.1.8.dist-info/RECORD

top_level.txt

experimental
flexgen