google-jetstream

View on PyPIReverse Dependencies (0)

0.2.2 google_jetstream-0.2.2-py3-none-any.whl

Wheel Details

Project: google-jetstream
Version: 0.2.2
Filename: google_jetstream-0.2.2-py3-none-any.whl
Download: [link]
Size: 72293
MD5: bbb1ee9717cb79e538c40cc848d4fa68
SHA256: d4372f6efbc9cfb7d88127d0c42f6efa89bdb754e2a943df2638fe077900606c
Uploaded: 2024-05-31 18:45:02 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: google-jetstream
Version: 0.2.2
Summary: JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
Author: Google LLC
Home-Page: https://github.com/google/JetStream
Classifier: Programming Language :: Python :: 3.10
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.10
Requires-Dist: absl-py
Requires-Dist: coverage
Requires-Dist: flax
Requires-Dist: grpcio
Requires-Dist: jax
Requires-Dist: jaxlib
Requires-Dist: numpy
Requires-Dist: portpicker
Requires-Dist: prometheus-client
Requires-Dist: pytest
Requires-Dist: seqio
Requires-Dist: tiktoken
Requires-Dist: blobfile
Requires-Dist: parameterized
Requires-Dist: shortuuid
Description-Content-Type: text/markdown
License-File: LICENSE
License-File: AUTHORS
[Description omitted; length: 3101 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
benchmarks/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
benchmarks/benchmark_serving.py sha256=8cWY_tTpmba_xE5fxYKJEFJwpC3Ids9sJQ91aX5VaK0 24291
benchmarks/eval_accuracy.py sha256=QqTeG3jmPgLkA3DznN7JDL0Z0WXxc812HGffiM4V7f4 2234
jetstream/__init__.py sha256=RkGxjD0QJSH0CQ-Z5K28z8W6SIb5wztJe8itKB_RPQY 574
jetstream/core/__init__.py sha256=RkGxjD0QJSH0CQ-Z5K28z8W6SIb5wztJe8itKB_RPQY 574
jetstream/core/config_lib.py sha256=LLiCYOff4FgFs8VJkDxE9m_8o0oWp8T34givf_RS-eE 5202
jetstream/core/orchestrator.py sha256=OOh6aPXSGkttnor5GTwWm55Io47jQYyEsrbpi4fTjMw 34730
jetstream/core/server_lib.py sha256=27xKgIuPTZrtIYwP3iqelEkfyLmLpqvHNCOYwHrBgM4 6125
jetstream/core/implementations/__init__.py sha256=RkGxjD0QJSH0CQ-Z5K28z8W6SIb5wztJe8itKB_RPQY 574
jetstream/core/implementations/mock/__init__.py sha256=RkGxjD0QJSH0CQ-Z5K28z8W6SIb5wztJe8itKB_RPQY 574
jetstream/core/implementations/mock/config.py sha256=B961-H9Yk13SEc9kwgkhWJwdNH6y78HrS8Ds0HAwqnU 993
jetstream/core/implementations/mock/server.py sha256=_IFavwXkgsfa4fzpuKeHJh9zdD-nXe4XbGaMon4CaW4 1512
jetstream/core/metrics/__init__.py sha256=RkGxjD0QJSH0CQ-Z5K28z8W6SIb5wztJe8itKB_RPQY 574
jetstream/core/metrics/prometheus.py sha256=nzkkXpU1jrenOL8T6bTbz5fQdBQ_hR-ZwkH-Vkr6b-8 1630
jetstream/core/proto/__init__.py sha256=RkGxjD0QJSH0CQ-Z5K28z8W6SIb5wztJe8itKB_RPQY 574
jetstream/core/proto/jetstream_pb2.py sha256=rPV8dLzB_EsG9XM8drSTS0C5ve8ymoNVc9dYD3_K6KE 4157
jetstream/core/proto/jetstream_pb2_grpc.py sha256=nLn08Lvj-wzm9mQ1Hkpcrll0vWa2lahM32Ul1y21sZc 4839
jetstream/core/utils/__init__.py sha256=RkGxjD0QJSH0CQ-Z5K28z8W6SIb5wztJe8itKB_RPQY 574
jetstream/core/utils/async_multifuture.py sha256=WBKUrXQmDhk-evAkID8AzGeTdeWweEO_1pbn-rs2Bm0 3357
jetstream/core/utils/return_sample.py sha256=CgE9Qm7q5jhF9Pe0YZ1VNClu1QXP1fZsX5ak3T2hUcQ 396
jetstream/engine/__init__.py sha256=ZB4JZ6kzQmIr_Y730OTPqQ_0oBXG-A9ltYu-2QtWpBo 1602
jetstream/engine/engine_api.py sha256=L--4Ey76fIQzajamntxeiOwq4SmnIgmOlbFTBPtnQus 7473
jetstream/engine/mock_engine.py sha256=wLZD7N80cqbgFHmRIGWKAACwsfk5YLwO9rAyVZMQTdE 9214
jetstream/engine/mock_utils.py sha256=hJxsFXnCqkHje-kGfG_o2qCAkwBS6oJKopT-_Z37hXI 2885
jetstream/engine/token_utils.py sha256=onnlyqyKCS1oAt7mLEKNcsXTI83VAkQHDVkkZqOCpzc 12609
jetstream/engine/tokenizer_api.py sha256=H5DeibNche_YhGVtd63VT5eJNRltlPiRUtsD9l0akZQ 1914
jetstream/engine/tokenizer_pb2.py sha256=O1KVYyvDHzosHufTSBEXM6HMqsybSm-2eUw-TvjZoYY 1840
jetstream/engine/tokenizer_pb2_grpc.py sha256=TAIbwLuI_k6HSDT_GpoKGsFj6RSxSAOQ2YdloHD90DQ 755
jetstream/tests/__init__.py sha256=RkGxjD0QJSH0CQ-Z5K28z8W6SIb5wztJe8itKB_RPQY 574
jetstream/tests/core/__init__.py sha256=RkGxjD0QJSH0CQ-Z5K28z8W6SIb5wztJe8itKB_RPQY 574
jetstream/tests/core/test_config_lib.py sha256=Pbmm5rRY8YkjpD39u2p3RE7afyQ-mrrQTi3ZWRtpfbg 1163
jetstream/tests/core/test_orchestrator.py sha256=2YV8PSeSinGUCg-uvwudCtPmG5XAsuET-pGqnOKZWD0 5283
jetstream/tests/core/test_server.py sha256=_k_RH8D_bZy6J9Vx9_gEbObS_DFGE4j-ZxTCyaVbBa4 4998
jetstream/tests/engine/__init__.py sha256=RkGxjD0QJSH0CQ-Z5K28z8W6SIb5wztJe8itKB_RPQY 574
jetstream/tests/engine/test_mock_engine.py sha256=9bFC3Yi1zg7bxYhBuqyxeRRj7ooAi-0PAqAQ2pawtp4 4548
jetstream/tests/engine/test_token_utils.py sha256=1bZORvvzHnwrGVVIk6BceLCbrWxEqGtGnyuJs1pG720 20732
jetstream/tests/engine/test_utils.py sha256=uxn5JsH_cer0Kn5bDo6_DhINwn0t88G5x4j-suBJjOs 3632
jetstream/third_party/__init__.py sha256=AbpHGcgLb-kRsJGnwFEktk7uzpZOCcBY74-YBdrKVGs 1
jetstream/third_party/llama3/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
jetstream/third_party/llama3/llama3_tokenizer.py sha256=lQrqbZJJmMcH6MVoM22Ejms27Ha0S-h3vBJiZuJUljU 7295
google_jetstream-0.2.2.dist-info/AUTHORS sha256=BOa3uCSC4eJuDA8wqoRdte2OSLbYFZiZawTu7flgU0s 10
google_jetstream-0.2.2.dist-info/LICENSE sha256=z8d0m5b2O9McPEK1xHG_dWgUBT6EfBDz6wA0F7xSPTA 11358
google_jetstream-0.2.2.dist-info/METADATA sha256=etcFJgxEPZm0X54OiarDLD6XCGj3Rl5y1OLGYKbWrMI 4005
google_jetstream-0.2.2.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
google_jetstream-0.2.2.dist-info/top_level.txt sha256=5Riy71SNhhTQlRPhIYpcDVryXmD_kcbc99V9qcza1LE 21
google_jetstream-0.2.2.dist-info/RECORD

top_level.txt

benchmarks
jetstream