pydiverse.pipedag

View on PyPIReverse Dependencies (0)

0.9.8 pydiverse_pipedag-0.9.8-py3-none-any.whl

Wheel Details

Project: pydiverse.pipedag
Version: 0.9.8
Filename: pydiverse_pipedag-0.9.8-py3-none-any.whl
Download: [link]
Size: 179343
MD5: b54a96dc4a177ac7fe73923f9333ed82
SHA256: d997bfbc9cb2417fe2eb5d83f7b147e800b8559f08f6f492822d4e656a35886e
Uploaded: 2024-09-06 06:13:27 +0000

dist-info

METADATA

Metadata-Version: 2.3
Name: pydiverse-pipedag
Version: 0.9.8
Summary: A pipeline orchestration library executing tasks within one python session. It takes care of SQL table (de)materialization, caching and cache invalidation. Blob storage is supported as well for example for storing model files.
Author: QuantCo, Inc.
Author-Email: Nicolas Camenisch <garnele007[at]gmail.com>, Martin Trautmann <windiana[at]users.sf.net>
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: Programming Language :: SQL
Classifier: Topic :: Database
Requires-Python: >=3.9
Requires-Dist: attrs (>=22.1.0)
Requires-Dist: click (>=8.1.3)
Requires-Dist: cryptography (>=41.0.1)
Requires-Dist: msgpack (>=1.0.4)
Requires-Dist: networkx (>=2.8)
Requires-Dist: packaging (>=21.3)
Requires-Dist: pandas (>=1.4.3)
Requires-Dist: pyarrow (>=11.0.0)
Requires-Dist: pydot (>=1.4.2)
Requires-Dist: pynng (>=0.7.1)
Requires-Dist: pyparsing (>=3.0)
Requires-Dist: python-box (>=6.1.0)
Requires-Dist: pyyaml (>=6.0)
Requires-Dist: sqlalchemy (>=1.4.39)
Requires-Dist: structlog (>=22.1.0)
Requires-Dist: typing-extensions (>=4.1.0)
Description-Content-Type: text/markdown
License-Expression: BSD-3-Clause
License-File: LICENSE
[Description omitted; length: 5663 characters]

WHEEL

Wheel-Version: 1.0
Generator: hatchling 1.25.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
pydiverse/.gitignore sha256=j8dp0Ncvmyg1g9WCNMS12_euluhOhFLuQFFTRYhyLpo 13
pydiverse/pipedag/__init__.py sha256=QbGJNjRQTEAIL4aEfIAqfsAnf84Zf342LrOyO1U9-Eo 710
pydiverse/pipedag/_typing.py sha256=ldBhWxiZhbqDQoc6K7pjM5beu9FVLD4q37FjnonJoGI 857
pydiverse/pipedag/backend/__init__.py sha256=x43Uh1RK-xGQYK0cTeTTVasb5bIXy3p__OhT_4AHdio 97
pydiverse/pipedag/backend/blob.py sha256=TZjyVEnxZZUxIy0Y31HDTu_n0Y_HA4mFUHq0q_MmLWs 6613
pydiverse/pipedag/backend/lock/__init__.py sha256=241rTDIBnVCJ7YtE_QypvsMDKIgbBXJK5L3Rqs-3yKQ 393
pydiverse/pipedag/backend/lock/base.py sha256=v-jkAolhLDQB38mpJSzyjKpvfS1Xt4shRaMrareqO0s 6178
pydiverse/pipedag/backend/lock/database.py sha256=hu5LhTkRu-ZIFi3chAL7aGjbhGyOFDEfSgnHXQetWXY 13938
pydiverse/pipedag/backend/lock/filelock.py sha256=PMSKFhaWQkzxJ2EZ7VG2RxvPBrzmz0CMLWGijZdVnz8 2756
pydiverse/pipedag/backend/lock/nolock.py sha256=QUjyf2Y4HBtTAXHGHtbi9A_ls47pd6xgsk7ERQoGP4s 769
pydiverse/pipedag/backend/lock/zookeeper.py sha256=lCCXLeUKVFSQYvhf2YJmGyka0HGQuSqv8I5M6xQ3yjk 3983
pydiverse/pipedag/backend/table/__init__.py sha256=6cy1gyrPUuq0SengMP3AHA1Xf0dSzICjyc1dB0Q1hXQ 233
pydiverse/pipedag/backend/table/base.py sha256=qmd4AbWdvvgCkgziFCd592dG4wuMqHUy5s2DTnmmFKg 33458
pydiverse/pipedag/backend/table/dict.py sha256=K23SpD22sABSERvKNq3E9a1UzhdMms_aqgAJdvIeWeA 7135
pydiverse/pipedag/backend/table/cache/__init__.py sha256=VTeU3j15XhXYbKUQ8fZdVnYodwqBPoDDd42b9B9-QlI 108
pydiverse/pipedag/backend/table/cache/base.py sha256=MF0vOZlG6WpBOrPGK7HX_gSTFmXRj7E5YOMKb57ncRQ 3443
pydiverse/pipedag/backend/table/cache/parquet.py sha256=YHrF3J3BqbndfoKnVQGorW1hglqaPWgEq-1lgjXZWpI 7798
pydiverse/pipedag/backend/table/sql/__init__.py sha256=Ahn2m_XDyx5JCrxk6SdAoBtlzoH8iR4mFvmBUlK-ey0 103
pydiverse/pipedag/backend/table/sql/ddl.py sha256=PriZg-7cZraBqbkDrxPaw3JvpCxN3OdsNx0ysNeF3FY 44253
pydiverse/pipedag/backend/table/sql/hooks.py sha256=iz2GHJNQz7oLUbHraTGP1DZTDhytACaTOoMuGQzN2bg 31952
pydiverse/pipedag/backend/table/sql/reflection.py sha256=mwpXDit7jvJfsBuf5bzrpGNZ8fKN362DQQ9SVuw2mAM 5033
pydiverse/pipedag/backend/table/sql/sql.py sha256=GOs1-yVEabiU-iKR2A7PrlGj6ZPEZfu4byPLW7-C8Lg 64210
pydiverse/pipedag/backend/table/sql/dialects/__init__.py sha256=oLvVwPLIiPBHEX2ban3oY0ylEKd5P3MQaS89ecx2iOM 230
pydiverse/pipedag/backend/table/sql/dialects/duckdb.py sha256=KZsUvkGtqteg6KyineHHsBcYGzwNasc7aclMXg4Nk7Q 4426
pydiverse/pipedag/backend/table/sql/dialects/ibm_db2.py sha256=b7SxeluUMXVP4DdDGEj9r-ZAfQ2pFJliKEjyznKuyrs 10798
pydiverse/pipedag/backend/table/sql/dialects/mssql.py sha256=5LenET00fGuwBmp9r6nT3mvYI3_YC_bNZd8p5d0Qx_U 12773
pydiverse/pipedag/backend/table/sql/dialects/postgres.py sha256=0NwprepdL0C2rWXADfs0wUwqSkjpRlOV_F2xov2n_XQ 5564
pydiverse/pipedag/backend/table/sql/dialects/snowflake.py sha256=rtkmxQX9awJT-R2glpuc0dy4nNENwfYYrjXAQQpBLNY 2009
pydiverse/pipedag/backend/table/util/__init__.py sha256=nd8jBvLPBy_wf5mDHZ4lZG-At3T9aiMIy2s5ORAi2ys 81
pydiverse/pipedag/backend/table/util/dtype.py sha256=a2gKh9hW56UF4uSGcgS_Wy1-YIu6mZCrm1-mciaUOPk 9164
pydiverse/pipedag/container/__init__.py sha256=CkC5iLR8CHaTL82JPw-JYsCVz7qUKnQraSH_lfKMb40 25490
pydiverse/pipedag/context/__init__.py sha256=4i9hDvKFMj7TVAriv-LQVWWlZtLsihqD4e2ayMYtB3Q 433
pydiverse/pipedag/context/context.py sha256=1gOhp-xRa901zSJuYnQFLD8A41g0Ss0RpfFUcmUktII 19672
pydiverse/pipedag/context/run_context.py sha256=v6vbm-j_rtpPI6BLFTtT1Up76mfA0FWMLl2avL_V-6k 29026
pydiverse/pipedag/context/trace_hook.py sha256=-wz8iKAzpKEMrIcV79_7zDE9EQ5r6Z-zQevDumW4kbI 8193
pydiverse/pipedag/core/__init__.py sha256=J7r9OBz1cl39v18w4vxr5lAYNDLX6BTg2RRlZihHynk 408
pydiverse/pipedag/core/config.py sha256=pO_BK3Haf-7BEWKUKlUTPB0UWffkP_ae0yRRGLDg7o4 20913
pydiverse/pipedag/core/flow.py sha256=CqB3ixumgd-zRfVMiDKn_TKU08FXwSkSRg9jbZ0Fj68 54404
pydiverse/pipedag/core/group_node.py sha256=4tECh7MFIluh4OXodNdkxDUCxcqSiKABVDeg_j46DzE 7891
pydiverse/pipedag/core/result.py sha256=e7F5yJe-K4GkmIb919YngGvwykln2WDVc1W_k4WQqvE 4552
pydiverse/pipedag/core/stage.py sha256=O29j4zXMT67lmpVDrdFQz2ZJT9sOHES8JG8rKgNduPY 9630
pydiverse/pipedag/core/task.py sha256=IBLjiq90zAJOE8oL_jpAFSERFwpIrqsUvW5Bn42He58 9335
pydiverse/pipedag/debug/__init__.py sha256=hwWf720wsijA0WatMXEorJT4glOq39mXOIdpro1D0Bo 135
pydiverse/pipedag/engine/__init__.py sha256=3eEpmNqwdOWbjQjj1N4n3d6l6xoCBRXRU7PNgotrsE0 493
pydiverse/pipedag/engine/base.py sha256=C_PEOP8tsJk1Xt5tnbKdQtXOYrnxYyStz0icjDNaDJw 1484
pydiverse/pipedag/engine/dask.py sha256=37JmpmkPJp9H3HuyrSgEsxq5DW7eRSLSJ7MSgHhWeE4 3768
pydiverse/pipedag/engine/prefect.py sha256=stmr5i1eeNMDEFBOWa-W7zdshtOx0yUcLWb2nRq_Py8 8834
pydiverse/pipedag/engine/sequential.py sha256=PmZzDGUD5WuU3uFb2-UlqORwV_4KuPlFBPw9EOU1NN4 2709
pydiverse/pipedag/errors/__init__.py sha256=CtO0sgMLrMEFSnorb_c1T0KvMo3kBSXB2OKZhFRahPA 1191
pydiverse/pipedag/management/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
pydiverse/pipedag/management/cli.py sha256=tdiekAdmaNrcfyZLgPH3tLZdlVigGpPDuDRqZ1cMwEU 620
pydiverse/pipedag/management/commands/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
pydiverse/pipedag/management/commands/clear_metadata.py sha256=Sh8dFO0KPJ0a87cKQ-8FcdG1SMsmnL8YGp0P9WZCycE 1741
pydiverse/pipedag/management/commands/delete_schemas.py sha256=vH7DuaYy_LRJdAbl7HZpjw9bU5H1tBHvzue1wxwbnZA 2783
pydiverse/pipedag/materialize/__init__.py sha256=iCC4N0pa2-Zu9mPURh0DC4ioimHCDkE2r4U_Fo_RC1M 150
pydiverse/pipedag/materialize/cache.py sha256=HCTMF1vVxbMbbMStCAgCI7dt84dqjxOCOiDsI4M1S4E 2735
pydiverse/pipedag/materialize/core.py sha256=yQI1sPdSmuPzusgClHshZL_9RKXcgs4LCdFnoR0z3CY 64271
pydiverse/pipedag/materialize/debug.py sha256=h2fvcLWOlZj59bpcinrcWGN3yOKjvOvquxGiAiKohz4 4441
pydiverse/pipedag/materialize/details.py sha256=l4lZEYNC8TM6k3Q-8UhuI2YVf_7XmVgaE49f0e0_6cU 3837
pydiverse/pipedag/materialize/metadata.py sha256=v1F3b0GUOcckxDnho_fD0SRN-6qIBL8lCV3Qh9sAaFE 2074
pydiverse/pipedag/materialize/store.py sha256=mtSMIbzi6z_KcpJbkMKUG7DjVioKF4NqiCAthZqSKto 22704
pydiverse/pipedag/util/__init__.py sha256=CVzh2-g8S4NIaRyiweqjpoylUDLQPmsoF-17w3Ou0sA 213
pydiverse/pipedag/util/computation_tracing.py sha256=lk_Kt0VKwqy-08AwWJmw1hd7_EQq3tZWaFTUbAwdL3g 9675
pydiverse/pipedag/util/deep_map.py sha256=q4Cq3Pt8q7yjmS209gBwiN4N8oaev0S8io9ylRkJ0ik 2061
pydiverse/pipedag/util/deep_merge.py sha256=hyyqz3TDQ7Ib4hxmMdR4c5YR6WQuvEte35v8UrrCxGE 1848
pydiverse/pipedag/util/disposable.py sha256=J2YexvpbbDMHJsgTGcy1AFTleHGqmqjMStfBUBc5kFI 944
pydiverse/pipedag/util/hashing.py sha256=AtveI2JbXqDHxR8Up6caP7cldm27OhnaBeMN0xa58g4 1129
pydiverse/pipedag/util/import_.py sha256=S7u_bNFQq5kxPKwPZKOYLFmfV736v7gkN6tsmSygiDg 3992
pydiverse/pipedag/util/ipc.py sha256=b-8xh-e1L9Ua8EMbyC56GB-MIPxZ7i8zNf7UxU-PFL4 7992
pydiverse/pipedag/util/json.py sha256=YQjOWDMJs-IMi7BMzZLkMEnwbrjOHNc84mraUZW_Xr4 5758
pydiverse/pipedag/util/naming.py sha256=IeMU9s0FKHNvmJlOmdmtnStpEBxcFnC3HkHASZj3TPg 1377
pydiverse/pipedag/util/structlog.py sha256=XQVSR-JvsPGg5wNZLKZPZNOgWigafkOSobAY5hePl1M 2904
pydiverse_pipedag-0.9.8.dist-info/METADATA sha256=gUsZt_GtBh0MFxpUYA5l4MAK34twH3PpFLTPNdKaUyA 6902
pydiverse_pipedag-0.9.8.dist-info/WHEEL sha256=1yFddiXMmvYK7QYTqtRNtX66WJ0Mz8PYEiEUoOUUxRY 87
pydiverse_pipedag-0.9.8.dist-info/entry_points.txt sha256=Yoqwf6U97EXVCWQjEedU63J23m1JvM20QA_5cERT3sU 72
pydiverse_pipedag-0.9.8.dist-info/licenses/LICENSE sha256=AcE6SDVuAq6v9ZLE_8eOCe_NvSE0rAPR3NR7lSowYh4 1517
pydiverse_pipedag-0.9.8.dist-info/RECORD

entry_points.txt

pipedag-manage = pydiverse.pipedag.management.cli:cli