Wheelodex » Projects » gzSpiderTools

gzSpiderTools

View on PyPI — Reverse Dependencies (0)

0.0.21 gzspidertools-0.0.21-py3-none-any.whl

Wheel Details

Project: gzSpiderTools
Version: 0.0.21
Filename: gzspidertools-0.0.21-py3-none-any.whl
Download: [link]
Size: 127028
MD5: 18ba9d326cc5ad5ce77d6b800dcec1a0
SHA256: 50013eaa1b06f64fcc8c3965c9fe4a9a80f2ec6a21f4b0b679d84c1a4aca5069
Uploaded: 2024-11-11 08:22:00 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.1
Name: gzspidertools
Version: 0.0.21
Summary: 魔改使用工具库
Author: George
Author-Email: persistencehoo[at]gmail.com
Maintainer: George
Maintainer-Email: persistencehoo[at]gmail.com
Home-Page: https://github.com/georgeJzzz/gzspidertools
Project-Url: Repository, https://github.com/georgeJzzz/gzspidertools
Keywords: crawler,scraping,aiohttp,asyncio,scrapy
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.8.1,<4.0.0
Requires-Dist: DBUtils (<4.0.0,>=3.0.2)
Requires-Dist: Pillow (<10.0.0,>=9.2.0); extra == "all"
Requires-Dist: PyMySQL (<2.0.0,>=1.0.2)
Requires-Dist: SQLAlchemy (<3.0.0,>=2.0.23)
Requires-Dist: Scrapy (==2.11.2)
Requires-Dist: aiohttp (<3.10.0,>=3.9.5)
Requires-Dist: aiomysql (<0.2.0,>=0.1.1)
Requires-Dist: drissionpage (==4.0.5.3)
Requires-Dist: elasticsearch-dsl (<9.0.0,>=8.11.0); extra == "all" or extra == "database"
Requires-Dist: itemadapter (<0.8.0,>=0.7.0)
Requires-Dist: kafka-python (==2.0.2)
Requires-Dist: loguru (<0.8.0,>=0.7.0)
Requires-Dist: mmh3 (<4.0.0,>=3.0.0); extra == "all"
Requires-Dist: motor (==2.5.1); python_version < "3.11"
Requires-Dist: motor (==3.3.0); python_version >= "3.11"
Requires-Dist: numpy (<1.25.0,>=1.24.3); python_version < "3.9" and extra == "all"
Requires-Dist: numpy (<1.27.0,>=1.26.0); (python_version >= "3.9" and python_version < "3.13") and extra == "all"
Requires-Dist: opencv-python (<4.9.0.0,>=4.8.0.74); extra == "all"
Requires-Dist: oracledb (<2.0.0,>=1.4.2); extra == "all" or extra == "database"
Requires-Dist: oss2 (<3.0.0,>=2.18.4); extra == "all"
Requires-Dist: pika (<1.4.0,>=1.3.2)
Requires-Dist: psycopg (<4.0.0,>=3.1.13); extra == "all" or extra == "database"
Requires-Dist: psycopg-binary (<4.0.0,>=3.1.13); extra == "all" or extra == "database"
Requires-Dist: psycopg-pool (<4.0.0,>=3.2.0); extra == "all" or extra == "database"
Requires-Dist: pycryptodome (<4.0.0,>=3.15.0); extra == "all"
Requires-Dist: pymongo (<4.0.0,>=3.12.3); python_version < "3.11"
Requires-Dist: pymongo (<4.9.0,>=4.8.0); python_version >= "3.11"
Requires-Dist: python-hcl2 (<5.0.0,>=4.3.0); extra == "all"
Requires-Dist: pyyaml (<6.1,>=6.0); extra == "all"
Requires-Dist: redis (<5.0.0,>=4.0.0)
Requires-Dist: requests (<3.0.0,>=2.28.1)
Requires-Dist: retrying (<2.0.0,>=1.3.3)
Requires-Dist: scrapy-redis (==0.8.0)
Provides-Extra: all
Provides-Extra: database
Description-Content-Type: text/markdown
[Description omitted; length: 1886 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
gzspidertools/__init__.py sha256=TLaNKS7UCbiDkqTEX1TniYAp8SegX1RUGiXp4SvGTTA 429
gzspidertools/commands/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/commands/crawl.py sha256=_GR__0ES6-AEqw20hl2VdzxMRKmdAPJg3OrRM5Uu37Q 84
gzspidertools/commands/genspider.py sha256=IFf5s6zHqA4_zOqEHGcPDPQP2tOwkrTO7R9Fabme_IA 340
gzspidertools/commands/startproject.py sha256=GsFFcokWX7Hf5CNEVC1ArM39aJ5zXqIiIz9cfQTv6pU 3868
gzspidertools/commands/version.py sha256=-8Qskol8dC4DFv5KtoJYD-ifD1tpVSS2gh1RLLuSmtg 272
gzspidertools/common/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/common/encryption.py sha256=oLVQ0NJAyrYpPDPav6QhACF-jdGq5XH14vVUTCC5Sbw 2502
gzspidertools/common/expend.py sha256=qevFKjBkzyru8L0g1jbxlAdxGQos0AhtzAIB74ZXFfw 10453
gzspidertools/common/mongodbpipe.py sha256=15dphRoChi6LFZ62D_q_-EWNUNuWK55baDDRLt6AfqU 5122
gzspidertools/common/multiplexing.py sha256=qWnt4i134q64jauNEOLJo3b9nhR__gzzX7NU-m-c6nw 20490
gzspidertools/common/mysqlerrhandle.py sha256=mw4cx6lJLK5FE6T28egBTFt7bjb8lsLf8Ck2wNJ-f7w 10643
gzspidertools/common/params.py sha256=C2anwSi8wkKDMGRjdvkFscTr20bj0XkMJJQXuIYpkHI 1577
gzspidertools/common/postgreserrhandle.py sha256=aII_BgR1MYtJ8CsOwvY9o7dSYKA2VooC5Tw_3XMvrI8 4915
gzspidertools/common/spiderconf.py sha256=ah7kVSjuWSYIP-nzuXIuAGp6YScEJsZSuSFBZjhUDxo 13003
gzspidertools/common/sqlformat.py sha256=oPpJYHqr8b5U1U6KxqLRajq9WUNytewr5QN_vSnxai0 3168
gzspidertools/common/typevars.py sha256=Uer0AckGPaT8CIHGw47G-8lnfImeNo9bEV3x8AxJV1E 5795
gzspidertools/common/utils.py sha256=lTVWMwE9Wy_brbeK87ZzK1yzBRRjHJmPNL_xRrxN1jc 12190
gzspidertools/config.py sha256=fHPyt63_vvsBS2nGVkSQkgfi9gnoUekylnMZwMXwGUo 871
gzspidertools/data/browsers.json sha256=kIr4KSLTjXrLXKU5oM_zSx0EYu9ne59QjEpuiskWCsQ 58096
gzspidertools/extras/__init__.py sha256=4MSTKbOCdIJhBqZqibjKE3hnEE1rNcFeA8Q0B0ix1YM 69
gzspidertools/extras/cvnpil.py sha256=2CoXUt9ZRCxpQfSXXWvTgdVqe_Y4ox28MIMqJ85bvjo 17414
gzspidertools/extras/ext.py sha256=-TKaWd3M6VA0zEsnwPmSU977cCgQ1QKfCXYjBkz4L_k 2005
gzspidertools/extras/oss.py sha256=23ewqE_ngUUWtr5gyB289nWI7ZQ4j57h-QkLB7ZbiCw 2640
gzspidertools/formatdata.py sha256=wisIakPpsyDaORSbFq-vp4MLfgE6nwDS6pXlrU5lU-8 7242
gzspidertools/items.py sha256=z1bg_GpF7ah5vyGmERDonBtG_WUs05V9nwGiK1Yd09g 5862
gzspidertools/middlewares.py sha256=GQk4-7zRXf5CNlSVmF0O0zt7lkV0PCwfd4RzrE8XBy4 802
gzspidertools/mongoclient.py sha256=CmngMn2u7AmjyOxzcT7QOKdJ4gvQ1WnFYYBSmwyllKo 4173
gzspidertools/mysqlclient.py sha256=2dyR2lmKBeyUmoOFz8VCdgMYhOu6LT5VZR5zCfnLbzc 1156
gzspidertools/pipelines.py sha256=_MElza6HTHij1fFlITcWT4hM3tGQW-SRdJp8AYXKztM 2130
gzspidertools/redisclient.py sha256=esgnnSbDOCjk76yhGjvR9Rnj0vSsZ85YS4kYs2U2DuI 28494
gzspidertools/request.py sha256=coQYzBmVYYWJ4EiWXrTqjHlm1MXqF2dEHU4ghAvwOas 112
gzspidertools/scraper/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/http/__init__.py sha256=D0ND7rp2bFlL_RCghVqgpg2ZgnfjiVl0tRNlmVRba-0 203
gzspidertools/scraper/http/request/__init__.py sha256=4NVf2V58OL4W9KdndzuxtOFKubBMcKOEHPMXaUT7qxU 1556
gzspidertools/scraper/http/request/aiohttp.py sha256=kraMUbZq4ZabFGUsUoWo0R_rSRGqFJz_redR4fN5FkQ 4315
gzspidertools/scraper/middlewares/__init__.py sha256=7gWetZ5MIILYJWQJjNeOOX2_QqEoIPD6Vc-qQ-WWWMg 950
gzspidertools/scraper/middlewares/drissionpage/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/middlewares/drissionpage/drissionpage_mid.py sha256=Utg1Ko5yrPtysRSHNOPjyQY81icLkzW18-psk9iJpvU 2021
gzspidertools/scraper/middlewares/headers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/middlewares/headers/ua.py sha256=Bp6EzhkjhQws6oF-EOMsL4vHZhyHmFsoOobRg6gh6Fo 1917
gzspidertools/scraper/middlewares/netlib/__init__.py sha256=b6oohyYnt64DQZhf8RKriRMYGA2nb1agi98VBe1d4yA 158
gzspidertools/scraper/middlewares/netlib/aiohttplib.py sha256=qtVQ8cF6fkfRnbtdcxAX7zYZ2YOEfv3VdbH2jbKoN3I 7463
gzspidertools/scraper/middlewares/proxy/__init__.py sha256=GoPdkZKtRoekIjwY8Glt4TdClt0nIXNKp9C-FupsENc 402
gzspidertools/scraper/middlewares/proxy/dynamic.py sha256=MI_ssb_8Z0v1nAZoRl6Y11jffp8J24m0SxyGjOUgAzg 3905
gzspidertools/scraper/middlewares/proxy/exclusive.py sha256=nHo-W30nh1R7ZNRZORm1-HzFQ_RKnIyGqvjM0folYGs 2809
gzspidertools/scraper/pipelines/__init__.py sha256=zyew8FDdu7zGr1orkv-0Xx5uPB9KzhBeg5XsFeZOdvU 2288
gzspidertools/scraper/pipelines/download/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/pipelines/download/file.py sha256=ys72arkXVkxLkxqEnVA5WIr66DxEMxHTylLopVnQEJk 2263
gzspidertools/scraper/pipelines/es/__init__.py sha256=Lltzcc2WasnK3YoewIvgjyNKhCGqsoAY958Oe9QeueQ 2359
gzspidertools/scraper/pipelines/es/asynced.py sha256=Vq_IbsAtW18ekRgGyPMFBdyBQeo8_mWuKZrpZ1c7j98 3096
gzspidertools/scraper/pipelines/es/fantasy.py sha256=WBXZ3Z04QWSCLdt1HrwpWgrbcfdJSN57CE_t_OAdFb4 144
gzspidertools/scraper/pipelines/mongo/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/pipelines/mongo/asynced.py sha256=2jKQFkgvTDG7x-6OJW5A84PgM8a92OJ45m51vO-ensU 1759
gzspidertools/scraper/pipelines/mongo/fantasy.py sha256=vvrfggBUVwA5_j_IOzH1J_E5fpjsp36LTo053yWiLvY 1437
gzspidertools/scraper/pipelines/mongo/twisted.py sha256=zx3fpSHVBycfpRm6-hIB4yH0yoOFew19aKXfX3runWk 816
gzspidertools/scraper/pipelines/msgproducer/__init__.py sha256=EYSHuuwqY5GqnXPCPv00E2L4tHMRSFLe3m41dNfy3Zc 150
gzspidertools/scraper/pipelines/msgproducer/kafkapub.py sha256=emxocWvduIpaOresbS6zXGMe5i3c_l65w7aQVmmt7DY 3287
gzspidertools/scraper/pipelines/msgproducer/mqpub.py sha256=orI07-fjwaLhytVEJd35hyLqP2SuZ70VP3ckKuhauPM 2213
gzspidertools/scraper/pipelines/mysql/__init__.py sha256=CyTY5gvlJ8XS0_-IpUY3rA5P7yN-wcCBK3Tpgs3AWAE 2774
gzspidertools/scraper/pipelines/mysql/asynced.py sha256=n00hFBQ_A4XEweJejA5taaeiqZU3w_LrM6drK8amVpo 2487
gzspidertools/scraper/pipelines/mysql/fantasy.py sha256=YbtRUy4Nz5bO6LYpmDSkQCDYzOBnjVQBiXaZ-B1kv0A 159
gzspidertools/scraper/pipelines/mysql/stats.py sha256=aNTmedCevB-iqf3aSOSxKy3rptyyMNxjbc5DY0Q8rZE 7200
gzspidertools/scraper/pipelines/mysql/turbo.py sha256=2GbJDJdkiQvAdIT2cy2kU7fRdMFNhFm0yuufTWog9_s 2055
gzspidertools/scraper/pipelines/mysql/twisted.py sha256=iT0Je_jJwiaAK8Jlv9A8_9JtcC40u0gXd0rXLSpxR2E 3186
gzspidertools/scraper/pipelines/oracle/__init__.py sha256=1qKothgIfF_got84KnU11a72dUKmJwqVPMekWgbFs-8 1505
gzspidertools/scraper/pipelines/oracle/fantasy.py sha256=ehmRF1v7RC6-4B7GlDBMGR-vm0p4lx8G59KeIpdrGXI 169
gzspidertools/scraper/pipelines/oracle/twisted.py sha256=633h2KZGDAPDvd01QluFQlvo2NbQMuPSLPBjF67VlJ4 2440
gzspidertools/scraper/pipelines/oss/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/scraper/pipelines/oss/ali.py sha256=2tK-9P2kyis4Jh80C2IhWSmoqqMlTIHDK_BhTp-8NMo 3434
gzspidertools/scraper/pipelines/oss/batch.py sha256=WH2JVHO5hcBhIPQ9baBTS3WmApJEaGM7gd9KuG2iLhY 1637
gzspidertools/scraper/pipelines/postgres/__init__.py sha256=lDkgjT9vAidT9QHUjmGvFTGWdUcopgkViwF0pZe3rak 2269
gzspidertools/scraper/pipelines/postgres/asynced.py sha256=8ufZwmaNVt7jsS5MhMNmY_2zSXST2ErvPLLXJ9VqQ1Q 2089
gzspidertools/scraper/pipelines/postgres/fantasy.py sha256=Rpg0X9GcSs6AN_eRtnpu3pO6r6-JmHTrKjdOBlNNiVM 174
gzspidertools/scraper/pipelines/postgres/twisted.py sha256=Nqy2SV_Od7XWZ5mjepEhGiYF0zEUIW1AlRLqHgHb6UE 3082
gzspidertools/scraper/spiders/__init__.py sha256=yar6zuXT-Ymj00YyQOCGQJC9a5JOyEr0D42M26eZjRM 6727
gzspidertools/scraper/spiders/crawl.py sha256=ykT0BFqLOE-NIYQz8gkC8MsQURoHKn8Uce7OnYgMHSU 333
gzspidertools/spiders.py sha256=7wc2QED5b9BZC5pHrbbs0P5NfQvi98GWPY8O7zEO0YM 176
gzspidertools/templates/project/module/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/templates/project/module/items.py.tmpl sha256=yh9B711-0HpTwOEcnjs0jq0_bq3YJeHp55a5bMNI78E 282
gzspidertools/templates/project/module/middlewares.py.tmpl sha256=7-TmGsS37zZLxBAp6PpjSoLfk9WOX8if6iwzxSW4CZk 3765
gzspidertools/templates/project/module/pipelines.py.tmpl sha256=9hvuACa2qDUo25_aqF9SeSD__N7v8lkWTTCrDspFp-8 381
gzspidertools/templates/project/module/run.py.tmpl sha256=0rdbqyxQGbavMwye-aiykHvPvUI5hop7U-j9bI5kjp0 2371
gzspidertools/templates/project/module/run.sh.tmpl sha256=DFyOk8tCT9NK3PZONKL09Q5XqV3GLsKmdxcZhUePCs4 164
gzspidertools/templates/project/module/settings.py.tmpl sha256=3Hw_iH7zEQ76eFWj90v9JTEAScI7_uvETUcwvmt2QA8 1366
gzspidertools/templates/project/module/spiders/__init__.py sha256=a-Jax6MTMZC2HOw3mUBcNu-T44dOUHDsb22Oly4HTnM 165
gzspidertools/templates/project/module/VIT/.conf sha256=ICASAZgLQGHG8t6V0Jg3Ye-N3c_71ImTWMJhCXunuqU 5654
gzspidertools/templates/project/pyproject.toml sha256=Ei-jOdTs9Bmmq75mHuhwNwt_XAIbQ2LFCluVnPbz54g 67
gzspidertools/templates/project/README.md sha256=7zB0VlYPtocHZ_Q_qVnZtzY5PqqqMuDJzdxKQ2lZ540 38
gzspidertools/templates/project/requirements.txt sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/templates/project/scrapy.cfg sha256=nzoegs3cbSNoMTrdHiPZBfA6As6QoDzH9M8PuwYJ6nY 284
gzspidertools/templates/spiders/async.tmpl sha256=A9VcK8fNcL-THA4C6ZM2VO69dMbt9jNMQJ8zIQR8mS4 1391
gzspidertools/templates/spiders/basic.tmpl sha256=SlJL5vtA85SHq_zIc4Vj9tcmAnE7XOiNZJ4AJzGLRAs 4370
gzspidertools/templates/spiders/crawl.tmpl sha256=Vd4RWCWcJ05M6wQvx6d_NmiR3UmkuzVvokfbKNl5yJ0 1255
gzspidertools/templates/spiders/csvfeed.tmpl sha256=lMIa9JX4Rv-h3nmeDI85QuAmtAXiAco0yUECkYFtE9s 565
gzspidertools/templates/spiders/dp.tmpl sha256=3UjFuAS1L-v02tTPvmruR1etiWROHS7w5kP4UiCUHRg 4496
gzspidertools/templates/spiders/sr.tmpl sha256=znmbMlT3M8ePbDlnMGlbKu-9vpPMFbUu3ESRVFJY0bo 5673
gzspidertools/templates/spiders/xmlfeed.tmpl sha256=n3ORdlT0ktyOuz2ku4-2_2LkPkVfh_QO9aKt2pBQQMQ 559
gzspidertools/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
gzspidertools/utils/cmdline.py sha256=bEZrAamFA0F9eg2Cjj5-Pttv-137bLRKv9FN7vB-qhA 6024
gzspidertools/utils/do_cmd.py sha256=1FS4S88P5XTr95F_dEvBTZjfVfJ6EBtcD4LcMXa_fY4 1129
gzspidertools/utils/fake_ua.py sha256=FeSZ-tifN4EAscF3QvN1OVc7V1cxGAl9dSYeI1SDPeI 1168
gzspidertools/utils/text_verification.py sha256=AbsuEy7rtAnRZjftaNP46fOAHCzVo-zCiqrECAF3T6U 3251
gzspidertools-0.0.21.dist-info/entry_points.txt sha256=-A6AlGpokAMeMxN6ysltpOB5J6Y9rOdmCm96-pcPtTI 61
gzspidertools-0.0.21.dist-info/LICENSE sha256=tbweTWGNiQ0cDAs6_VBc0ZY8CvNxgIso7jUA1QkubSo 1091
gzspidertools-0.0.21.dist-info/METADATA sha256=7MDRgXKbJUagLRGdJgzv0HJY_IaQbmXSIgP1lUnjmug 5124
gzspidertools-0.0.21.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
gzspidertools-0.0.21.dist-info/RECORD — —

entry_points.txt

[console_scripts]
gzcmd = gzspidertools.utils.cmdline:execute