ayugespidertools

View on PyPIReverse Dependencies (0)

3.10.1 ayugespidertools-3.10.1-py3-none-any.whl

Wheel Details

Project: ayugespidertools
Version: 3.10.1
Filename: ayugespidertools-3.10.1-py3-none-any.whl
Download: [link]
Size: 110814
MD5: 25077432cd561524b5abf0637d513d3c
SHA256: 2e272feaf70d0f6a4c8ff5ce435f71667359239a320fb6f32ec90cfcb98e1c62
Uploaded: 2024-10-19 14:28:08 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: AyugeSpiderTools
Version: 3.10.1
Summary: scrapy 扩展库:用于扩展 Scrapy 功能来解放双手。
Author: ayuge
Author-Email: ayugesheng[at]gmail.com
Maintainer: ayuge
Maintainer-Email: ayugesheng[at]gmail.com
Home-Page: https://www.ayuge.top/mkdocs-material/
Project-Url: Documentation, https://ayugespidertools.readthedocs.io/en/latest/
Project-Url: Repository, https://github.com/shengchenyang/AyugeSpiderTools
Keywords: crawler,scraping,scrapy-extension
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.8.1,<4.0.0
Requires-Dist: DBUtils (<4.0.0,>=3.0.2)
Requires-Dist: Pillow (<10.0.0,>=9.2.0); extra == "all"
Requires-Dist: PyMySQL (<2.0.0,>=1.0.2)
Requires-Dist: SQLAlchemy (<3.0.0,>=2.0.23)
Requires-Dist: Scrapy (==2.11.2)
Requires-Dist: aiohttp (<3.10.0,>=3.9.5)
Requires-Dist: aiomysql (<0.2.0,>=0.1.1)
Requires-Dist: elasticsearch-dsl (<9.0.0,>=8.11.0); extra == "all" or extra == "database"
Requires-Dist: itemadapter (<0.8.0,>=0.7.0)
Requires-Dist: kafka-python (==2.0.2)
Requires-Dist: loguru (<0.8.0,>=0.7.0)
Requires-Dist: mmh3 (<4.0.0,>=3.0.0); extra == "all"
Requires-Dist: motor (==2.5.1); python_version < "3.11"
Requires-Dist: motor (<3.6.0,>=3.5.1); python_version >= "3.11"
Requires-Dist: numpy (<1.25.0,>=1.24.3); python_version < "3.9" and extra == "all"
Requires-Dist: numpy (<1.27.0,>=1.26.0); (python_version >= "3.9" and python_version < "3.13") and extra == "all"
Requires-Dist: opencv-python (<4.9.0.0,>=4.8.0.74); extra == "all"
Requires-Dist: oracledb (<2.0.0,>=1.4.2); extra == "all" or extra == "database"
Requires-Dist: oss2 (<3.0.0,>=2.18.4); extra == "all"
Requires-Dist: pika (<1.4.0,>=1.3.2)
Requires-Dist: psycopg (<3.2.0,>=3.1.13); extra == "all" or extra == "database"
Requires-Dist: psycopg-binary (<3.2.0,>=3.1.13); extra == "all" or extra == "database"
Requires-Dist: psycopg-pool (<3.3.0,>=3.2.0); extra == "all" or extra == "database"
Requires-Dist: pycryptodome (<4.0.0,>=3.15.0); extra == "all"
Requires-Dist: python-hcl2 (<5.0.0,>=4.3.0); extra == "all"
Requires-Dist: pyyaml (<6.1,>=6.0); extra == "all"
Requires-Dist: retrying (<2.0.0,>=1.3.3)
Provides-Extra: all
Provides-Extra: database
Description-Content-Type: text/markdown
[Description omitted; length: 7186 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.9.0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
ayugespidertools/__init__.py sha256=rVXwm_yP_vygEm0MFYPPBUaj9-W4phXtX4IyHQMaKV4 428
ayugespidertools/commands/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
ayugespidertools/commands/crawl.py sha256=YiBAnHgTLzY8WAOpV43KwvJlwlIpnDEP6kBODf3cfH0 75
ayugespidertools/commands/genspider.py sha256=rlYQlMSU3uNecP3Tym-iC94CIGuG4Hlicn92-X8CK-E 330
ayugespidertools/commands/startproject.py sha256=HFyjjrm6UwONUbv4U_5rGoBMDmsD62fumLuEWdbldZY 869
ayugespidertools/commands/version.py sha256=NVVRFLzvlmmDJQ3pBe4RgH_qyigkwvjmOE4xvC56OUc 357
ayugespidertools/common/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
ayugespidertools/common/encryption.py sha256=x7mgzOj6EESoxm06x_4IVpFFAaVBObgvPO3MSKwkPXU 2326
ayugespidertools/common/expend.py sha256=bOwU2coCigICdZ3wHLAx65KQ89xrwEcWvZBQcxk3RnU 10176
ayugespidertools/common/mongodbpipe.py sha256=_JM8bxYkiWAt6FEFDR4y8_-HjIkQP-m0I4byRyvjOsQ 4962
ayugespidertools/common/multiplexing.py sha256=lHJwRrrf3L2H8C367LanQa-jPrFtMPmgh6F4AibP3vI 18965
ayugespidertools/common/mysqlerrhandle.py sha256=7YA8S_YoDwQZOBhMjmgrSmmJ7EjFW70B8lr2778zsyI 10339
ayugespidertools/common/params.py sha256=v6_XXuaz4PSRbwnWjOhqaxzCPxZ4ApF5bKk-6qZe7LM 1508
ayugespidertools/common/postgreserrhandle.py sha256=SfE5FgbPvPfgJDMHVDhKBYKmhbjPPwDgBcCeejG6AFE 4763
ayugespidertools/common/spiderconf.py sha256=L5WrVK-W3e2UG36q72d2gMhQw0b_bHziVPIHtf-uPMM 12584
ayugespidertools/common/sqlformat.py sha256=jvPZs2NSfKu8-LbPrxJLOk9jHAuGC2WdnZz1-S0tIOc 3079
ayugespidertools/common/typevars.py sha256=m9YbZO6jwDX703TgHmprN5WGl0P2qaOnuauACMoPflA 5572
ayugespidertools/common/utils.py sha256=EHI7TRZSMBVd91TyR4AGr7k7GI5PQifskQdps-KUbLk 11733
ayugespidertools/config.py sha256=zaBOdFK_Rg94G-pp4CHV1-LarO74bEBaE3n-k_0TIqk 795
ayugespidertools/data/browsers.json sha256=kIr4KSLTjXrLXKU5oM_zSx0EYu9ne59QjEpuiskWCsQ 58096
ayugespidertools/extras/__init__.py sha256=1Q3ccnYrNDCKQ7xFSJyM71ab3tabj76OSJiXX5QOgE0 68
ayugespidertools/extras/cvnpil.py sha256=k79eYZWxN9Qv5sN88MjLPvgQGcBLYn4dbU6-DaoEArg 15987
ayugespidertools/extras/ext.py sha256=ZWgNVHNhzEB-S32JQrbPpmQnMlg6O1os9H6wZeKY2Pc 1937
ayugespidertools/extras/oss.py sha256=DPfVMTVTco_YY3XDfX7R75df0_gdTwF5LqdHJlWKw5A 2559
ayugespidertools/formatdata.py sha256=j9g0EWgB4VFx6ATTnFJI88DKQ6olSXhq55jK0Uy-RMM 6980
ayugespidertools/items.py sha256=iGQGGIzYLZVwbFU7hecUrdVB1qPjA_9dCIFn5qTi5z0 5597
ayugespidertools/middlewares.py sha256=ddFORBbiSv4QjDHpFuuZ1mo6ybcOO9cKECSqWZ2eJmg 653
ayugespidertools/mongoclient.py sha256=gN2fcb_ptvr0lJQqEhb1TgCAuCF7HGQaLnjiaH-GCtw 4054
ayugespidertools/mysqlclient.py sha256=XA0jxwehhKHWk-abO9RYVlInzo88o_YXVGTmfXZuyWY 1114
ayugespidertools/pipelines.py sha256=Mgc0_BNCRb-YnQ6Uum3_4fntT1nVXLSg9x0symTpYtw 2258
ayugespidertools/request.py sha256=JYRnR_Ogk6o5PAh17IUx2VE-MDjpxfDwp1dl1pUrj3k 110
ayugespidertools/scraper/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
ayugespidertools/scraper/http/__init__.py sha256=JYRnR_Ogk6o5PAh17IUx2VE-MDjpxfDwp1dl1pUrj3k 110
ayugespidertools/scraper/http/request/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
ayugespidertools/scraper/http/request/aiohttp.py sha256=dYrQwvquvU0Gc8fU0STZ2bCxWiBH0nXbJXMabWXXNnA 4185
ayugespidertools/scraper/middlewares/__init__.py sha256=u1CLjnmmzmztB0mNiYE33EONBTvgNSlRAJfDJt2Yfik 797
ayugespidertools/scraper/middlewares/headers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
ayugespidertools/scraper/middlewares/headers/ua.py sha256=rPLy3VjiwsYwAjcA22MpqfQ4imccP2JEhZBwtKZjrN4 1865
ayugespidertools/scraper/middlewares/netlib/__init__.py sha256=sD9FSjQGLFwQyu0hVKiH7zQwXqdnfWITmB3DrrCVOQI 154
ayugespidertools/scraper/middlewares/netlib/aiohttplib.py sha256=r4-ewyMHR2OtqanHAw_Oeza2O3HU_8EoHw2cqbnfiNo 7247
ayugespidertools/scraper/middlewares/proxy/__init__.py sha256=EiV0-l7tVRjXC55wsN4k7NULsGGK8W9orT8CJN6J33c 395
ayugespidertools/scraper/middlewares/proxy/dynamic.py sha256=ZN_W50tb1Ad5z7dVovsFfzjsbZUN9USEDDrwG-8_7kA 3812
ayugespidertools/scraper/middlewares/proxy/exclusive.py sha256=aWFqkCO-SNJf1JYa2QXzIKAWTB7koznOsMTJ7DA5_rs 2737
ayugespidertools/scraper/pipelines/__init__.py sha256=7UEBnUZtNqFeHOtlCU--R_0RoUoFbSWRoiVhRjkl6sw 2298
ayugespidertools/scraper/pipelines/download/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
ayugespidertools/scraper/pipelines/download/file.py sha256=hTyv-skhMFTGNkeHWjIFZeaVIoUXtUafyUWtjsd6YcQ 2217
ayugespidertools/scraper/pipelines/es/__init__.py sha256=0ELL8WnRUW-ZC2hEX6VQsSfvrnBSb0XKJKdhOL1xfwA 2312
ayugespidertools/scraper/pipelines/es/asynced.py sha256=uLcx5x5Df3NI-zXwhkhA_X3wFxDdOIw3i9LrWJEyTiI 3024
ayugespidertools/scraper/pipelines/es/fantasy.py sha256=pnPera54geubGfiUnslBQXgsxDlD404_VIzdwB_Id_o 141
ayugespidertools/scraper/pipelines/mongo/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
ayugespidertools/scraper/pipelines/mongo/asynced.py sha256=489TaXg9nAB5ceJiM5vtqPs7mdZ4M8JFVRimUr5vdjo 1719
ayugespidertools/scraper/pipelines/mongo/fantasy.py sha256=cakoNWho8Q5Hf7zfRWYIpdDeicYXMZkBgPRU8zLl-F4 1408
ayugespidertools/scraper/pipelines/mongo/twisted.py sha256=gQ27ec_Bg4eTJM5I_vdDPxNVMHoVJ6p8MJrapFKWNNY 802
ayugespidertools/scraper/pipelines/msgproducer/__init__.py sha256=8HKFGDtdYvJTSWWg0wqUFpG1Yfr80vq7SIeDOYZBMfw 148
ayugespidertools/scraper/pipelines/msgproducer/kafkapub.py sha256=VFsgKnRtejlgPEJkGFc0blz6hkxXw7zoSpXTLFUfUB0 3200
ayugespidertools/scraper/pipelines/msgproducer/mqpub.py sha256=AeJDnkF4c47nypPkzIJxwo2K4bdft2V4N98CgCd4FQY 2163
ayugespidertools/scraper/pipelines/mysql/__init__.py sha256=trtjRAo_9tFxn0CRzR9luCrSTuU6kSJQw1oTAZSmIVM 2704
ayugespidertools/scraper/pipelines/mysql/asynced.py sha256=E9-r9hIQoLDtejcELk9Wute9GqtR9vGIcVBazQDrI2s 2430
ayugespidertools/scraper/pipelines/mysql/fantasy.py sha256=0dUU--a9qTqjrVQIjKzSED6MNTeb1o6M2zTIBvZgpPg 156
ayugespidertools/scraper/pipelines/mysql/stats.py sha256=-Cw-kLQDrHyXJ0V2o_AV-jxobQ38hd3SYokoQ5TMO8A 7041
ayugespidertools/scraper/pipelines/mysql/turbo.py sha256=DJPF4c07VNfkdC_d6k6Bo4bCQaxm-6mLBZ6TRXnLU-g 2000
ayugespidertools/scraper/pipelines/mysql/twisted.py sha256=9w3GGq5ZTbgqzTO0a0gFz8KCpJDmDS6fx77fg4zMw3I 3112
ayugespidertools/scraper/pipelines/oracle/__init__.py sha256=PZobCY_42EuufXJyWs8b1htuSWwCXyrWoGL3clu5ZnI 1472
ayugespidertools/scraper/pipelines/oracle/fantasy.py sha256=usAs-DirrMq1mrZFMqB2DyV9L_C76izLMkXFybcrsZI 161
ayugespidertools/scraper/pipelines/oracle/twisted.py sha256=VhfQDQ0q4KwkfYEdRqiz58gmpfwCM7qMcmiYVd5AHEw 2385
ayugespidertools/scraper/pipelines/oss/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
ayugespidertools/scraper/pipelines/oss/ali.py sha256=x955MUQ5-J6qUCsuEBks2prSAPO507sGTVAWSxayZUY 3361
ayugespidertools/scraper/pipelines/oss/batch.py sha256=JC-PhSXV_X62gfTcC0LiDnTSI0F4Dx570z8x3-SA7X0 1643
ayugespidertools/scraper/pipelines/postgres/__init__.py sha256=487PPsN-O_W6eQ8vltOqcQXmk4hN8ocZV6ak3gCenyg 2219
ayugespidertools/scraper/pipelines/postgres/asynced.py sha256=DNxoiadE0Qxm3X6P_4utjEFLzzC9bR8_NjSN0DedWxE 2046
ayugespidertools/scraper/pipelines/postgres/fantasy.py sha256=imPzG3VvySJhKNp3-FlSlzIruymkZkCuwWjaPyho-x4 171
ayugespidertools/scraper/pipelines/postgres/twisted.py sha256=NUa7Bcc0lY0fz1dOeNP4-sVJ_V2_caWp58JSbl36kdQ 3016
ayugespidertools/scraper/spiders/__init__.py sha256=6COrjI6iAsOA2HOl-g3FBPAG_BhNBw0vIgG4iXLVh8A 6494
ayugespidertools/scraper/spiders/crawl.py sha256=-KaGMJADAkJtwFSECMeO9EdRsab6v5IZYZJCWZrGpLk 323
ayugespidertools/spiders.py sha256=5eX5WzXMXIuHjVks7oecRJJalsN1vCSvZCUtpzgZRc4 175
ayugespidertools/templates/project/module/VIT/.conf sha256=eW1JPTau5OL5TcRtwr68I3UPUJVgrmZq7oTcy3PM8Vo 6711
ayugespidertools/templates/project/module/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
ayugespidertools/templates/project/module/items.py.tmpl sha256=Np-s1YAcR11Dpq2LBMaz-AkQUfXkP1HJm_1su3qUojU 270
ayugespidertools/templates/project/module/middlewares.py.tmpl sha256=9NB1WYc0qOomsmxN0KPzZ-MIn8q3rLpwTUyVXERyFF4 3663
ayugespidertools/templates/project/module/pipelines.py.tmpl sha256=3dAWB6xx4aSOdX6S7osk9nrEuqc1hwM9lyb--1W0kxs 368
ayugespidertools/templates/project/module/settings.py.tmpl sha256=dLr8cidjRt3uJgw-uk63_fUdeWG5qTpnAOStASPdqe8 1118
ayugespidertools/templates/project/module/spiders/__init__.py sha256=ULwecZkx3_NTphkz7y_qiazBeUoHFnCCWnKSjoDCZj0 161
ayugespidertools/templates/project/scrapy.cfg sha256=rRXe96NnAjpS8_2AtC_flgy7uleqtduLmPd-K720IG4 273
ayugespidertools/templates/spiders/async.tmpl sha256=C1XAxBHHlKNlwiZTBsnVcUdU9VyWWHjS6NetqR7Sw_w 935
ayugespidertools/templates/spiders/basic.tmpl sha256=21oiVO-jM6YxY1XaM2pdlJ2sXQw6Xwq9q7tMiBESumw 2866
ayugespidertools/templates/spiders/crawl.tmpl sha256=urF_d3ehss0dj0aT9X4wmxwHaRTZ-PXBhZpZY45jMZw 851
ayugespidertools/templates/spiders/csvfeed.tmpl sha256=sUOCnmDu2YocUxqiq34rJIO9ZFrIwNm8bFhHJAr5wZw 526
ayugespidertools/templates/spiders/xmlfeed.tmpl sha256=Wz3n8lhiRaHJ5ujjMQ30e0PnRDfg5CEOVf7_yfa-YNk 524
ayugespidertools/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
ayugespidertools/utils/cmdline.py sha256=hlNzUvt98BtRm-gYu4X44mse-LLdbEkhi498jL9B22Y 6876
ayugespidertools-3.10.1.dist-info/LICENSE sha256=Luhgtj1mB9AJY1xIoRQCW9oPFdyQWQmTmYRwhQL7C8M 1070
ayugespidertools-3.10.1.dist-info/METADATA sha256=00L91GCHr6fxzuyYspr8as_IP-R21wh4n3jMQFmAq38 13746
ayugespidertools-3.10.1.dist-info/WHEEL sha256=sP946D7jFCHeNz5Iq4fL4Lu-PrWrFsgfLXbbkciIZwg 88
ayugespidertools-3.10.1.dist-info/entry_points.txt sha256=e1RLZxiku2NVbBdjVzqwr3AY9XFDe90SYgrc5rzSGPo 64
ayugespidertools-3.10.1.dist-info/RECORD

entry_points.txt

ayuge = ayugespidertools.utils.cmdline:execute