Wheelodex » Projects » modis-crawler-utils

modis-crawler-utils

View on PyPI — Reverse Dependencies (0)

0.3.32 modis_crawler_utils-0.3.32-py3-none-any.whl
0.3.31 modis_crawler_utils-0.3.31-py3-none-any.whl

Wheel Details

Project: modis-crawler-utils
Version: 0.3.31
Filename: modis_crawler_utils-0.3.31-py3-none-any.whl
Download: [link]
Size: 71778
MD5: 347ed8d72fcd18a6953ebbf214f20ed2
SHA256: 4dbfa670f69fbad471542ef0cab5688b327fff324731ba4537eaeef30cab2703
Uploaded: 2024-11-08 14:12:22 +0000

dist-info

METADATA · WHEEL · RECORD · entry_points.txt

METADATA

Metadata-Version: 2.3
Name: modis-crawler-utils
Version: 0.3.31
Summary: Scrapy utils for Modis crawlers projects.
Author: Varlamov
Author-Email: varlamov[at]ispras.ru
Home-Page: https://gitlab.at.ispras.ru/crawlers/crawler-utils
Project-Url: Repository, https://gitlab.at.ispras.ru/crawlers/crawler-utils
License: BSD
Classifier: Development Status :: 3 - Alpha
Classifier: Framework :: Scrapy
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: BSD License
Classifier: License :: Other/Proprietary License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Requires-Python: >=3.9,<4.0
Requires-Dist: Pillow (>=7.1.2)
Requires-Dist: certifi
Requires-Dist: cryptography (==36.0.2)
Requires-Dist: dateparser (>=1.2.0)
Requires-Dist: ephemeral-port-reserve (>=1.1.1)
Requires-Dist: itemadapter (>=0.2.0)
Requires-Dist: kafka-python (>=2.0.1)
Requires-Dist: opensearch-py (<3.0.0,>=2.7.1)
Requires-Dist: pydantic (<3.0.0,>=2.4.2)
Requires-Dist: pymongo (>=3.10.1)
Requires-Dist: pyopenssl (==22.0.0)
Requires-Dist: python-logstash (>=0.4.6)
Requires-Dist: requests (>=2.23.0)
Requires-Dist: scrapy (>=2.6.0)
Requires-Dist: scrapy-puppeteer-client (>=0.0.6)
Requires-Dist: scrapy-splash (>=0.8.0)
Requires-Dist: sentry-sdk (<3.0.0,>=2.13.0)
Requires-Dist: twisted
Description-Content-Type: text/markdown
[Description omitted; length: 4552 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 2.0.0.dev0
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
crawler_utils/__init__.py sha256=GMeI-pB75at4fEUqVTkbQXnyD5SE25sagwaenEjkBS4 1321
crawler_utils/captcha_detection/__init__.py sha256=ja-vbpjM7z-wSiDXfuOXCKuARUoVthB_0UoV4UvT94c 120
crawler_utils/captcha_detection/captcha_detection.py sha256=xys928icFKjcYExlWm50HGc29A5sGDKJ7FCSY-m-0so 3287
crawler_utils/cloudflare_captcha_bypass.py sha256=hi9vNZ6t6FdVpnnkQhptmF4AFUWA5BItlxt1sWIXOxg 1193
crawler_utils/credentials/__init__.py sha256=rGOkAFrw0I8Pa4iNqzO0rKmDBLplGqIFRzcYb4cxo4k 262
crawler_utils/credentials/credential.py sha256=EROywQm03AQngcv2zCqmYox3MUyJ43bEMR67DN4WvCA 3032
crawler_utils/credentials/manager.py sha256=dc4GH3ymYQPww6lONbIZgKK7_h96XYu5PVYyNPK_TDk 5975
crawler_utils/credentials/store/__init__.py sha256=PJ7R8fk4eZXc9NTRRh-kRdNiCcnYT-bbWenoy3XW13g 1263
crawler_utils/credentials/store/local.py sha256=JW_5M7ZPs5iaC558bfiVfiUA8wB9VR6VvdUhTSJ7lIQ 4407
crawler_utils/credentials/store/talisman.py sha256=HS_1hk_OgAC4TBLVjQY4K0FJjoyfGfvNS7bm9RDKGoc 3533
crawler_utils/deploy/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
crawler_utils/deploy/bump_version.py sha256=VEcE_V5wpBbY7ipkU9rFSHYQf4TV9i0BN5-OIDpk8lU 437
crawler_utils/deploy/create_egg.py sha256=ppsnC6fdGRyKj4-NJa3GCSZS1PIWVfY6R2dbaXtth1Q 4155
crawler_utils/deploy/make_arguments_md_file.py sha256=WzHEaci5vcQ9kTTUyMPjWid89hnKURWAR5069xL7R8s 3113
crawler_utils/domains.py sha256=OXGfL5JTE379vVx9PYFgVVefjXq5Xol9QMYQlgucvew 533
crawler_utils/echo.py sha256=7cdd6kJPv7YyYCiRVuFovlfwA41Zw1ez4k-8ojbV8yY 1422
crawler_utils/files.py sha256=gkaF2QU8l6c_OdCHIKhY6n9AIKMOCtDGkikyEcKfCiY 30298
crawler_utils/images.py sha256=wmiy_6zBFaQGGpI7N2MlnjTHRzc3UEnpxywUTI-h2Qs 5002
crawler_utils/kafka.py sha256=DMybQQmuC9WCYK-9iM-uUP4akVdqFgy1Swgxs7y3r04 2647
crawler_utils/logstash.py sha256=EuHA1WbQUIV2pYoOjTPEY5KIVu7qRmCiDBOaBY_45pY 3073
crawler_utils/misc.py sha256=o6lqNUrUw2zlvCUHDukZTnYC68UJtOURT5bvQHpe1-c 1495
crawler_utils/mongodb.py sha256=DXHeyohGKQn-rF_MAocm86KVWmyKqzwE5ENj8e7waP0 4862
crawler_utils/opensearch/__init__.py sha256=AWlAtsST30AVABBnd4VKFjTStGfB-CuCOeJtuUSua6w 274
crawler_utils/opensearch/dupefilter.py sha256=IepAzXRqFu4-Mmkat9I2TGfqvmcH8I3LetDrVyvnmLM 8582
crawler_utils/opensearch/dupefilter_strategies/__init__.py sha256=yZtC8u5lQnm8XlEH9QZV4faeGGvppsXMrsoD5GPmXq0 3049
crawler_utils/opensearch/dupefilter_strategies/delta_fetch_items.py sha256=32IdnUr16vw7yT9D0QN37EX0WrYtNozs63fvXfqJkTE 4164
crawler_utils/opensearch/dupefilter_strategies/depth_based.py sha256=3xqFdN2Dv4TTFs4eaMRWbA1kMRql3SITOqFPBXjeUIc 899
crawler_utils/opensearch/dupefilter_strategies/drop_unproductive_requests.py sha256=CcaOcfELC4Kd4uwgggfVB_ycvs-ghusE7pn8PKciVFc 5251
crawler_utils/opensearch/items_pipeline.py sha256=2rFbaOd95Pst-vfIePnCootbzUeHLtFK9hSmUAZyErQ 3742
crawler_utils/opensearch/request_fingerprint.py sha256=12u_LTkbvUj5ksggF0i9Oyz5Y90vLuVCU8VaWFJbjgk 1576
crawler_utils/opensearch/requests_middleware.py sha256=N-tMKtOmQ9uRCYKp34xAmIO4Llo8mmDBYhkW0tdeJS0 4950
crawler_utils/opensearch/storage.py sha256=wk1J9aULgAMSID53H3ZYmdFNqWRC6DzPqcYs5rj_u3s 4786
crawler_utils/proxypy.py sha256=3MfVgn-5y6qjvbcV-8edmdsK-I08QogzInDIIhhtfAc 4915
crawler_utils/sentry_logging/__init__.py sha256=A5GCIg7f1URgsTyXf2mVDXlpH0ZYHiSI7BR0smJX7ZM 89
crawler_utils/sentry_logging/sentry_logging.py sha256=Eg0m0O4shNuhmriST3Py6fXes77Aq2xcpU3E5ydcnjU 1939
crawler_utils/social_media/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
crawler_utils/social_media/items.py sha256=5AtWyXaRM4cu6H7PEGGp3jXQ6HYZLZVOF3IQEU3U4HA 23632
crawler_utils/socks.py sha256=nF7Kun_t-y7PXkC9S1_OJk_tEaSrksE27UhJcFQi8dw 4274
crawler_utils/splash_proxy.py sha256=bkFdD2uDSW3ONak6pQMvL6ucAg7BhEOFByJWVCak-ok 499
crawler_utils/states/__init__.py sha256=8VCPWyQYVSONSIn_vFNp7JfmQhNglbjUjTtvtjsL0s8 1955
crawler_utils/states/local_store.py sha256=32pj7XIWYTXHLNlxPZlaym33FrWTVG6qutS8Evb-XRM 4489
crawler_utils/states/talisman_states_api.py sha256=fZ2UsH2COWq6eOq8NQFIBx0-P8zk09hF4CX507t7MOc 7705
crawler_utils/talisman_controller.py sha256=Hfb6OVq3Xp73mOEtawhwCHfyvaOuh6EENXkd-ZH2WNU 5102
crawler_utils/talisman_job_env.py sha256=b_-sIInJSRipmSxSCOb8WB-LZ-m2QK5tWdWHdT8XaTM 1387
crawler_utils/talisman_proxy.py sha256=KIioJg6TKncGM11ewjpOKPs-6Zh2P4IDOA0fQx-GSbE 14724
crawler_utils/talisman_spider_state.py sha256=1iVR_sIQ4yo2p-TjZLCrOBZaCSYAziQvc8xhB3kxPng 2332
crawler_utils/text_captcha_bypass/__init__.py sha256=n1aM4ULwAIV4nyj9pss29zjNQRc6PG8jF_seujarID4 134
crawler_utils/text_captcha_bypass/captchaMiddleware.py sha256=YmvrZgNPIlkSrNJdMj5FPv8oGix7mDG8pl-U6yagN9w 3369
crawler_utils/text_captcha_bypass/captchaRule.py sha256=FsyU248JhZAoHRJhtQGkPFNitXnhCfM8K84klTQ2Qyc 2129
crawler_utils/timestamp.py sha256=SPipOEIvTvbs97J3-QhPW95YWmC1NoM3yuhrHdfq7oI 179
crawler_utils/trust_level.py sha256=SROpCgEa_88DP2HbzxlqWJfsVwfJQbkNVzyETbQqNVc 635
crawler_utils/uuid.py sha256=Gp2qdeHbxWJC2gQUhBw7z8vjNmqUooXJi9Oa5ej5GQw 281
crawler_utils/validate_input.py sha256=bd-aTsMzjgY2hNUExmiVrzSyPqLJLT74XLvagjbEGhg 2332
modis_crawler_utils-0.3.31.dist-info/METADATA sha256=4hftW6uVEphXaqJokn8rwcv69UzZR0V7BUbIITN7ipI 6179
modis_crawler_utils-0.3.31.dist-info/WHEEL sha256=YxM3tSmuuzPARtqHgFjwYakaXJ7nMa2TMsK_1H5JEok 93
modis_crawler_utils-0.3.31.dist-info/entry_points.txt sha256=9ZSEwbJI3NHPcQRWCCwoU4UXV8a1JenGWPTUJ4F_CtY 176
modis_crawler_utils-0.3.31.dist-info/RECORD — —

entry_points.txt

[console_scripts]
build-egg = crawler_utils.deploy.create_egg:main
build-md = crawler_utils.deploy.make_arguments_md_file:main
bump-version = crawler_utils.deploy.bump_version:main