Wheelodex » Projects » distribute-crawler » distribute_crawler-1.0.1-py3-none-any.whl

distribute-crawler

View on PyPI — Reverse Dependencies (0)

1.0.1 distribute_crawler-1.0.1-py3-none-any.whl

Wheel Details

Project: distribute-crawler
Version: 1.0.1
Filename: distribute_crawler-1.0.1-py3-none-any.whl
Download: [link]
Size: 4812
MD5: 268bb34fdc08614d06761bb0be2cd08b
SHA256: 3a7632db72d53a4ba54f3938221bbc8742499abb3f8fe2628b992ea6a358048a
Uploaded: 2024-06-01 03:35:12 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: distribute_crawler
Version: 1.0.1
Summary: 使用scrapy,redis, mongodb,graphite实现的一个分布式网络爬虫,底层存储mongodb集群,分布式使用redis实现,爬虫状态显示使用graphite实现。
Author: yanjlee
Author-Email: yanjlee[at]163.com
Home-Page: https://github.com/yanjlee/distribute_crawler
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Dist: requests
Requires-Dist: faker
Requires-Dist: execjs
Requires-Dist: loguru
Requires-Dist: base64
Requires-Dist: hashlib
Requires-Dist: Crypto
Requires-Dist: pandas
Requires-Dist: fuzzywuzzy
Requires-Dist: httpx
Requires-Dist: Pillow
Requires-Dist: playwright
Requires-Dist: PyExecJS
Requires-Dist: redis
Requires-Dist: fastapi
Requires-Dist: uvicorn
Requires-Dist: APScheduler
Requires-Dist: beautifulsoup4
Requires-Dist: bs4
Requires-Dist: certifi
Requires-Dist: clickhouse-driver
Requires-Dist: curl-cffi
Requires-Dist: DrissionPage
Requires-Dist: Jinja2
Requires-Dist: langchain
Requires-Dist: langchain-community
Requires-Dist: suiutils-py
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 4398 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
distribute_crawler-1.0.1.dist-info/LICENSE sha256=GzHS9pi6vw_oGwKIGxAPch8iuVrHazOilEsYL7AlPK0 1085
distribute_crawler-1.0.1.dist-info/METADATA sha256=Svw-1YP4DMTTrvOsrcj0_zIliLxsN7qVl0XLki6vGHg 8074
distribute_crawler-1.0.1.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
distribute_crawler-1.0.1.dist-info/top_level.txt sha256=AbpHGcgLb-kRsJGnwFEktk7uzpZOCcBY74-YBdrKVGs 1
distribute_crawler-1.0.1.dist-info/RECORD — —

top_level.txt

[empty]