XueQiuSuperSpider

View on PyPIReverse Dependencies (0)

2.2.5 XueQiuSuperSpider-2.2.5-py3-none-any.whl

Wheel Details

Project: XueQiuSuperSpider
Version: 2.2.5
Filename: XueQiuSuperSpider-2.2.5-py3-none-any.whl
Download: [link]
Size: 8042
MD5: 0d9389a558776fd6e4b4059433ef5aa2
SHA256: e5ac31e4b40dc43bb76cfaff95e6484a98587242968e0dbecd91dcbb5ad06813
Uploaded: 2024-06-01 08:45:34 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: XueQiuSuperSpider
Version: 2.2.5
Summary: 雪球超级爬虫的所有组件互相没有任何依赖,包括参数。整体架构由Collector、Mapper以及Consumer三个接口支撑。功能分别为数据搜集、数据相关信息(分支信息)的组装、以及最终的数据分析,三个接口定义了整个数据抓取生命周期的三个阶段。Mapper组件可以进行多次嵌套,就像流水线一样,不同的Mapper负责自己对应的组装任务,经过N个Mapper,完成一个对象的N种属性组装,当然,如果你不需要某些属性,你完全可以跳过某些mapper,这样可以节省许多抓取时间。在参数传递方面,模块在处理参数之前会对参数进行深度复制,确保不会出现多线程同步问题,模块内部参数严格定义为只读。变量只局限在方法范围内,完全避免了线程间数据共享。.
Author: yanjlee
Author-Email: yanjlee[at]163.com
Home-Page: https://github.com/yanjlee/XueQiuSuperSpider
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Dist: requests
Requires-Dist: faker
Requires-Dist: execjs
Requires-Dist: loguru
Requires-Dist: base64
Requires-Dist: hashlib
Requires-Dist: Crypto
Requires-Dist: pandas
Requires-Dist: fuzzywuzzy
Requires-Dist: httpx
Requires-Dist: Pillow
Requires-Dist: playwright
Requires-Dist: PyExecJS
Requires-Dist: redis
Requires-Dist: fastapi
Requires-Dist: uvicorn
Requires-Dist: APScheduler
Requires-Dist: beautifulsoup4
Requires-Dist: bs4
Requires-Dist: certifi
Requires-Dist: clickhouse-driver
Requires-Dist: curl-cffi
Requires-Dist: DrissionPage
Requires-Dist: fake-useragent
Requires-Dist: Flask
Requires-Dist: Flask-APScheduler
Requires-Dist: Flask-Cors
Requires-Dist: frida
Requires-Dist: gevent
Requires-Dist: Jinja2
Requires-Dist: langchain
Requires-Dist: langchain-community
Requires-Dist: suiutils-py
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 11307 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
XueQiuSuperSpider-2.2.5.dist-info/LICENSE sha256=mLVACQjyujHq1ZYLwwwF11oMIaWi1yLKHumfZAAPFFk 1080
XueQiuSuperSpider-2.2.5.dist-info/METADATA sha256=QJhPlXVwQzxHgMyKBsx283qhcscprgvnzM4OGaPpZec 17460
XueQiuSuperSpider-2.2.5.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
XueQiuSuperSpider-2.2.5.dist-info/top_level.txt sha256=AbpHGcgLb-kRsJGnwFEktk7uzpZOCcBY74-YBdrKVGs 1
XueQiuSuperSpider-2.2.5.dist-info/RECORD

top_level.txt

[empty]