CrawlersTools

View on PyPIReverse Dependencies (0)

1.4.81 CrawlersTools-1.4.81-py3-none-any.whl

Wheel Details

Project: CrawlersTools
Version: 1.4.81
Filename: CrawlersTools-1.4.81-py3-none-any.whl
Download: [link]
Size: 94376
MD5: 8fbfa667be4d05fff79e28a128c1b2f5
SHA256: ee0310c8ac4ffd6a628ee205b9f3f366e52ad61e2f01741d3cb4374ae5e0ee9d
Uploaded: 2023-12-25 08:28:38 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: CrawlersTools
Version: 1.4.81
Summary: Tools for Crawlers
Author: MuggleK
Author-Email: peichangchuan[at]gmail.com
Home-Page: https://github.com/MuggleK/CrawlersTools
License: BSD License
Classifier: Intended Audience :: Developers
Classifier: Operating System :: OS Independent
Classifier: Natural Language :: Chinese (Simplified)
Classifier: Programming Language :: Python :: 3.7
Classifier: Topic :: Software Development :: Libraries
Platform: all
Requires-Dist: auto-mix-prep
Requires-Dist: DBUtils (==1.3)
Requires-Dist: fontTools
Requires-Dist: httpx
Requires-Dist: httpx[http2]
Requires-Dist: loguru
Requires-Dist: Pillow
Requires-Dist: PyExecJS (==1.5.1)
Requires-Dist: pymongo
Requires-Dist: PyMySQL
Requires-Dist: redis
Requires-Dist: tqdm
Requires-Dist: PyYAML
Requires-Dist: lxml
Requires-Dist: numpy
Requires-Dist: Distance
Requires-Dist: chardet
Requires-Dist: sinan
Requires-Dist: kafka-python
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 34978 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.42.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
CrawlersTools/__init__.py sha256=yZoUpqm0bbDAH4Ltqm454vSt44gi9nuuKixebdKddkM 475
CrawlersTools/extractors/__init__.py sha256=s3AXtcakQCXZf380IlFpCP_uQiXmBkEngR4vSxdy6JA 1415
CrawlersTools/extractors/attachment_extractor.py sha256=XtM1mwqUywh9b-ZUyJRqi4VXy3M6RLsMlhyCy0OCZMg 1800
CrawlersTools/extractors/base.py sha256=xLNtejxF-yORT8OnhVzcY0qFIG5fyoK68ZTkY3uNtzU 1291
CrawlersTools/extractors/content_extractor.py sha256=pY3Wl5pTUcMZ99DJGTT5JPBSWfkloIRNuaZHyYm2iyg 4313
CrawlersTools/extractors/list_extractor.py sha256=II7Yv8urPLRak49mYtyfXRKknWLT5z0av2qOrIEsmIM 15555
CrawlersTools/extractors/time_extractor.py sha256=px7cOUE2w2aqu1DLQeYk04hKt2BrPSl0OpinDq8f0r0 1919
CrawlersTools/extractors/title_extractor.py sha256=f8XLVnw13PYGj9kon-psS-nAgrICn4aRiv2ZgXcTeiU 2755
CrawlersTools/extractors/schemas/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
CrawlersTools/extractors/schemas/element.py sha256=h8Xcj-UwxK7QVIsW0hEQZh3jSPAQgxyX4mKNSh-nj3Y 13067
CrawlersTools/extractors/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
CrawlersTools/extractors/utils/cluster.py sha256=a6re6OS-RHE9FR5IFvi19sKWGkfmo-7Cy5PullQeRkg 1643
CrawlersTools/extractors/utils/element.py sha256=8v5Qk_5XMyq4Fg9jF-d5TXFWKjWml5WBV-mH7vj0eHo 14866
CrawlersTools/extractors/utils/preprocess.py sha256=P0Nw1P8MieC6KXekCuXCgkhQ4AyBaLrthqETqOfmzZc 5803
CrawlersTools/extractors/utils/settings.py sha256=B8VBRIsM677vFLun425ZnfY7liDrhTzNA7CFZgwj3qs 7783
CrawlersTools/extractors/utils/similarity.py sha256=_Yk2EV3pF7pQwV-PEw6c30RieijNhuhGjcLF1eCzxIQ 1830
CrawlersTools/js_crawler/__init__.py sha256=Hk_006YtRSQ8IhuzldloEQkG4TZbuONCuzSwWP87Vfw 280
CrawlersTools/js_crawler/font_decrypt.py sha256=gwcrP_sGKISUXwCW0X6yoiA3bRYL-ap4hNinJ0W4GzE 31476
CrawlersTools/js_crawler/transfer_js.py sha256=5hq6UDJMrf1b6CQcZ2_ZoXLk92RLjnfsGG8VdDVMJKo 932
CrawlersTools/logs/__init__.py sha256=iFT0WA5upw5TRWfjs-tEqR7gA_QP1CPjKn3s4qP5EWo 255
CrawlersTools/logs/formatters.py sha256=X2pDfEpTGM3zhDz5nMtrajL9jcU180YJkHoTPKis1ZY 2042
CrawlersTools/logs/handlers.py sha256=wfVJH5v75dcpISZyS_LuAPrhwva0QBNgRWM-YOkWizg 1167
CrawlersTools/logs/log.py sha256=ZlGPJlMCGVqMjaSd_9Tcg6TnbV_nPlpW1DGq7JglG1o 1627
CrawlersTools/logs/logger.py sha256=W23QpAUgxA9X2EWJfSmG4ecYph83r2cUeCt7AO5jtsY 2135
CrawlersTools/pipelines/__init__.py sha256=I9MsF_IKLEud3txzXaMU0QQ2qJVeK7QxACI8IdmWrpA 324
CrawlersTools/pipelines/kafka_operate.py sha256=CYpPvd49agk430btJGHHkGPXqEebksfWS2QfXqvwhXM 1174
CrawlersTools/pipelines/mongo_pipeline.py sha256=tW1k5cLE-ET_OwPWKVs_0eFAJ0XfLsSMqJUeHG9ssj8 1977
CrawlersTools/pipelines/mysql_pipeline.py sha256=bgSdLblUA8T44uTsjX8wXsvgLoS5wxm-vXPITB_nZR8 4924
CrawlersTools/pipelines/redis_pipeline.py sha256=NcPGC8DFcYh_oAio4ymcM9fVpZ5CO5p_Q1yoqrmqcpU 660
CrawlersTools/preprocess/__init__.py sha256=oZkJjcQ4QnX0nxuDdpdV7Zj83r3aRevW_o3OBkhg1LU 254
CrawlersTools/preprocess/bloom_filter.py sha256=wKhMh8xPFX6X6s9w9ZQyka5KB4-bCdy34h6-AwgcfJM 2376
CrawlersTools/preprocess/time_process.py sha256=If3BH-G1uI6_4psmtzWLQNz3RnsyTLXp6SK5QpXToTw 2147
CrawlersTools/projects/__init__.py sha256=SbK2t4Sm-FF5msM8Y1FK0J8VEKkBaR7gggZz13W0zMI 126
CrawlersTools/projects/filters.py sha256=TU1UvvToVdTgx7BDzTsts-z0rCs7w_lSny0KYRWUeM8 1685
CrawlersTools/projects/upload_oss.py sha256=Zr5HeY9UAEilyDlBkBS0UN62Ewzf7SRPiGkkw4lbMDw 5435
CrawlersTools/requests/__init__.py sha256=PU5l2o-dKiX2mLjBfKd6ksE5DHnTkttPtlRAzNLVriY 430
CrawlersTools/requests/base_requests.py sha256=tGX-x2E06SVavyF46fa5HIDJBNSnnKssSgyY6oSfTss 6417
CrawlersTools/requests/proxy.py sha256=et7Ix3UB5zWXhZ0PQJS9tnHV8xNfgADM5OpQUFuawyI 697
CrawlersTools/requests/random_ua.py sha256=ImLc8PVnKO5JJ2-h3L9vy4gRKvpr319puL7f7uY5iK0 15884
CrawlersTools/schedules/__init__.py sha256=d1X6TkWHyHJ8eqaMPqOf-hgIbYL1wC6Bz9thM9fTyUw 186
CrawlersTools/schedules/auto_thread.py sha256=coADtTh7m1pgSKNUtLWqcqc6i5v87AxFfSC9hk8_3sk 3333
CrawlersTools-1.4.81.dist-info/LICENSE sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ 11357
CrawlersTools-1.4.81.dist-info/METADATA sha256=g58TOPsg2eVRQZuMh4aMMOrZAmHkWlRnHalRy5cFyzU 43181
CrawlersTools-1.4.81.dist-info/WHEEL sha256=oiQVh_5PnQM0E3gPdiz09WCNmwiHDMaGer_elqB3coM 92
CrawlersTools-1.4.81.dist-info/top_level.txt sha256=v4FOWiFEIesGMlIwI2F0ldSAWJ00yxjjrSfns2fuSgw 14
CrawlersTools-1.4.81.dist-info/RECORD

top_level.txt

CrawlersTools