icrawler

View on PyPIReverse Dependencies (4)

0.6.9 icrawler-0.6.9-py3-none-any.whl

Wheel Details

Project: icrawler
Version: 0.6.9
Filename: icrawler-0.6.9-py3-none-any.whl
Download: [link]
Size: 34400
MD5: adead5300c20a545ef7d9d6f735359b7
SHA256: cc8e8248d037f06b87baaf7c9ef6cb97be976dda7dc226b49dfe98c62a939f6d
Uploaded: 2024-05-31 08:57:13 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: icrawler
Version: 0.6.9
Summary: A multi-thread crawler framework with many builtin image crawlers provided.
Author-Email: Kai Chen <chenkaidev[at]gmail.com>, Zhiyuan Chen <this[at]zyc.ai>
Maintainer-Email: Kai Chen <chenkaidev[at]gmail.com>, Zhiyuan Chen <this[at]zyc.ai>
Project-Url: documentation, https://icrawler.readthedocs.io/
Project-Url: homepage, https://icrawler.readthedocs.io/
Project-Url: repository, https://github.com/hellock/icrawler
License: The MIT License (MIT) Copyright (c) 2016 Kai Chen Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Keywords: Crawler
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Internet :: WWW/HTTP
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Topic :: Utilities
Requires-Python: >=3.7
Requires-Dist: beautifulsoup4
Requires-Dist: bs4
Requires-Dist: lxml
Requires-Dist: pillow
Requires-Dist: pyyaml
Requires-Dist: requests
Requires-Dist: six
Description-Content-Type: text/markdown
License-File: LICENSE
[No description]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.43.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
icrawler/__init__.py sha256=y3s0KqPXYQVBw0qW146oU-906aFWnd6Yo9CZ_SGDu7g 384
icrawler/crawler.py sha256=4kUDT8a3A49a26qTGOIwsKziag4pOyCyzL0f47-aUXs 7168
icrawler/downloader.py sha256=j8DA8UjW6rFcgUhvcwsiVSyz3qQzhLrNd4kHw_1ptC8 9766
icrawler/feeder.py sha256=JIrQnkTlT-4NKTSBDie69cSZfXUDhSeA72vxSgfBAn0 3216
icrawler/parser.py sha256=TaUOudF6PSdJhXAsMfaMdeX5RfCrBZ7S5KcMuieGOvI 5022
icrawler/version.py sha256=gkGeZfEBYwyQQM-ecPpcryRAHIElqDdO3fv9Mo9Y5Bo 411
icrawler/builtin/__init__.py sha256=NsiLaQ7GfFi91ivqip-pmnToIL2OYAgFr4YIrFQbDco 471
icrawler/builtin/baidu.py sha256=AzuuICF4QCRZDEtJ8cj8vamnRsg3enwsFzQWynOJMYg 5787
icrawler/builtin/bing.py sha256=2l5Gc-HUtUIBZ49P7pVrRUW8W0zMr7cBsEXlzh1VzJ4 5817
icrawler/builtin/filter.py sha256=iBzVHlw4ElMSNAbnfgvJsbOphQHRPNDwqrKVU5xoJlY 1207
icrawler/builtin/flickr.py sha256=phPI88h7HOqH9wDrpjBawqzW3zQoszZ9hwRumLa1ySA 5730
icrawler/builtin/google.py sha256=dnhimEKc2EhtmdzVnmZpGMdls_X1IN_1hIyTXa14hiQ 7687
icrawler/builtin/greedy.py sha256=i_G3mhtxQenZXkgexXStcAoci41ieC-er9yuBiOnIXw 3630
icrawler/builtin/urllist.py sha256=eqjcrGXaDz5858pwUi_vZgw6DQK4m0lPU-PDVikjlmI 1726
icrawler/storage/__init__.py sha256=b-hDGHeNV_togOTPjf52FrBUMKeBXb9vRlolqFrUZXU 165
icrawler/storage/base.py sha256=j82fWl3dlbtdLUtyYSbmXH0fEF79PHUjyQzcGuNY1KA 810
icrawler/storage/filesystem.py sha256=71BvnygiLNtz8UobK71ax7CeiNHmNIJj7g3QSfKpdio 1071
icrawler/storage/google_storage.py sha256=fmgiTRWfZnrRqTVnH98Qq23gLa_t-ldS7smrtD8ztR4 1321
icrawler/utils/__init__.py sha256=gjJTwqtFr8p-idiM7fsZX2161tLvYErn6cyxkfAiW2E 285
icrawler/utils/cached_queue.py sha256=87JoFMgO2PT12roTiGYrF4xtJK1G5MdIpcSIswy8JuA 2149
icrawler/utils/proxy_pool.py sha256=hM5Qvxxv6DAJmbuDnP2WZGYRrUdksUQh6uIjTCXMwM0 19650
icrawler/utils/session.py sha256=QmPtq_M_ZjS5kjWnDzgMJWZfxzNh0Gs64svBCCGl1Xo 1333
icrawler/utils/signal.py sha256=-nf7k_expwvVD85wJMdMsbFDTy1DAQUOYGu-sX1c9hA 1332
icrawler/utils/thread_pool.py sha256=bxPcdTisogWoSWS2IYCKtJrDcl31znCXnVOdv_OCAMg 3512
icrawler-0.6.9.dist-info/LICENSE sha256=guOpFWYAri9Zen7XtxZJXtWt9pLkktcPSG8P9cJ-0hE 1075
icrawler-0.6.9.dist-info/METADATA sha256=1iK_TSsac6AX7jR4ML3iiBVriahB_YBZ97B0ZJcy9vA 2763
icrawler-0.6.9.dist-info/WHEEL sha256=GJ7t_kWBFywbagK5eo9IoUwLW6oyOeTKmQ-9iHFVNxQ 92
icrawler-0.6.9.dist-info/top_level.txt sha256=RjGzR5ZVXxgOmcCbNxkuxWy85mIcVbQUwpU627Mk-LE 9
icrawler-0.6.9.dist-info/RECORD

top_level.txt

icrawler