cocrawler

View on PyPIReverse Dependencies (0)

0.1.14 cocrawler-0.1.14-py3-none-any.whl

Wheel Details

Project: cocrawler
Version: 0.1.14
Filename: cocrawler-0.1.14-py3-none-any.whl
Download: [link]
Size: 85418
MD5: 23da1533b0bbd5f280bfebe5e62c47ee
SHA256: 7c0122368295ebb5171833c58a4c32c858c656c4b72a82add1ed805ef927ac6f
Uploaded: 2021-02-27 01:33:53 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: cocrawler
Version: 0.1.14
Summary: A modern web crawler framework for Python
Author: Greg Lindahl and others
Author-Email: lindahl[at]pbm.com
Home-Page: https://github.com/cocrawler/cocrawler
License: Apache 2.0
Classifier: Development Status :: 2 - Pre-Alpha
Classifier: Environment :: Console
Classifier: Operating System :: POSIX :: Linux
Classifier: Environment :: MacOS X
Classifier: Framework :: AsyncIO
Classifier: Intended Audience :: Information Technology
Classifier: Intended Audience :: Developers
Classifier: Natural Language :: English
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3 :: Only
Requires-Python: >=3.6.3
Requires-Dist: uvloop
Requires-Dist: aiohttp
Requires-Dist: yarl
Requires-Dist: aiodns
Requires-Dist: pyyaml
Requires-Dist: cchardet
Requires-Dist: surt
Requires-Dist: reppy
Requires-Dist: cachetools
Requires-Dist: tldextract (>=3)
Requires-Dist: sortedcontainers
Requires-Dist: sortedcollections
Requires-Dist: psutil
Requires-Dist: hdrhistogram
Requires-Dist: beautifulsoup4
Requires-Dist: lxml
Requires-Dist: extensions
Requires-Dist: warcio
Requires-Dist: geoip2
Requires-Dist: objgraph
Requires-Dist: brotlipy
Requires-Dist: setuptools-scm
Requires-Dist: bottle; extra == "test"
Requires-Dist: pytest (>=3.0.0); extra == "test"
Requires-Dist: pytest-cov; extra == "test"
Requires-Dist: pytest-asyncio; extra == "test"
Provides-Extra: test
Description-Content-Type: text/markdown
[Description omitted; length: 3014 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.36.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
cocrawler/__init__.py sha256=89paP-zRovajGUUp0tbmIf_46VbsbrsNNGbwKZC6HQg 22878
cocrawler/accumulator.py sha256=7ylCTmAa1LMny7p92eFvjLYh4yidONOpCMYpczkFOZ8 2355
cocrawler/burner.py sha256=RC_8TzpSJ3gSyqskjid5B06jZaf7p26XEhKCqniq_WQ 3834
cocrawler/config.py sha256=IFHajzKMfHCEp35PofOp8cauXFd_jP5iOQNoTKpI45c 6051
cocrawler/content.py sha256=bcjjXrPQzR-hB7BxrBMZOgI-Ogg7wdDBgJ9CCRSYntI 4908
cocrawler/datalayer.py sha256=M7tPl4gyVu60sydOkFy0kcYdRn8-JVpJSGPj68w9Wf8 1844
cocrawler/dns.py sha256=bCQFVjiDYQYzeOx4XATiSRf5Td2tvOSfy80GI3C2_UY 6613
cocrawler/facet.py sha256=BvYrZHEiucHUifZoMcql-QyQZr-JHDFPrLATy3O_c28 10570
cocrawler/fetcher.py sha256=3R_DysYYZS6V6saWOixHC7ia904MjvqCpemQ7qujPIk 10249
cocrawler/geoip.py sha256=fREo8YbD4ARG7N3EQFgjEvqvsEZDESOk5HJn9YEgmi8 4498
cocrawler/hostdomain.py sha256=sBYJ6Z_9rx4LSZ8urFW02YpY2inIs-wTIXXvhiWj7cQ 547
cocrawler/memory.py sha256=MRN8Rzex3F_oc6JStWilbgrj-NlDX3wEbkRuOf71Ojk 5010
cocrawler/parse.py sha256=R6H1lMg5u24_95bfbwu3XqmFxos1W_y4kgexUwdPTII 14541
cocrawler/pdeathsig.py sha256=GW0pErukkLMyBsq0-ReXaaBlel-IMYL0zCFc0ewdbRc 307
cocrawler/post_fetch.py sha256=hoOQ2yGpjVMWhsO12khorAPS3EkhntVKIk7h9W677no 10636
cocrawler/pre_fetch.py sha256=upqbybqa3aq4Q8pDwMPqEguQvvY2Ik9NjpPyTJsuKOw 354
cocrawler/robots.py sha256=HGpSCowJtyxnj_0kZYpno5pfEZ8RwLSFi30iIbW-2bI 13283
cocrawler/scheduler.py sha256=aOrep54wfQ1Yqqm0_KkDTRDLryO4sRnAdZLsTds3htA 11644
cocrawler/seeds.py sha256=tuDwgjDaw9r2_iwwtebX06QQ98hxpmltza3AmGQ2fgk 5841
cocrawler/stats.py sha256=_wC42Y7a-6VKBmT_wdgDWLtq2gHUfs31CRo2RkeT-Kg 11347
cocrawler/surt.py sha256=xZjnKItJET3UvhezUGcYf8GWt63NkS5XfD3WgSEQTz4 7976
cocrawler/timebin.py sha256=_vgyYJKt3YMFKO-WyNJBETUrcnnfgfv2p-YFA_HbWJg 1837
cocrawler/timer.py sha256=N-E2pPLuhc1Y4nvEhQ-TTKYM03wfHkgjckxFV90FtCg 6418
cocrawler/topk.py sha256=N_4RNXORwE6533TURNczZyOxw7L-r8lfWIzdAXlA3z0 2955
cocrawler/url_allowed.py sha256=-itsLe34olesB4ew92YEVogwX_k0Mo-n4U-1Fw0jZbk 4556
cocrawler/urls.py sha256=mF1F9XVzbgzaT4tF4G6cMcp7eaQM9o1PLUVNdY-ZkvI 15421
cocrawler/useragent.py sha256=3U1YBF5PpnIFI_GBb85SCKgJTVo3EM_lTP_XItmZff4 2310
cocrawler/warc.py sha256=qtSzBdMcPmdFB-yuquqXc_n9iPH7QnMxj0jDmgEWbgk 10474
cocrawler/webserver.py sha256=ti0D_iDz_82X4qSedIgfZ1MXH6XfqwP4ITJgPzqVF0I 1878
cocrawler-0.1.14.data/scripts/aiohttp-fetch.py sha256=46UnOvClIXlC9-8ViE5eFcc8MYgAiJfyAcHaAagohbY 2534
cocrawler-0.1.14.data/scripts/bench_burner.py sha256=uLExFgNO8isXELnIDzDoMD4cAgWIU7G307MWn4aSyn8 2619
cocrawler-0.1.14.data/scripts/bench_dns.py sha256=0kkZeTisqZMxRF3bIazVIvxUEb1-E4WREnPzwlwTxFY 3823
cocrawler-0.1.14.data/scripts/cocrawler-savefile-dump.py sha256=f8fKK6vcXU_wezJldc91n452tv2PKohrtD6l47JRYN0 294
cocrawler-0.1.14.data/scripts/crawl.py sha256=7yLbNzR5FQA4R_YbkvF-392DkPSFwRDl5jhQxq9mTGg 3747
cocrawler-0.1.14.data/scripts/parse-html.py sha256=9aTl4xa-_8YebMC2_O9n6kpZ5QaoObf9J9-pHcoY1aE 422
cocrawler-0.1.14.data/scripts/run_burner.py sha256=A8D8kOGm4zjFmziujcChl6LpRdoJziW8m-FbfakuunM 2478
cocrawler-0.1.14.data/scripts/run_burner_bench.py sha256=tFjrI3gNXQeiJ9CFmQNjbwp-4HKHgl5pJ4W3910uMoU 1833
cocrawler-0.1.14.data/scripts/run_parsers.py sha256=9hG4Jz5_wjn1Ww1Tbxlw3RzH1EVNlerkS1_D07evszY 3418
cocrawler-0.1.14.dist-info/LICENSE sha256=OsdzOX4jEkcE_IrRGTV76n95bTPGEZKNkUFPBvaR-jk 11355
cocrawler-0.1.14.dist-info/METADATA sha256=rbQI50k8xGmjEL8Q9vUahdWM8bzAbMM5qcCxEbb45ew 4733
cocrawler-0.1.14.dist-info/WHEEL sha256=OqRkF0eY5GHssMorFjlbTIq072vpHpF60fIQA6lS9xA 92
cocrawler-0.1.14.dist-info/top_level.txt sha256=8iH1q5vOjF0pEIRtPxHbP1bZzH0RrOANH9FB9poQv6E 10
cocrawler-0.1.14.dist-info/RECORD

top_level.txt

cocrawler