robotsparser

View on PyPIReverse Dependencies (0)

0.0.12 robotsparser-0.0.12-py3-none-any.whl

Wheel Details

Project: robotsparser
Version: 0.0.12
Filename: robotsparser-0.0.12-py3-none-any.whl
Download: [link]
Size: 5743
MD5: 0ad2800a218fc426793ce88ad28369a1
SHA256: 00400bfa27e1d0f7d7e9bd6461ba145b7252405d9e6a595ff1930f9ca754b3c3
Uploaded: 2023-02-22 22:14:42 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: robotsparser
Version: 0.0.12
Summary: Parse robots.txt files and find indexed urls
Author: Diego Velez
Author-Email: diegovelezs94[at]gmail.com
Home-Page: https://github.com/Dvelezs94/robotsparser
Keywords: robots.txt,sitemap,crawler,data mining
Classifier: Development Status :: 1 - Planning
Classifier: Intended Audience :: Developers
Classifier: Programming Language :: Python :: 3
Classifier: Operating System :: Unix
Classifier: Operating System :: MacOS :: MacOS X
Classifier: Operating System :: Microsoft :: Windows
Requires-Dist: bs4
Requires-Dist: lxml
Requires-Dist: cloudscraper
Description-Content-Type: text/markdown
License-File: LICENSE
[Description omitted; length: 1451 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.38.4)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
robotsparser/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
robotsparser/parser.py sha256=Ty8aDSVJv4W8MT7rfC69Xy74rVLn0SJ4oxYd4jRMkyg 9402
robotsparser-0.0.12.dist-info/LICENSE sha256=_958YbUUE8ifXcf7C2EcePjZ9rn5kal_0QqOUPHZn7E 1066
robotsparser-0.0.12.dist-info/METADATA sha256=U5vNQgeQRROCO70kUMr_NnUtKzCqp4W9nIydCCVJ1ZM 2130
robotsparser-0.0.12.dist-info/WHEEL sha256=2wepM1nk4DS4eFpYrW1TTqPcoGNfHhhO_i5m4cOimbo 92
robotsparser-0.0.12.dist-info/top_level.txt sha256=zyQmsAyt8bhnIUCqmfJ5pf-UZ0I6nIglXNTjkqMTSF0 13
robotsparser-0.0.12.dist-info/RECORD

top_level.txt

robotsparser