Wheelodex » Projects » new-frontera

new-frontera

View on PyPI — Reverse Dependencies (0)

0.9.0 new_frontera-0.9.0-py3-none-any.whl

Wheel Details

Project: new-frontera
Version: 0.9.0
Filename: new_frontera-0.9.0-py3-none-any.whl
Download: [link]
Size: 125159
MD5: cd0b20a217561ba6b0bc48b6a14a929a
SHA256: 6a6c1dd1196cf0fab235ecbc058a91a2c344231c2500f5c98d37713df01cc4a2
Uploaded: 2024-01-28 04:00:52 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt

METADATA

Metadata-Version: 2.1
Name: new-frontera
Version: 0.9.0
Summary: A scalable frontier for web crawlers
Author: new_frontera developers
Maintainer: Alejandro Gil
Home-Page: https://github.com/ZeroCool940711/new-frontera
License: BSD
Keywords: crawler,frontier,scrapy,web,requests,new_frontera
Classifier: Development Status :: 4 - Beta
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: BSD License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.4
Classifier: Programming Language :: Python :: 3.5
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Topic :: Internet :: WWW/HTTP
Classifier: Topic :: Software Development :: Libraries :: Application Frameworks
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Requires-Dist: six (>=1.8.0)
Requires-Dist: w3lib (>=1.15.0)
Requires-Dist: cityhash (>=0.1.7)
Requires-Dist: Twisted; extra == "distributed"
Requires-Dist: pyparsing (==1.5.7); extra == "graphs"
Requires-Dist: pydot (==1.0.28); extra == "graphs"
Requires-Dist: SQLAlchemy; extra == "graphs"
Requires-Dist: happybase (>=1.0.0); extra == "hbase"
Requires-Dist: thriftpy2; extra == "hbase"
Requires-Dist: kafka-python (>=1.4.0); extra == "kafka"
Requires-Dist: colorlog (>=2.4.0); extra == "logging"
Requires-Dist: python-json-logger (>=0.1.5); extra == "logging"
Requires-Dist: redis (>=2.10.5); extra == "redis"
Requires-Dist: hiredis (>=0.2); extra == "redis"
Requires-Dist: boto3; extra == "s3"
Requires-Dist: SQLAlchemy (>=1.0.0); extra == "sql"
Requires-Dist: cachetools; extra == "sql"
Requires-Dist: beautifulsoup4; extra == "strategies"
Requires-Dist: publicsuffix; extra == "strategies"
Requires-Dist: tldextract (>=1.5.1); extra == "tldextract"
Requires-Dist: pyzmq; extra == "zeromq"
Requires-Dist: msgpack-python (>=0.4); extra == "zeromq"
Provides-Extra: distributed
Provides-Extra: graphs
Provides-Extra: hbase
Provides-Extra: kafka
Provides-Extra: logging
Provides-Extra: redis
Provides-Extra: s3
Provides-Extra: sql
Provides-Extra: strategies
Provides-Extra: tldextract
Provides-Extra: zeromq
Description-Content-Type: text/markdown
License-File: LICENSE
License-File: AUTHORS
[Description omitted; length: 2591 characters]

WHEEL

Wheel-Version: 1.0
Generator: bdist_wheel (0.42.0)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
new_frontera/__init__.py sha256=5it4oRcAsKHMZ0zCAxS5vNni2gixtqJ9X8K9g_MVOkw 390
new_frontera/_version.py sha256=l_NScZONjqliVL8FhphVJngDf5c8KVbi4-O0LwvFf6w 497
new_frontera/exceptions.py sha256=Z5qRy3Tew9yG83Z67t-gjbkQcVUpd4Wu2IkY2zpNAbM 95
new_frontera/contrib/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
new_frontera/contrib/backends/__init__.py sha256=iwhKnzeBJLKxpRVjvzwiRE63_zNpIBfaKLITauVph-0 24
new_frontera/contrib/backends/partitioners.py sha256=--tga_G3okQNts7eaDEcYhcHi2iA2RR-uoigEzoQs8Q 1111
new_frontera/contrib/backends/hbase/__init__.py sha256=45sF8knpAMcl85LzYDByIFJtMJxpssJoRGNO-5lhZuQ 25097
new_frontera/contrib/backends/hbase/domaincache.py sha256=kUY5e8F6bS2MEVuYjmdOyVsmorbLFshoY9gK9jgL0dM 10662
new_frontera/contrib/backends/hbase/utils.py sha256=EoumxIENcYYY26_3BJisZS-KFErwdv9_R2yQc42Py-I 814
new_frontera/contrib/backends/memory/__init__.py sha256=6UTHWmXNVXcf8GE1kMRed7a1tyyXgeM7S3mHPbrDSew 5450
new_frontera/contrib/backends/redis_backend/__init__.py sha256=yDN8giNNbo3cRh_5uKcUfY0Q5JAPoW8S7Hs_GBZJV0s 17869
new_frontera/contrib/backends/remote/__init__.py sha256=5FQ0s_2rPa2Vpj_dOhp6usXXAHPT9X-MBVVZLP2Uoqo 23
new_frontera/contrib/backends/remote/messagebus.py sha256=IB8DgrXE6STTSF4b5ix8ZA7t7vqf2f5beJWG6208R6c 4592
new_frontera/contrib/backends/remote/codecs/__init__.py sha256=5FQ0s_2rPa2Vpj_dOhp6usXXAHPT9X-MBVVZLP2Uoqo 23
new_frontera/contrib/backends/remote/codecs/json.py sha256=Cent4RoI5EI5i6n0S9IdV-J9ZnD2_x1UpMfp4YC9LFQ 7776
new_frontera/contrib/backends/remote/codecs/msgpack.py sha256=Sg_f8rRlKkusaa7u35SiAlBI_rkatb5Uq8qJCdOfqhc 4006
new_frontera/contrib/backends/sqlalchemy/__init__.py sha256=mWYRBS781er6TdW5jmqqoM5xi_p0itQ3HMiUbSrdIms 4958
new_frontera/contrib/backends/sqlalchemy/components.py sha256=STKz4RwRDs7fOo0p02wkCrmSlXwTnmZasvHHYV2ADMA 13516
new_frontera/contrib/backends/sqlalchemy/models.py sha256=ezcA1lnJq-yA5BTSMsuc87mB0gry34PwVryzQLqOAj8 3114
new_frontera/contrib/canonicalsolvers/__init__.py sha256=naWy5osJEM_P-_va5JO44H8GWOu5_a0ZXgPM13y89i4 163
new_frontera/contrib/canonicalsolvers/basic.py sha256=M6MqZ5PbeWkfdx029CpjPyDEPum26gfI6KLpQv-xta0 1882
new_frontera/contrib/canonicalsolvers/common.py sha256=SJbmiKvujoiOmo8MapYPf5mX7VPGYhwlxYCSc1bFkXs 990
new_frontera/contrib/messagebus/__init__.py sha256=5FQ0s_2rPa2Vpj_dOhp6usXXAHPT9X-MBVVZLP2Uoqo 23
new_frontera/contrib/messagebus/kafkabus.py sha256=oMqVx2IY27Mqq2_z8OCJumkmopgcIob5dff5y8Ywa-I 11606
new_frontera/contrib/messagebus/kafka/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
new_frontera/contrib/messagebus/kafka/offsets_fetcher.py sha256=-OgXH_NGbk9CV9cS4YqJSvGviQxpRFZBDlvUPt2qaT0 17395
new_frontera/contrib/messagebus/zeromq/__init__.py sha256=WgbkQEtAoEKETOy0BhotyFqmS06EDCctx3wOm0QX_Zg 10035
new_frontera/contrib/messagebus/zeromq/broker.py sha256=hFNi3PVnTVnv3lg8WikjMP4zu9vzg59VL5ygxkMylsI 6085
new_frontera/contrib/messagebus/zeromq/socket_config.py sha256=sNKiAamidWW12KZCuu4TpK68VGoMn3cJbsbjVVOoxeA 1959
new_frontera/contrib/middlewares/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
new_frontera/contrib/middlewares/domain.py sha256=zz-ohnxuDNoxepducKtlKLjgh8lomMAwGcNQJgXZgOA 3688
new_frontera/contrib/middlewares/fingerprint.py sha256=wBjFRS6c96G4IlBPX-Y7iyhJP7H74gj7HuxQdWuwuSo 4498
new_frontera/contrib/requests/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
new_frontera/contrib/requests/converters.py sha256=wx8Fde-1xQ_Zf6KzdIo_tkDZ7G6oULtKRyr25deErMs 1718
new_frontera/contrib/requests/manager.py sha256=ikzBPPoHaWoAdgC3XKlnCsE_EN8C-hsXR3PPlBf25ug 445
new_frontera/contrib/scrapy/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
new_frontera/contrib/scrapy/converters.py sha256=hL0H14Qv2Du13ACDdbcNoFO-CC1oLmMoIbQ8uI5gWIc 5196
new_frontera/contrib/scrapy/manager.py sha256=e-uGHJYAIEil9Wc0n5QflIdEFF2rchLORW5C2Orj1Ns 578
new_frontera/contrib/scrapy/messagebus_stats.py sha256=Ezg5sbV_8BHRLfBXoFqd7jVONb6kmYAn9uzA7N9N5gY 3294
new_frontera/contrib/scrapy/overusedbuffer.py sha256=ZPw5V3CmAoPNGQZb4mdxcDnbu15RYTiDiPAMbnVKvKw 524
new_frontera/contrib/scrapy/settings_adapter.py sha256=AWROGZcJ3gjQ1FIJp6ifr61LnL-FvST719dcvipIZJc 877
new_frontera/contrib/scrapy/middlewares/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
new_frontera/contrib/scrapy/middlewares/schedulers.py sha256=hFjWsu2HeVGy6N0l4hnTRP7wYSdlK8grZsSefeWpVh4 680
new_frontera/contrib/scrapy/schedulers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
new_frontera/contrib/scrapy/schedulers/frontier.py sha256=Nm6whMGEXnIViRwsvvtnBySekQGBOElWvRra-7xWYgw 6944
new_frontera/contrib/scrapy/schedulers/recording.py sha256=40Kh_H5GzrnaTq-rEIYDPLU25IRgxeu9c3m_tvQZOro 5446
new_frontera/core/__init__.py sha256=j4yzggVGvdLyISE2ImVi0nzQYLrVRipBE-ppbmq83CA 4232
new_frontera/core/codec.py sha256=tFfNQn83-8jRbaedCahLFU2BPAnAecPrCWQSgZs87aA 2831
new_frontera/core/components.py sha256=UzDU-ezd6czNY612CoV5Ip7bXe9RfEIvgNYciWFAcws 10715
new_frontera/core/manager.py sha256=jOEXAR4HW1nuB9wit3faSVHRx7tKB-EP3GkUhaZWosM 35709
new_frontera/core/messagebus.py sha256=_wRKzP9_EYa_bTwg24PbGPv3NwDOKPLp6Q2LO8jwMPc 6793
new_frontera/core/models.py sha256=aE14XaAES9kWBpyw2WQUecLz4EvlPlhGF3M_0ORFUCE 5698
new_frontera/logger/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
new_frontera/logger/filters/__init__.py sha256=M0z63xeRH6aimJVmoombH4fLEwMDFm639VRBE-Hcc2U 2350
new_frontera/logger/formatters/__init__.py sha256=MhIwz1q9uvTbf9lFQ0H5AUXrVwon8rnvl0kwq3UrJYk 551
new_frontera/logger/formatters/color.py sha256=eSwoT9ID9LrdvMjzz0MjltXwzV0H5hQRkBGVp-VpVsY 1800
new_frontera/logger/formatters/json.py sha256=lGjyVo1-BhOkyoMs3R8QEbjLkAbpBwl55fzQAcMXxV4 322
new_frontera/logger/handlers/__init__.py sha256=gXNYjAW6vZWlZyAuLkcF1XW7oG8fV-tgfv38hVHmJpw 202
new_frontera/settings/__init__.py sha256=OupaQSGc6vIgQDQ09rb7f2KQEoOqhpsxR6W-JawSG8w 2582
new_frontera/settings/default_settings.py sha256=Tx9pkK5FcbeCk-oZzl5hOCwqF-KU7ysqPd-3WRt4a9Q 3585
new_frontera/strategy/__init__.py sha256=MS_I7KpGPv84m6DIoRHQZ4z2Gw8KdCgJYj04jltSCpo 6334
new_frontera/strategy/basic.py sha256=L4D2Yzr9Co1Yfyk7IeCBAwTfkJZ8svYoDqaxuHF2aSE 794
new_frontera/strategy/depth.py sha256=pWlsNhXjWMO8AqjLsDK9y9KdTaTtYDLsmV_BQ-wUybk 1487
new_frontera/strategy/discovery/__init__.py sha256=FrxQtEjppV-Kt29ATn1twFKd9kv-k6xLWfrdPDxRW9w 23484
new_frontera/strategy/discovery/sitemap.py sha256=6xS4fuHw8VkvjJt5_8ZRznE6e4OjlFesQMvLB8Mtirc 643
new_frontera/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
new_frontera/utils/add_seeds.py sha256=0-hiYvzGMPVfA_s-HUYHRvX5oasGYEnxD1ZQj99ZqWE 1630
new_frontera/utils/converters.py sha256=d_Fb5f3cyeDFolI9cPFz4n3yUVHtCgo9jGSlBWCT4Ck 648
new_frontera/utils/encoders.py sha256=KOWEpBlBKBdcJ2gyIGNnlk7qS5oo4RSxFbcyMgGYbps 494
new_frontera/utils/fingerprint.py sha256=kR3H4ZTu68DXV4jiEa4kIcB44nCT_EaZwr4P5owtXfo 1380
new_frontera/utils/heap.py sha256=AbHDqpCQcMhvCh9VYXytKkcGNTaQOCYP3R0cN02G4I8 2071
new_frontera/utils/managers.py sha256=dY86SHE4WP1aYhzEWG0wOMzaD-iigqQ1iTNJexy9XKw 2347
new_frontera/utils/misc.py sha256=Ybr0cdou3472_KNVeX3OXqHYW3OSpVPeefr_hh3DUDc 2703
new_frontera/utils/msgpack.py sha256=UN24kjAXBrpEaFglga_5A7djPvp57zs1yxn2Y1MyrLw 712
new_frontera/utils/ossignal.py sha256=_nYCE88cuES0i4PlHvj5pBEqj8jDAurFT5BWeZ0rIoM 685
new_frontera/utils/s3.py sha256=Mwxc-Qf65trDr4UY6RQWZSuElNE7lzlaOcRnurPaT8E 837
new_frontera/utils/tester.py sha256=itx-sYD1jxRDgdSzyJHmeLVHl6D7MLhaVZWQuSWBKQI 5156
new_frontera/utils/twisted_helpers.py sha256=QzK2niO1qeTSL6ypFdg2QGNwEVNp-rPc3dkS99WWOwk 2082
new_frontera/utils/url.py sha256=YncjaBtsDGm4lkcLtwbH4eX2gugmChjMInm2voXwe7Y 1781
new_frontera/utils/graphs/__init__.py sha256=7VJKu_JWFaN7M9rLeEf6p7BCvqkKji0reYZkLD1m8O0 195
new_frontera/utils/graphs/data.py sha256=mcGHnWzkOkxsaD2QM-R1tPdACh834hL9EpcfL8puJLY 5580
new_frontera/utils/graphs/generate_diagrams.py sha256=u1uLS5MY2sR6Xf7rv7di7HlgPxqrPRo0f87L-T8o37s 1004
new_frontera/utils/graphs/manager.py sha256=YgmKpeK-8wkpKpgce5g4v4qeDCaVbSbei6eh7vJALOM 5236
new_frontera/utils/graphs/models.py sha256=EfCGaKfz188waypyLrLcFR7-fKKbo-NsTAAnXNZt49M 3263
new_frontera/worker/__init__.py sha256=5FQ0s_2rPa2Vpj_dOhp6usXXAHPT9X-MBVVZLP2Uoqo 23
new_frontera/worker/db.py sha256=tLtqYHrsj6605_9WH9Odm6Ryrax5VR4NPdctc04D53Q 9648
new_frontera/worker/server.py sha256=8R_zGJso3Jjcd4bvUQWmwVwOD46HY9FGkZntCVK8Dfo 5293
new_frontera/worker/stats.py sha256=xomNUA4mCdn_v7xdERB_9VqjWGTn9N0_b6mtp-qO7Dg 4218
new_frontera/worker/strategy.py sha256=abMWbmuGPPqNarn-lHi83A5fswlkEG4Z7GPwCDuuzlg 16326
new_frontera/worker/components/__init__.py sha256=2szH-m9DsGg0kG9f5SiysPgs4Q4J8-H2R8qT4qGUrxA 3362
new_frontera/worker/components/batch_generator.py sha256=aFjs5SlfMDqRXmTABAFnh0XVFjspz8SejMDWVhAfPV0 5711
new_frontera/worker/components/incoming_consumer.py sha256=8bdYFSJsN_XdSP1zY4yhl8orqIQyN_7NGeKV2OuNC_w 5060
new_frontera/worker/components/scoring_consumer.py sha256=qxH9CXdEGFgnyktnD_2RooEMyUpRm0T1VUhv8VptcDo 2384
new_frontera-0.9.0.dist-info/AUTHORS sha256=66GOMGOeX_pQ43lvOIqhAxdOHQMD_XvKBAQ1oyupPQg 127
new_frontera-0.9.0.dist-info/LICENSE sha256=p2K3bqSRw40qLaYfMT47cxslFEo78s6gKr_exBKubd0 1526
new_frontera-0.9.0.dist-info/METADATA sha256=dCK0frWTZfv_FGjY4cS5uyn9WuMOCohC-xfNbXxUcu8 5273
new_frontera-0.9.0.dist-info/WHEEL sha256=oiQVh_5PnQM0E3gPdiz09WCNmwiHDMaGer_elqB3coM 92
new_frontera-0.9.0.dist-info/top_level.txt sha256=aNvfxvU4ANF2W5LXKEy69Pmj0PHS2uUre55l0NPxFS4 13
new_frontera-0.9.0.dist-info/RECORD — —

top_level.txt

new_frontera