qai-scraper

View on PyPIReverse Dependencies (0)

0.6.1 qai_scraper-0.6.1-py3-none-any.whl

Wheel Details

Project: qai-scraper
Version: 0.6.1
Filename: qai_scraper-0.6.1-py3-none-any.whl
Download: [link]
Size: 28816
MD5: 31abaaabfa34fa87e2ae4c6566b2421a
SHA256: 2d0036f7b4c604cd56a300de8d9d316e29a401c98ef7e398235f8f437ad2b49f
Uploaded: 2024-08-06 05:49:18 +0000

dist-info

METADATA

Metadata-Version: 2.1
Name: qai-scraper
Version: 0.6.1
Summary: QAI Web Scraper
Author: parnell
Author-Email: 152523161+leeparnell[at]users.noreply.github.com
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.11
Requires-Python: >=3.11,<3.12
Requires-Dist: beautifulsoup4 (<5.0.0,>=4.12.2)
Requires-Dist: bs4 (<0.0.3,>=0.0.2)
Requires-Dist: chromadb (<0.6.0,>=0.5.5)
Requires-Dist: flask (<4.0.0,>=3.0.0)
Requires-Dist: ftfy (<7.0.0,>=6.1.1)
Requires-Dist: html2text (<2021.0.0,>=2020.1.16)
Requires-Dist: langchain (<0.2.0,>=0.1.0)
Requires-Dist: lxml (<6.0.0,>=5.2.1)
Requires-Dist: lxml-html-clean (<0.2.0,>=0.1.1)
Requires-Dist: markdownify (<0.12.0,>=0.11.6)
Requires-Dist: pandas (<3.0.0,>=2.1.0)
Requires-Dist: pi-conf (<0.9.0.0,>=0.8.5.1)
Requires-Dist: pi-log (<0.6.0.0,>=0.5.8.1)
Requires-Dist: qai-core (<0.7.0,>=0.6.0)
Requires-Dist: selenium (<5.0.0,>=4.21.0)
Requires-Dist: spacy (<4.0.0,>=3.7.2)
Requires-Dist: undetected-chromedriver (<4.0.0,>=3.5.5)
Requires-Dist: validators (<0.22.0,>=0.21.2)
Description-Content-Type: text/markdown
[Description omitted; length: 14 characters]

WHEEL

Wheel-Version: 1.0
Generator: poetry-core 1.8.1
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
qai/scraper/__init__.py sha256=jbWTihxgIOFYoIhXw7qVRz7S7jwCfMKOEkCaNYIRhuM 527
qai/scraper/combined/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
qai/scraper/combined/scrape_filter.py sha256=gBr9jxoHxM4xlXFvxYqpHmiKf4A4q6ein9xYn-6xyMY 1520
qai/scraper/definitions.py sha256=MalmRD5jQpIVoYNpFyrFsZFbp3TRe0NuLeS1koVFeQw 120
qai/scraper/filters/basic_filter.py sha256=rFjWlU1Oyu5V3rmNE2V4YT8-J1NeoAeHDIQf2fOltrc 645
qai/scraper/filters/filter.py sha256=TJIx8Ey9-tkn3m7oX_9az3UDc7VQ2y_5fKE8cBdDWzE 11605
qai/scraper/filters/meta.py sha256=VSy2MgFhl0gCL206HvZi7skDv48Yj_KZrsudhOkmIYk 483
qai/scraper/processors/div_table.py sha256=yJrJq5rHsRPs5v0X8upPHPSxHLC6IB7dTBcciy35Dog 1914
qai/scraper/processors/html_simplifier.py sha256=tOXDyfQvwcunAp-1NbLcT_HuW2k7L5gS1RaV39FZiLs 4007
qai/scraper/processors/html_writer.py sha256=K2_QbMCgKczqfdkKCYwYinnelDXSJSmuBLgQAKHTf6M 1116
qai/scraper/processors/markdown_writer.py sha256=oUADwpQMX6iw6ZFmJZiZKOj3wCgOo6g0hGCMh8UMjWI 1927
qai/scraper/processors/one_deep_merger.py sha256=hZk-WP0yMIdU1qsF-8Fm9vrK3spu56preDmyUWoFMnc 1747
qai/scraper/processors/processor_factory.py sha256=Npx--18-IoHfcYM6Re-d2MTO89OVjFoIJiPwHhY-dVc 2425
qai/scraper/processors/processors.py sha256=dueg3ZtCgsXZlHE35V1mqClshxZSWSO8t4H9lkZta1c 1316
qai/scraper/processors/tag_denester.py sha256=RQQAeOFy_8gjm3hhG04_rxbtrlw9toB-qk0-tYlwJWg 1242
qai/scraper/processors/tag_keeper.py sha256=3xKItKVFFSTHaIbIYqvNg3FQ_We8qUhXn8TUaA9AQlY 3642
qai/scraper/processors/tag_remover.py sha256=IqvfjmMUhtGS_kT9R3ZbJUykCQvF0auPysJRwV6UUwA 2731
qai/scraper/processors/tag_to_static.py sha256=RQQAeOFy_8gjm3hhG04_rxbtrlw9toB-qk0-tYlwJWg 1242
qai/scraper/processors/text_writer.py sha256=G2IUcCN8zsOQDLL6-BqZKjYRhYJ2v7VuJkZCEQWkyx8 1003
qai/scraper/processors/value_converter.py sha256=UAlFx0ldzT_dZA_NziwKCwmuULsUIXLJvT4TrOjXpwg 889
qai/scraper/processors/writer.py sha256=avMp7r8TCOV4SFNux7QIw0vQd67ttUlQwc5MT1iGDYE 2068
qai/scraper/scrapers/meta.py sha256=4GmEw9R3q4iOgv_1fy5gJV_FdA_LxfMeEOpv8OTS_2w 235
qai/scraper/scrapers/scrape_and_filter.py sha256=SMh2aOpqfLw1oNRP0JJALFsndbW18FbqKdXSlQFUesA 2514
qai/scraper/scrapers/scraper.py sha256=hJ2W6UyQu6gWfFMk_mGQ0NQQXXrqcTfGRVlrlaQm4oI 12022
qai/scraper/scrapers/scraper_factory.py sha256=lkM1t3nXK0NXctsuD7CCjWsbq2zpI6_XL_rKe-U3mXk 387
qai/scraper/scrapers/stealthscraper.py sha256=G2ooncDszOD7kmKRFF5TDQIKShPMpOhOJXZLqVcnpQk 3771
qai/scraper/scrapers/vision_scraper.py sha256=9mrHsmrVGDaaSjTZKF1goCRnvok6ZTCAaFh7eFA_MS0 1756
qai/scraper/utils/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
qai/scraper/utils/bs_utils.py sha256=nBGkTGwmkW23C5rNkS35de2kUxP6CPi12YbKC_XDq_E 5484
qai/scraper/utils/scrape_utils.py sha256=GwTPmAf-4-J0uz3ubtuVpdhDn7b-SDWQysTmyvuDhuY 2133
qai_scraper-0.6.1.dist-info/METADATA sha256=EbPKYxvUcIUWv0hEb4EEomeuhiIgzvXgqel9xsJgakU 1110
qai_scraper-0.6.1.dist-info/WHEEL sha256=FMvqSimYX_P7y0a7UY-_Mc83r5zkBZsCYPm7Lr0Bsq4 88
qai_scraper-0.6.1.dist-info/RECORD