Wheelodex » Projects » Crawl4AI

Crawl4AI

View on PyPI — Reverse Dependencies (16)

0.5.0.post8 crawl4ai-0.5.0.post8-py3-none-any.whl

Wheel Details

Project: Crawl4AI
Version: 0.5.0.post8
Filename: crawl4ai-0.5.0.post8-py3-none-any.whl
Download: [link]
Size: 312549
MD5: 0c8c1252fd030a05e1dbc3bfcdd300cb
SHA256: ad7b59e4a4df721cda40510e493e1b9058899071ac175f9b06d11dd1c7fe79fa
Uploaded: 2025-03-25 13:57:20 +0000

dist-info

METADATA · WHEEL · RECORD · top_level.txt · entry_points.txt

METADATA

Metadata-Version: 2.4
Name: Crawl4AI
Version: 0.5.0.post8
Summary: 🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & scraper
Author: Unclecode
Author-Email: Unclecode <unclecode[at]kidocode.com>
Home-Page: https://github.com/unclecode/crawl4ai
License: MIT
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Requires-Python: >=3.9
Requires-Dist: aiosqlite (~=0.20)
Requires-Dist: lxml (~=5.3)
Requires-Dist: litellm (>=1.53.1)
Requires-Dist: numpy (<3,>=1.26.0)
Requires-Dist: pillow (~=10.4)
Requires-Dist: playwright (>=1.49.0)
Requires-Dist: python-dotenv (~=1.0)
Requires-Dist: requests (~=2.26)
Requires-Dist: beautifulsoup4 (~=4.12)
Requires-Dist: tf-playwright-stealth (>=1.1.0)
Requires-Dist: xxhash (~=3.4)
Requires-Dist: rank-bm25 (~=0.2)
Requires-Dist: aiofiles (>=24.1.0)
Requires-Dist: colorama (~=0.4)
Requires-Dist: snowballstemmer (~=2.2)
Requires-Dist: pydantic (>=2.10)
Requires-Dist: pyOpenSSL (>=24.3.0)
Requires-Dist: psutil (>=6.1.1)
Requires-Dist: nltk (>=3.9.1)
Requires-Dist: playwright
Requires-Dist: aiofiles
Requires-Dist: rich (>=13.9.4)
Requires-Dist: cssselect (>=1.2.0)
Requires-Dist: httpx (>=0.27.2)
Requires-Dist: fake-useragent (>=2.0.3)
Requires-Dist: click (>=8.1.7)
Requires-Dist: pyperclip (>=1.8.2)
Requires-Dist: faust-cchardet (>=2.1.19)
Requires-Dist: aiohttp (>=3.11.11)
Requires-Dist: humanize (>=4.10.0)
Requires-Dist: PyPDF2; extra == "pdf"
Requires-Dist: torch; extra == "torch"
Requires-Dist: nltk; extra == "torch"
Requires-Dist: scikit-learn; extra == "torch"
Requires-Dist: transformers; extra == "transformer"
Requires-Dist: tokenizers; extra == "transformer"
Requires-Dist: torch; extra == "cosine"
Requires-Dist: transformers; extra == "cosine"
Requires-Dist: nltk; extra == "cosine"
Requires-Dist: selenium; extra == "sync"
Requires-Dist: PyPDF2; extra == "all"
Requires-Dist: torch; extra == "all"
Requires-Dist: nltk; extra == "all"
Requires-Dist: scikit-learn; extra == "all"
Requires-Dist: transformers; extra == "all"
Requires-Dist: tokenizers; extra == "all"
Requires-Dist: selenium; extra == "all"
Requires-Dist: PyPDF2; extra == "all"
Provides-Extra: pdf
Provides-Extra: torch
Provides-Extra: transformer
Provides-Extra: cosine
Provides-Extra: sync
Provides-Extra: all
Description-Content-Type: text/markdown
Dynamic: author
Dynamic: home-page
Dynamic: license-file
Dynamic: requires-python
License-File: LICENSE
[Description omitted; length: 31403 characters]

WHEEL

Wheel-Version: 1.0
Generator: setuptools (78.0.2)
Root-Is-Purelib: true
Tag: py3-none-any

RECORD

Path Digest Size
crawl4ai/__init__.py sha256=0hscE89H4n2F1ltTenI6791E2hWTZGHBVgxRp9e8XkI 3957
crawl4ai/__version__.py sha256=E9p_qOjUlSwezhFURIx9NfHRvZDVgPJHdq8-A6I4e8c 51
crawl4ai/async_configs.py sha256=9Ys1sOFQW5a075MB5BWvYyqzU5IgNSe6rnx6F1rdglE 56258
crawl4ai/async_crawler_strategy.py sha256=wszV39wHUWbTZJVYxcRfcoFSquVvTA1BvLqBXYDJUmY 73768
crawl4ai/async_database.py sha256=OQnGZ0iTiA9TMu41Wzs-Od6NeGq_qtbAooUZjzD-Hn4 22054
crawl4ai/async_dispatcher.py sha256=iV15F8ZZOUzK8qrQ2MqIO1i9MumYc0UdTrjNDqELQf4 25234
crawl4ai/async_logger.py sha256=z5CJ4NkHOgDBqfIBwtnwfvUpwAdtSAslnmKyKi-iJxY 10533
crawl4ai/async_webcrawler.py sha256=1jYHaA-a2OE-hQBy1aCME_1HbxTd0n1lj1OE4kIs-KE 30858
crawl4ai/browser_manager.py sha256=NE-QqHYgfhSUJ54NFY-E92laB0ZPKvYcaYTEqZRVF0Q 35757
crawl4ai/browser_profiler.py sha256=0MEtAA38kqQQ9OgZ2unKX899Z-Y1Ua1R6zXCMe0C3w4 41993
crawl4ai/cache_context.py sha256=rmeJBJCYFgDyf0rD_O0fTaZamUi02WndEEmtRLFOmvg 4063
crawl4ai/chunking_strategy.py sha256=DC4uoLJXryBxHmMsoqEIkoa_Gk9kevIn51tmkO2TgsM 7524
crawl4ai/cli.py sha256=TnUsfg7ojKpM5FNLDZ22HocRhJM4w_OH2Y0GDpeNFfs 52967
crawl4ai/config.py sha256=RGG88wH6rlVj9wX8hWpkQqgZtwfjMDS95Em_YB9LycQ 4423
crawl4ai/content_filter_strategy.py sha256=cucKw7B6xFnqnLxoVnbyP5uy6MLJdpJScsIrBMWNB-g 37809
crawl4ai/content_scraping_strategy.py sha256=31HvkQEEw9BrEPMbqmVVH_TSugOQKvOndaXnScnN5n0 63110
crawl4ai/docker_client.py sha256=vDwkpjAEI8wbmWnGWLn1RJVtDttX6Jf8rDgrq5LtK-I 7276
crawl4ai/extraction_strategy.py sha256=34ifzkQEGr08CNIRFHFNhhLtbOVit-D7M65iLXRUIyo 69472
crawl4ai/hub.py sha256=DhH_H1D0CkaqBuutI1rviHfhjGBZgeZHz1H6TobyFrw 2447
crawl4ai/install.py sha256=I0ACuWf0eSgVfKS2k0InVIfGxJQfSWEBQ4GD8cnFRHs 5843
crawl4ai/markdown_generation_strategy.py sha256=O8Yu_UeVy1-U2nVM-xxuYZR9E1fFtQiE54SRkga18Q0 9336
crawl4ai/migrations.py sha256=NG3otxQzcfpAYtcwVujgD29pkjuEdFGXyvgYOBMM9YA 6457
crawl4ai/model_loader.py sha256=gU1byMLfZpHuXEQX_9JgLHd0kD1_8gBGWkhRUVhkuLQ 9222
crawl4ai/models.py sha256=FCJoq0kvK8YNuar1hcmTMn_6DDsP7k3dqWpqv6yeWfU 11142
crawl4ai/prompts.py sha256=C97OUcr-7xMbXGbManWlxN46fVVYE2LxwEV_zPMrfMk 34065
crawl4ai/proxy_strategy.py sha256=hUTeox8ySkactnuQpAgs9_Bgl2tiX4rG1NzsONnkkps 5091
crawl4ai/ssl_certificate.py sha256=wJR4Y92jx1bCIhUjX9yrG1wioR9sBSFFeTUyJJRKsM0 6711
crawl4ai/types.py sha256=uASZOGxzJWaXz4VO14GLu-ec56nyh-zjB3pYXYRpgzw 6939
crawl4ai/user_agent_generator.py sha256=zVfc6EoAht8gRg_grqTvDiS2-Bn4s6hIcsFCdaC5FyM 16228
crawl4ai/utils.py sha256=BPhs43bRalzQJpU-rr_zwdRsQhWrqtStphemjW3EAdg 90784
crawl4ai/browser/__init__.py sha256=Qka2ZCZqrrekxEZBa0XETEooAe5-qfNYBZjNvFUK8Uo 301
crawl4ai/browser/docker_config.py sha256=PWhEp7jH0cBAZt_HoX_IrcROU5sUV7mZk8dx58dqKns 6025
crawl4ai/browser/docker_registry.py sha256=lslOI3xQi1U8kH-KB9iOoqZX9WGyQv8-fe5C2dxM1xE 6277
crawl4ai/browser/docker_strategy.py sha256=8TPR36QTCdyP1QVTQ7zLyQ6M3-k0hO3jHxhb-KvfXmo 11947
crawl4ai/browser/docker_utils.py sha256=8PqDfxd_p1YaxuGCNJVbik_XktEvZePJM_U8oxvwA64 21298
crawl4ai/browser/manager.py sha256=PaM-AdP-yI37Ci7_v6_dJ7fcdwJUARi9VWXG8dZSp9c 7621
crawl4ai/browser/models.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
crawl4ai/browser/profiles.py sha256=2dWQeYUipm7VMTmnfBJgLGoBVTqD_qiJ_CCEBrwoTEI 20697
crawl4ai/browser/strategies.py sha256=bqvPAPWeDs6qtRd1DQdDfmFweItKLq8ma_w1_lLGgHQ 50737
crawl4ai/browser/utils.py sha256=Zerk_vvPMQpK7OUIJ_pxf-2XXWNbnd8R6uxk0FyUoSM 11484
crawl4ai/components/crawler_monitor.py sha256=oKwa2XcrHsJvf4Pzna-eKENC88ShqRgXltX-d9de3vI 30530
crawl4ai/crawlers/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
crawl4ai/crawlers/amazon_product/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
crawl4ai/crawlers/amazon_product/crawler.py sha256=CIOFJgrE5VftZVdvGpI2u5hdjUWjFAf9ktAzsrh4n9Q 655
crawl4ai/crawlers/google_search/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
crawl4ai/crawlers/google_search/crawler.py sha256=DvGFvctWnBouQjBZ2Acp9zGgCP_scI3ZRWvspYoTj_I 6276
crawl4ai/deep_crawling/__init__.py sha256=PZUX5TzRjYIT968b_Vy6-StCM2i6mklRQySHFkzb9rY 1094
crawl4ai/deep_crawling/base_strategy.py sha256=RLgS5bBCHlg7iw1sQZx103O16DaaW16dtjkgF__Rdkg 5623
crawl4ai/deep_crawling/bff_strategy.py sha256=yb8ZCt2bW11fZSqDxriUI44KzqejNLFjd2CoRQcQsls 9682
crawl4ai/deep_crawling/bfs_strategy.py sha256=JCRZG91L8y-ffxnGgZnEQQI65I0_1jGPKCFMNBpC-so 9961
crawl4ai/deep_crawling/crazy.py sha256=NvJvKPzzlwJ5wIq3zht9QthP2Ujdq6PRJqOlMMINBJQ 15936
crawl4ai/deep_crawling/dfs_strategy.py sha256=_LXCpQvfcerWtTS2RDQMEkm-yDcwOPp6R4l9Q6rekJo 4462
crawl4ai/deep_crawling/filters.py sha256=FNOdt1ZY-2QoEuTcjNZzKz0NkPzFNV9vAgnEIT3jPT4 22052
crawl4ai/deep_crawling/scorers.py sha256=VJ3dZAYTs3ldwLyopc5yuz_yf4YzgQeB1XEZIDDHdtg 16742
crawl4ai/html2text/__init__.py sha256=NfXaRCnPt_XYWy0kHGbKEJINwPNOGwsO7JIPgLMjrsg 43167
crawl4ai/html2text/__main__.py sha256=bYt9eEaoRQWdejEHFD8REx9jxVEdZptECFsV7F49Ink 30
crawl4ai/html2text/_typing.py sha256=LfPy-xPqDr9HrT1n3k9Y8i5u8Gr94CXo3v8-y9-jDe0 71
crawl4ai/html2text/cli.py sha256=ZX8qMXP2Twc8gzP2xbJ_WFmSuk4sLwKFsFEaiX0TFJA 9968
crawl4ai/html2text/config.py sha256=myiV_W33jX0ibAbA4farJ9yrZWGqwC71bYOl8E3Q0zs 4107
crawl4ai/html2text/elements.py sha256=p3onMQ-4gcAI8U36HAH5vvX-9s6QMQAjrV2uXrjjzdg 423
crawl4ai/html2text/utils.py sha256=Xpc8qN4nsi-rQwviRe0Lx8UiCv1Iwz3qNHPfIqkouBc 8576
crawl4ai/js_snippet/__init__.py sha256=WmXmXUaXy54bXeKx2gbUyTDI9TrLAk2GDCz6eCN4Ns8 749
crawl4ai/js_snippet/navigator_overrider.js sha256=zxi0yhpN5K-OHVBJL091YR6LsAKSO5T_Zbwpd4YUW-c 766
crawl4ai/js_snippet/remove_overlay_elements.js sha256=xanWt0WxPqkWqnQezBxtpSBtktHGxzmIcC6DefP5rO4 4070
crawl4ai/js_snippet/update_image_dimensions.js sha256=gfSfj_2zMFp93rimQDFAKk78KVpRegapnlVYko062AA 1811
crawl4ai/legacy/__init__.py sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU 0
crawl4ai/legacy/cli.py sha256=gWs24NqKnboMu5kYic8pS9ssXcHw_uaClBFMgMIWw0M 3516
crawl4ai/legacy/crawler_strategy.py sha256=dL383Gl460B66NgR-MlrOm4zUdthcv0k67A954tYvhU 15778
crawl4ai/legacy/database.py sha256=Wo1WuhEsd-HuMxcFyQ8JwMYTFRQMuKnbMFgRFfRCQ2k 4966
crawl4ai/legacy/docs_manager.py sha256=ODTVchWTZXD9syUh79xBqPqw9i90kxPWd9QAFxa0bU4 3002
crawl4ai/legacy/llmtxt.py sha256=sewUmcQZPRiDACYmuxKqbWUP5a-RXpQ4P12ZxHlZpXA 21399
crawl4ai/legacy/version_manager.py sha256=frS1DNEzHap3nRNDu1yshj2Ln9KSqlf1-A3Tie8JyNQ 956
crawl4ai/legacy/web_crawler.py sha256=uD9ESFMNPyD55rPBRnwOJu_x8qlJK8nqO1NiU9pm8Wg 10348
crawl4ai/processors/pdf/__init__.py sha256=SdWO98Kdxd86GkL_WOrstvuOdjwyX4QYUzEJ2y-CiNE 6056
crawl4ai/processors/pdf/processor.py sha256=ClncWRFNuL8xP6iiQ898KT1HHbLiTlARVFaH4FIlY_U 22282
crawl4ai/processors/pdf/utils.py sha256=LTHB7FW4tCxfA5jml2OcSDU6hv0n5j5XfUSl5mLOY0E 13085
crawl4ai-0.5.0.post8.dist-info/licenses/LICENSE sha256=GT_jJwS-4VzXT1FT5WnN-DDiZEXhl5ilXa7jLaQHWKo 9998
crawl4ai-0.5.0.post8.dist-info/METADATA sha256=fzJiNNzDPJKiW70OzNn9UJzRE9_IImeJI0cMRimQMEE 34424
crawl4ai-0.5.0.post8.dist-info/WHEEL sha256=DK49LOLCYiurdXXOXwGJm6U4DkHkg4lcxjhqwRa0CP4 91
crawl4ai-0.5.0.post8.dist-info/entry_points.txt sha256=ZIwWwh2nDphLG7uwBxOSBMsBxqGFjd_8uRVkWMUQa5w 230
crawl4ai-0.5.0.post8.dist-info/top_level.txt sha256=5vkxvM11I635u6TIlfI-MOaVnY6t_zQ6bjU1mXkfFhE 9
crawl4ai-0.5.0.post8.dist-info/RECORD — —

top_level.txt

crawl4ai

entry_points.txt

[console_scripts]
crawl4ai-doctor = crawl4ai.install:doctor
crawl4ai-download-models = crawl4ai.model_loader:main
crawl4ai-migrate = crawl4ai.migrations:main
crawl4ai-setup = crawl4ai.install:post_install
crwl = crawl4ai.cli:main