Crawlee Python
byApify
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and…
Web CrawlingOpen Source Developer ToolsOpen Source
About
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Open Source Health
- Stars
- 9,517
- Forks
- 805
- License
- Apache-2.0
- Last commit
- 1 months ago
Python
Alternatives to Crawlee Python
Deep Researchby David ZhangAn AI-powered research assistant that performs iterative, deep research on any topic by combining search engines, web scraping, and large language models. The goal of this repo is to provide the simplest implementation of a deep research agent - e.g. an agent that can refine…- select.rsby Utkarsh KukretiA Rust library to extract useful data from HTML documents, suitable for web scraping.
Scrapelyby ScrapyA pure-python HTML screen-scraping library- Faster Than Requestsby Juan CarlosFaster requests on Python 3
MechanicalSoupby MechanicalSoupA Python library for automating interaction with websites.
Resources & Links
Related Categories
Using Crawlee Python?
Track its cost next to the rest of your stack and get a reminder before it renews.
Add to my stackVendor
Apify
Publisher of Apify Console