Crawlee
JSON →Crawlee is a Python library for web scraping and browser automation, providing a robust and flexible framework for building web scraping tasks. It offers features like automatic parallel crawling, proxy rotation, session management, and persistent storage, supporting various techniques from static HTML parsing with BeautifulSoup and Parsel to dynamic JavaScript-rendered content with Playwright. Currently at version 1.6.2, Crawlee for Python has been stable since its v1.0 release in September 2025 and follows semantic versioning, meaning breaking changes are reserved for major releases.
Traffic · last 30 days ↓44% vs prev 7d
total hits 28
actors 7 distinct systems
last hit 1d ago MetaBot
top countries 🇸🇬 Singapore · 🇩🇪 Germany · 🇺🇸 United States · 🇨🇦 Canada · 🇪🇸 Spain
API endpoints
full doc /v1/registry/crawlee
install /v1/registry/crawlee/install
compatibility /v1/registry/crawlee/compatibility