Scrapy

JSON →
library 2.14.1 ·python
verified Jun 9, 2026 install

High-level web crawling and scraping framework. Current version is 2.14.1 (Jan 2026). Requires Python >=3.10. Two major breaking changes in 2.13: start_requests() (sync) replaced by start() (async), and TWISTED_REACTOR now defaults to asyncio — both can silently break existing spiders.

total hits 42
actors 11 distinct systems
last hit 20h ago PetalBot
GPTBot
4
Amazonbot
4
MetaBot
4
ByteDance
3
Script
2
Sogou
1
Search engines
6
Humans
12

top countries 🇺🇸 United States · 🇸🇬 Singapore · 🇨🇦 Canada · 🇩🇪 Germany · 🇮🇹 Italy