Preparing for system design interviews?  Try bugzed.com →

CrawleX

JSON →
library 1.0.4 ·javascript
verified Jun 7, 2026

A stealth web crawler for Node.js (≥20) that achieves Chrome-perfect TLS and HTTP/2 fingerprinting, making bot detection nearly impossible. v1.0.4 (April 2025) is actively maintained with weekly releases focused on stability and feature parity. It includes a browser render pool for JavaScript-heavy pages, persistent queue management, lifecycle hooks, and built-in sitemap support. Unlike Playwright or Puppeteer, CrawleX provides a higher-level orchestration layer optimized for large-scale scraping with anti-bot evasion as a core feature. Ships TypeScript types and is ESM-only. Key differentiators: automatic fingerprint rotation, adaptive throttling, and a plugin system for custom middleware.

total hits 10
actors 3 distinct systems
last hit 17d ago AhrefsBot
GPTBot
3
Humans
5

top countries 🇺🇸 United States · 🇸🇬 Singapore · 🇮🇳 India · 🇨🇦 Canada · SN