warc3-wet-clueweb09
JSON →A Python library designed to efficiently parse and work with ARC and WARC files, specifically tailored with fixes and optimizations for ClueWeb09 WET (Web Extracted Text) files. It provides an interface to iterate over records within these compressed archives. The current version is 0.2.5, indicating a pre-1.0 status with potential for future API changes, and it's maintained on an as-needed basis.
Traffic · last 30 days ↓87% vs prev 7d
total hits 11
actors 3 distinct systems
last hit 7d ago Script
top countries 🇺🇸 United States · 🇩🇪 Germany · 🇨🇦 Canada · 🇫🇷 France
Resources
API endpoints
full doc /v1/registry/warc3-wet-clueweb09
compatibility /v1/registry/warc3-wet-clueweb09/compatibility