A Fast, spec compliant Python 3.14+ tokenizer
JSON →Pytokens is an open-source Python library providing a fast, spec-compliant tokenizer for Python 3.14+ that is also capable of running on older Python versions (>=3.8). Currently at version 0.4.1, it appears to be actively maintained with recent releases focusing on packaging and development improvements.
Traffic · last 30 days ↓75% vs prev 7d
total hits 12
actors 3 distinct systems
last hit 4d ago AhrefsBot
top countries 🇺🇸 United States · 🇨🇦 Canada · 🇩🇪 Germany · 🇸🇬 Singapore
API endpoints
full doc /v1/registry/pytokens
install /v1/registry/pytokens/install
compatibility /v1/registry/pytokens/compatibility