A Fast, spec compliant Python 3.14+ tokenizer
JSON →Pytokens is an open-source Python library providing a fast, spec-compliant tokenizer for Python 3.14+ that is also capable of running on older Python versions (>=3.8). Currently at version 0.4.1, it appears to be actively maintained with recent releases focusing on packaging and development improvements.
Traffic · last 30 days ↓50% vs prev 7d
total hits 18
actors 5 distinct systems
last hit 9d ago human
top countries 🇺🇸 United States · 🇨🇦 Canada · 🇸🇬 Singapore · 🇫🇷 France
API endpoints
full doc /v1/registry/pytokens
install /v1/registry/pytokens/install
compatibility /v1/registry/pytokens/compatibility