tokenize-rt
JSON →tokenize-rt is a Python library that provides a wrapper around the standard library's `tokenize` module, ensuring proper round-tripping of Python source code. It extends the standard token set with `ESCAPED_NL` and `UNIMPORTANT_WS` tokens, making it especially useful for refactoring tools that need to preserve whitespace and exact source representation. The library is actively maintained, with version 6.2.0 released on May 23, 2025, and generally follows a regular release cadence.
Traffic · last 30 days ↑167% vs prev 7d
total hits 14
actors 6 distinct systems
last hit 1d ago Googlebot
top countries 🇺🇸 United States · 🇩🇪 Germany · 🇮🇳 India · 🇨🇦 Canada · 🇫🇷 France
API endpoints
full doc /v1/registry/tokenize-rt
install /v1/registry/tokenize-rt/install
compatibility /v1/registry/tokenize-rt/compatibility