tokenize-rt
JSON →tokenize-rt is a Python library that provides a wrapper around the standard library's `tokenize` module, ensuring proper round-tripping of Python source code. It extends the standard token set with `ESCAPED_NL` and `UNIMPORTANT_WS` tokens, making it especially useful for refactoring tools that need to preserve whitespace and exact source representation. The library is actively maintained, with version 6.2.0 released on May 23, 2025, and generally follows a regular release cadence.
Traffic · last 30 days
total hits 12
actors 4 distinct systems
last hit 4d ago GPTBot
top countries 🇸🇬 Singapore · 🇺🇸 United States · 🇨🇦 Canada · 🇬🇧 United Kingdom · 🇩🇪 Germany
API endpoints
full doc /v1/registry/tokenize-rt
install /v1/registry/tokenize-rt/install
compatibility /v1/registry/tokenize-rt/compatibility