python3-tokenize-rt

wrapper around the Python stdlib `tokenize` which roundtrips

Description

The stdlib tokenize module does not properly roundtrip. This wrapper around the stdlib provides two additional tokens ESCAPED_NL and UNIMPORTANT_WS, and a Token data type. Use src_to_tokens and tokens_to_src to roundtrip.

This library is useful if you're writing a refactoring tool based on the python tokenization.

Upload more screenshots

Please help extend the collection of screenshots. Just make a screenshot and upload it here. You don't need to register or anything.

Upload a screenshot

Hint: upload an image here from your clipboard with Ctrl-V


Homepage

https://github.com/asottile/tokenize-rt


Install this software package

If the package is available for the distribution you are currently using on your computer then install the software by clicking on…

Install python3-tokenize-rt