token-utils
  • About tokens: Python vs token-utils
  • About untokenizing
  • Prelude to the tutorial
  • Tutorial: recipes, tips, and tricks

API

  • Token class
  • Tokenizing related methods

Appendix

  • To do
token-utils
  • Overview: module code

All modules for which code is available

  • token_utils.custom_warnings
  • token_utils.token_class
  • token_utils.tokenizing

© Copyright 2026, André Roberge.

Built with Sphinx using a theme provided by Read the Docs.