Skip to content

0.2

Choose a tag to compare

@simonw simonw released this 10 Jul 23:37
  • --encode now encodes text to integer tokens and displays them. This has been renamed from --tokens.
  • --decode against a sequence of integer tokens now turns those back into text. #7
  • --tokens for either of those options outputs the raw tokens in a format that helps show if they have a leading space or similar. #4