Tag: explainer

All the articles with the tag "explainer".

• Tokenization: why counting the letters in strawberry can trip up a model

  Published:Mar 14, 2026 |  at 10:30 PM

  How tokenizers turn text into IDs, why that can make letter counting harder, and how token costs differ across languages.