#BPE

Animated Breakdown of GPT-4o's Tokenizer: Why It Can't Count the R's in Strawberry

A 6-minute animation traces 'strawberry' through GPT-4o's tokenizer—real token IDs and BPE merges—explaining why models can't count letters, how reasoning models work around it, and Hindi tokenization efficiency vs GPT-4.