Modern language models predict "tokens", not words—but what exactly are tokens?| seantrott.substack.com
Tokenization's a winner, plus some administrative updates.| seantrott.substack.com
Want to really understand how large language models work? Here’s a gentle primer.| www.understandingai.org