Login
From:
seantrott.substack.com
(Uncensored)
subscribe
Tokenization in large language models, explained
https://seantrott.substack.com/p/tokenization-in-large-language-models
links
backlinks
Roast topics
Find topics
Find it!
Modern language models predict "tokens", not words—but what exactly are tokens?
