Login
Roast topics
Find topics
Find it!
From:
Giles' Blog
(Uncensored)
subscribe
Writing an LLM from scratch, part 15 -- from context vectors to logits; or, can it really be that simple?! :: Giles' blog
https://www.gilesthomas.com/2025/05/llm-from-scratch-15-from-context-vectors-to-logits
links
backlinks
Tagged with:
python
ai
llm from scratch
til deep dives
Roast topics
Find topics
Roast it!
The way we get from context vectors to next-word prediction turns out to be simpler than I imagined -- but understanding why it works took a bit of thought.