Login
From:
Giles' Blog
(Uncensored)
subscribe
Writing an LLM from scratch, part 8 -- trainable self-attention :: Giles' blog
https://www.gilesthomas.com/2025/03/llm-from-scratch-8-trainable-self-attention
links
backlinks
Tagged with:
python
ai
llm from scratch
til deep dives
Moving on from a toy self-attention mechanism, it's time to find out how to build a real trainable one. Following Sebastian Raschka's book 'Build a Large Language Model (from Scratch)'. Part 8/??
Roast topics
Find topics
Find it!
