Writing an LLM from scratch, part 13 -- the 'why' of attention, or: attention heads are dumb :: Giles' blog
A pause to take stock: realising that attention heads are simpler than I thought explained why we do the calculations we do.| Giles' Blog
A pause to take stock: realising that attention heads are simpler than I thought explained why we do the calculations we do.| Giles' Blog
