Login
From:
Giles' Blog
(Uncensored)
subscribe
Writing an LLM from scratch, part 11 -- batches :: Giles' blog
https://www.gilesthomas.com/2025/04/llm-from-scratch-11-batches
links
backlinks
Tagged with:
python
ai
llm from scratch
til deep dives
Batching speeds up training and inference, but for LLMs we can't just use matrices for it -- we need higher-order tensors.
Roast topics
Find topics
Find it!
