Login
From:
AI Summer
(Uncensored)
subscribe
Understanding einsum for Deep learning: implement a transformer with multi-head self-attention from scratch
https://theaisummer.com/einsum-attention/
links
backlinks
Roast topics
Find topics
Find it!
Learn about the einsum notation and einops by coding a custom multi-head self-attention unit and a transformer block