Login
From:
Franz Louis Cesista
(Uncensored)
subscribe
CASPR Without Accumulation is Muon
https://leloykun.github.io/ponder/caspr-wo-accum-is-muon/
links
backlinks
Roast topics
Find topics
Find it!
The CASPR optimizer, a variant of Shampoo, reduces to Muon when we remove the accumulation on the preconditioners.
