Login
From:
Franz Louis Cesista
(Uncensored)
subscribe
CASPR Without Accumulation is Muon
https://leloykun.github.io/ponder/caspr-wo-accum-is-muon/
links
backlinks
The CASPR optimizer, a variant of Shampoo, reduces to Muon when we remove the accumulation on the preconditioners.
Roast topics
Find topics
Roast it!
Roast topics
Find topics
Find it!
Roast topics
Find topics
Find it!
