Roast topics
Find topics
Roast it!
Roast topics
Find topics
Find it!
Login
From:
Franz Louis Cesista
(Uncensored)
subscribe
Squeezing 1-2% Efficiency Gains Out of Muon by Optimizing the Newton-Schulz Coefficients
https://leloykun.github.io/ponder/muon-opt-coeffs/
links
backlinks
Simply switching to Muon can already get you 2x efficiency gains. But you can squeeze out an extra 1-2% by optimizing the Newton-Schulz coefficients.