Sharpness-Aware Muon: Matrix-Aware Optimization with Momentum-Guided Perturbations
Adds momentum-guided sharpness-aware perturbations to the Muon optimizer for flatter minima.
Explainer · on the wire
The explainer for this story is still on the wire.
The claim, the mechanism, and the figures land here once generated.
Source · arXiv wire