Adaptive Federated Optimization Across Smooth and Nonsmooth Regimes
AdaGrad-style methods can simultaneously adapt to both the order and constants of smoothness in centralized optimization.
Explainer · on the wire
The explainer for this story is still on the wire.
The claim, the mechanism, and the figures land here once generated.
Source · arXiv