Optimization Nuggets: Stochastic Polyak Step-sizePublished byfa.bianp.neton •1 min readA simple step-size tuner with optimal ratesSGDProofsLearn moreShareLegalReport