A Second look at Exponential and Cosine Step Sizes Simplicity, Adaptivity, and Performance

ASecondlookatExponentialandCosineStepSizes:Simplicity,Adaptivity,andPerformanceXiaoyuLi∗1ZhenxunZhuang∗2FrancescoOrabona123Abstracttypicallybetterscalewiththecomplexityofthepredic-torsandtheamoun...