GuaranteesforTuningtheStepSizeusingaLearning-to-LearnApproachXiangWang1ShuaiYuan1ChenweiWu1RongGe1Abstractrinetal.(2015)consideredtheideaoftuningtheseparame-tersbyoptimization—thatis,considerameta...
ASecondlookatExponentialandCosineStepSizes:Simplicity,Adaptivity,andPerformanceXiaoyuLi∗1ZhenxunZhuang∗2FrancescoOrabona123Abstracttypicallybetterscalewiththecomplexityofthepredic-torsandtheamoun...
OnConvergence-DiagnosticbasedStepSizesforStochasticGradientDescentScottPesme1AymericDieuleveut2NicolasFlammarion1Abstractwarmrestarts(Loshchilov&Hutter,2016).Howeverthosestrategiestypicallydonotcom...
AutomaticClassifiersasScientificInstruments:OneStepFurtherAwayfromGround-TruthJacobWhitehill1AnandRamakrishnan1Abstractotherfieldsbyservingasscientificinstrumentsthatcanmeasurebehavioral,medical,so...