AdagradStepsizes:SharpConvergenceOverNonconvexLandscapesRachelWard12XiaoxiaWu12LéonBottou2AbstractcanbeapproximatedbytheaverageofalargenumberAdaptivegradientmethodssuchasAdagradandnofcomponentfunc...
VariantsofRMSPropandAdagradwithLogarithmicRegretBoundsMaheshChandraMukkamala12MatthiasHein1AbstractThegoalofthispaperistwofold.First,weproposeSC-AdagradwhichisavariantofAdagradadaptedtotheAdaptiveg...
