AccelerationofSVRGandKatyushaXbyInexactPreconditioningYanliLiu1FeiFeng1WotaoYin1Abstractregularizerψ(x)isproper,closed,andconvex,butmaybenonsmooth.Anonzeroψ(x)isdesirableinmanyapplica-Empiricalri...
KatyushaX:PracticalMomentumMethodforStochasticSum-of-NonconvexOptimizationZeyuanAllen-Zhu1Abstractsolvingthem.Theproblemofminimizingsum-of-nonconvexAtleasttracingbackto2015,Shalev-Shwartz(2016)iden...