AffineInvariantAnalysisofFrank-WolfeonStronglyConvexSetsThomasKerdreux1LewisLiu23SimonLacosteJulien2345DamienScieur43AbstractAlgorithm1Frank-WolfeAlgorithmLMOLine-searchItisknownthattheFrank-Wolfe(...
SADAGRAD:StronglyAdaptiveStochasticGradientMethodsZaiyiChen12YiXu2EnhongChen1TianbaoYang2Abstractiterations.Ithasreceivedtremendousinterestsforsolvingbigdatalearningproblems(e.g.,see(Deanetal.,2012...
DynamicRegretofStronglyAdaptiveMethodsLijunZhang1TianbaoYang2RongJin3Zhi-HuaZhou1Abstractincurredbythelearnerandthatofthebestfixeddecisioninhindsight,i.e.,Tocopewithchangingenvironments,recentde-ve...
OptimalAlgorithmsforSmoothandStronglyConvexDistributedOptimizationinNetworksKevinScaman1FrancisBach2Se´bastienBubeck3YinTatLee3LaurentMassoulie´1Abstractnatelocalincrementalimprovementsteps(sucha...
Natasha:FasterNon-ConvexStochasticOptimizationviaStronglyNon-ConvexParameterZeyuanAllen-Zhu1Abstractrandom∇fi(x).Givenanon-convexfunctionf(x)thatisanav-•Theso-calledproximaltermψ(x)addsmoregener...