UCBMomentumQ-learning:CorrectingthebiaswithoutforgettingPierreMénard1OmarDarwicheDomingues2XuedongShang23MichalValko234Abstractbalancetheexplorationoftheenvironmentandexploitationofthecurrentknowl...
SMG:AShufflingGradient-BasedMethodwithMomentumTrangH.Tran1LamM.Nguyen2QuocTran-Dinh3Abstractlearning,including,butnotlimitedto,logisticregression,multi-kernellearning,conditionalrandomfields,andneu...
Quasi-GlobalMomentum:AcceleratingDecentralizedDeepLearningonHeterogeneousDataTaoLin1SaiPraneethKarimireddy1SebastianU.Stich1MartinJaggi1Abstractiskeptlocally(nevertransmittedduringtraining).Decentr...
Positive-NegativeMomentum:ManipulatingStochasticGradientNoisetoImproveGeneralizationZekeXie1LiYuan2ZhanxingZhu3MasashiSugiyama41AbstractItiswell-knownthatstochasticgradientnoise(SGN)instochasticopt...
UniversalAverage-CaseOptimalityofPolyakMomentumDamienScieur1FabianPedregosa2Abstractmizationmethods.Thesimplexmethod,forexample,hasaworst-caseexponentialcomplexity,thatbecomespolyno-PolyakMomentum(...
MomentumImprovesNormalizedSGDAshokCutkosky12HarshMehta1AbstractthatSGD’sconvergencerateisindependentofthedimen-sionoftheproblem,allowingittoscalemoreeasilytoWeprovideanimprovedanalysisofnormalized...
ConvergenceofaStochasticGradientMethodwithMomentumforNon-SmoothNon-ConvexOptimizationVienV.Mai1MikaelJohansson1AbstractThisfunctionclassisveryrichandimportantinoptimiza-tion(Rockafellar,1982;Vial,1...
AcceleratedLinearConvergenceofStochasticMomentumMethodsinWassersteinDistancesBugraCan1MertGurbuzbalaban1LingjiongZhu2Abstractsupervisedlearningincludelinearandnon-linearregressionproblems,supportve...
KatyushaX:PracticalMomentumMethodforStochasticSum-of-NonconvexOptimizationZeyuanAllen-Zhu1Abstractsolvingthem.Theproblemofminimizingsum-of-nonconvexAtleasttracingbackto2015,Shalev-Shwartz(2016)iden...
ConvergenceAnalysisofProximalGradientwithMomentumforNonconvexOptimizationQunweiLi1YiZhou1YingbinLiang1PramodK.Varshney1AbstractAlgorithm1APGInthiswork,weinvestigatetheacceleratedprox-Input:y1=x1=x0...