VarianceReductionviaPrimal-DualAcceleratedDualAveragingforNonsmoothConvexFinite-SumsChaobingSong1StephenJ.Wright1JelenaDiakonikolas1Abstractvectorswithntypicallylarge;gi:R!R,i=1,2,...,n,bepossiblyn...
PIDAcceleratedValueIterationAlgorithmAmir-massoudFarahmand12MohammadGhavamzadeh3Abstractapproximationofthevalueoraction-valuefunctions,i.e.,Vk+1←TπVkorQk+1←T∗Qk.FordiscountedMDPs,Theconvergence...
Parameter-freeLocallyAcceleratedConditionalGradientsAlejandroCarderera1JelenaDiakonikolas2CheukYin(Eric)Lin2SebastianPokutta3Abstracttions(Jaggi,2013;Garber,2016;Hazan&Luo,2016;Braunetal.,2017;2019...
HouseholderSketchforAccurateandAcceleratedLeast-Mean-SquaresSolversJyotikrishnaDass1RabiMahapatra1Abstractelsarestatisticallyrobustandeasilyinterpretable.Hence,theyfindapplicationsincancerresearch(...
DataaugmentationfordeeplearningbasedAcceleratedMRIreconstructionwithlimiteddataZalanFabian1ReinhardHeckel2MahdiSoltanolkotabi1Abstracttients.Duetothesubsampling,therearefewerequationsthanunknowns,a...
ADOM:AcceleratedDecentralizedOptimizationMethodforTime-VaryingNetworksDmitryKovalev1EgorShulgin1PeterRichta´rik1AlexanderRogozin23AlexanderGasnikov23Abstract⇒⇒WeproposeADOM–anAcceleratedmethodf...
AcceleratedAlgorithmsforSmoothConvex-ConcaveMinimaxProblemswithO(1/k2)RateonSquaredGradientNormTaeHoYoon1ErnestK.Ryu1Abstractvalueforquantifyingsuboptimality.Moreover,thenotionismeaningfulfordiffer...
StatisticallyPreconditionedAcceleratedGradientMethodforDistributedOptimizationHadrienHendrikx1LinXiao2Se´bastienBubeck2FrancisBach1LaurentMassoulie´1Abstractleaveψmainlyfornon-smoothregularizati...
OntheConvergenceofNesterov’sAcceleratedGradientMethodinStochasticSettingsMahmoudAssran123MichaelRabbat23AbstractHowever,thetheoreticalunderstandingofAcceleratedmeth-odsremainslimitedwhenusedwithst...
AnAcceleratedDFOAlgorithmforFinite-sumConvexFunctionsYuwenChen1AntonioOrvieto1AurelienLucchi1Abstractlearningandwhichcanbeformulatedas:Derivative-freeoptimization(DFO)hasrecentlyminf(x):=1nfi(x),(1...
AcceleratedStochasticGradient-freeandProjection-freeMethodsFeihuHuang12LueTao12SongcanChen12Abstract1.IntroductionInthepaper,weproposeaclassofAcceleratedInthepaper,wefocusonsolvingthefollowingconst...
AcceleratedMessagePassingforEntropy-RegularizedMAPInferenceJonathanN.Lee1AldoPacchiano2PeterBartlett23MichaelI.Jordan23Abstractinferenceinthesemodelshasmultipleapplications,rangingfromcomputervisio...
ASimplerApproachtoAcceleratedStochasticOptimization:IterativeAveragingMeetsOptimismPooriaJoulani1AnantRaj2Andra´sGyo¨rgy1CsabaSzepesva´ri13Abstractblynon-smooth)convexfunction.Whenφ=0,andgivena...
AcceleratedLinearConvergenceofStochasticMomentumMethodsinWassersteinDistancesBugraCan1MertGurbuzbalaban1LingjiongZhu2Abstractsupervisedlearningincludelinearandnon-linearregressionproblems,supportve...
AcceleratedFlowforProbabilityDistributionsAmirhosseinTaghvaei1PrashantG.Mehta1AbstractInthispaper,weproposeamethodologyandnumericalalgorithmsthatachieveAcceleratedgradientflowsontheThispaperpresent...
ContinuousandDiscrete-timeAcceleratedStochasticMirrorDescentforStronglyConvexFunctionsPanXu1TianhaoWang2QuanquanGu1Abstractloss,squarelossandstronglyconvexregularizerssuchas`2normandKullback-Leible...
ComputationalOptimalTransport:ComplexitybyAcceleratedGradientDescentIsBetterThanbySinkhorn’sAlgorithmPavelDvurechensky1AlexanderGasnikov234AlexeyKroshnin234Abstractclustering(Hoetal.,2017),textcla...
ADMMandAcceleratedADMMasContinuousDynamicalSystemsGuilhermeFranc¸a1DanielP.Robinson1Rene´Vidal1Abstract1.1.RelatedworkRecently,therehasbeenanincreasinginterestinPerhapsthesimplestconnectionbetwee...
meProp:SparsifiedBackPropagationforAcceleratedDeepLearningwithReducedOverfittingXuSun12XuanchengRen12ShumingMa12HoufengWang12Abstractsuchthatonlyhighlyrelevantparametersareupdatedandotherparameters...
DoublyAcceleratedMethodsforFasterCCAandGeneralizedEigendecompositionZeyuanAllen-Zhu1YuanzhiLi2Abstracttraditionof(Wangetal.,2016;Garber&Hazan,2015),weassumewithoutlossofgeneralitythatλi∈[−1,1].W...