NoiseandFluctuationofFiniteLearningRateStochasticGradientDescentKangqiaoLiu1LiuZiyin1MasahitoUeda123AbstractandTeh,2011).Whenthenoiseisduetominibatchsam-pling,thenoiseiscalledtheSGDnoiseorminibatch...
FinitemixturemodelsdonotreliablylearnthenumberofcomponentsDianaCai1TrevorCampbell2TamaraBroderick3Abstracthakaranetal.,2016),microscopygroups(Rubin-Delanchyetal.,2015;Griffie´etal.,2016),haplotype...
AmortizedFiniteElementAnalysisforFastPDE-ConstrainedOptimizationTianjuXue1AlexBeatson2SigridAdriaenssens1RyanP.Adams2AbstractbyPDEs.Commonexamplesincludeoptimaldesign,op-timalcontrol,andtheidentifi...
RandomShufflingBeatsSGDafterFiniteEpochsJeffHaoChen1SuvritSra2Abstract1.IntroductionAlong-standingprobleminoptimizationisWefocusonminimizationofthefinite-sumprovingthatRANDOMSHUFFLE,thewithout-repl...
NearoptimalfinitetimeidentificationofarbitrarylineardynamicalsystemsTuhinSarkar1AlexanderRakhlin2Abstractpopularlinearfeedbackcontrolsystemfoundinavarietyofdevices,fromplanetarysoftlandingsystemsfo...
LightweightStochasticOptimizationforMinimizingFiniteSumswithInfiniteDataShuaiZheng1JamesT.Kwok1Abstractiandgaresmoothandconvex.Stochasticgradientde-scent(SGD)(Robbins&Monro,1951)anditsvariantsVaria...
BeyondFiniteLayerNeuralNetworks:BridgingDeepArchitecturesandNumericalDifferentialEquationsYipingLu1AoxiaoZhong2QuanzhengLi234BinDong564Abstractswhilemaintainingasimilarperformance.Thiscanbeexplaine...