Zeroth-OrderNon-convexLearningviaHierarchicalDualAveragingAmélieHéliou1MatthieuMartin1PanayotisMertikopoulos21ThibaudRahier1Abstractalsorequiresthattheproblem’sobjectiveremainstationaryduringthe...
OptimalNon-convexExactRecoveryinStochasticBlockModelviaProjectedPowerMethodPengWang1HuikangLiu2ZiruiZhou3AnthonyMan-ChoSo1Abstractmodel(SBM),whichtendstogenerategraphscontainingunderlyingcommunitys...
RegretMinimizationinStochasticNon-convexLearningviaaProximal-GradientApproachNadavHallak1PanayotisMertikopoulos2VolkanCevher3Abstractproblems,andtheycanadapttodifferentmeasuresofregretunderdifferen...
MARINA:FasterNon-convexDistributedLearningwithCompressionEduardGorbunov123KonstantinBurlachenko3ZhizeLi3PeterRichta´rik3AbstractmentofnewefficientmethodsforNon-convexoptimizationproblems(Danilovae...
LeveragingNon-uniformityinFirst-orderNon-convexOptimizationJinchengMei12YueGao1BoDai2CsabaSzepesva´ri31DaleSchuurmans21Abstractinreinforcementlearning(RL)(Agarwaletal.,2020),super-Classicalglobalc...
AValue-Function-basedInterior-pointMethodforNon-convexBi-levelOptimizationRishengLiu123XuanLiu12XiaomingYuan4ShangzhiZeng4JinZhang56Abstractaremainlydividedintotwotypes,forinstance,hyper-parameters...
AHybridVariance-ReducedMethodforDecentralizedStochasticNon-convexOptimizationRanXin1UsmanA.Khan2SoummyaKar1Abstractistosolve,vialocalcomputationandcommunication,thefollowingoptimizationproblem:This...
StochasticOptimizationforNon-convexInf-ProjectionProblemsYanYan1YiXu2LiijunZhang3XiaoyuWang4TianbaoYang1AbstractX→Rmisalower-semicontinuousdifferentiablemapping,and·,·istheinnerproduct.Therequir...
OracleEfficientPrivateNon-convexOptimizationSethNeel1AaronRoth2GiuseppeVietri3ZhiweiStevenWu3Abstractandaparameterw∈W:argminwL(D,w).Thisgeneralclassofproblemsincludesclassicalempiricalriskminimiza...
Non-convexLearningviaReplicaExchangeStochasticGradientMCMCWeiDeng1QiFeng2LiyaoGao1FamingLiang1GuangLin1AbstractinDNNsbyinjectingnoisestostochasticgradients.Sincethen,varioushigh-orderSGMCMCalgorith...
IPBoost–Non-convexBoostingviaIntegerProgrammingMarcPfetsch1SebastianPokutta2Abstractdescent.Boostingschemesofthistypeareoftenreferredtoasconvexpotentialboosters.TheseprocedurescanachieveRecentlyno...
InertialBlockProximalMethodsForNon-convexNon-SmoothOptimizationLeThiKhanhHien1NicolasGillis1PanagiotisPatrinos2Abstractbutpossiblynon-smoothNon-convexfunction,andr(x)=Weproposeinertialversionsofblo...
ASampleComplexitySeparationbetweenNon-convexandConvexMeta-LearningNikunjSaunshi1YiZhang1MikhailKhodak2SanjeevArora13Abstractcomplexityofanunseenbutrelatedtesttask.Althoughthereisalonghistoryofsucce...
SimpleStochasticGradientMethodsforNon-SmoothNon-convexRegularizedOptimizationMichaelR.Metel1AkikoTakeda12Abstractwherefj(w)=F(w,ξj)andhasaLipschitzcontinuousgradient.Ourworkfocusesonstochasticgrad...
ScreeningRulesforLassowithNon-convexSparseRegularizersAlainRakotomamonjy12GillesGasso1JosephSalmon3AbstractWhiletheLassohashadagreatimpactonmachinelearn-ingandsignalprocessingcommunitiesgivensomesu...
Katalyst:BoostingConvexKatyushaforNon-convexProblemswithaLargeConditionNumberZaiyiChen12YiXu3HaoyuanHu1TianbaoYang3AbstractwhereeachfiisaL-smoothfunction,andψ(x)isa“sim-ple”closedconvexfunctionw...
DifferentiallyPrivateEmpiricalRiskMinimizationwithNon-convexLossFunctionsDiWang1ChangyouChen1JinhuiXu1Abstractsultsobtainedfromsensitivedatasothatthedistributionoftheperturbedresultsisinsensitiveto...
SIGNSGD:CompressedOptimisationforNon-convexProblemsJeremyBernstein12Yu-XiangWang23KamyarAzizzadenesheli4AnimaAnandkumar12AbstractAlgorithm1SIGNSGDTraininglargeneuralnetworksrequiresdistribut-Input:...
Non-convexConditionalGradientSlidingChaoQu1YanLi2HuanXu2AbstractBesidesthisgeneralform,wealsoconsiderastochasticWeinvestigateaprojectionfreeoptimizationsettingandafinite-sumsetting.Inthestochastics...
ConvergenceguaranteesforaclassofNon-convexandnon-smoothoptimizationproblemsKoulikKhamaru1MartinJ.Wainwright12Abstractwellasreferencestherein.Accordingly,recentyearshavewitnessedanexplosionofresearc...