StructuredVariationallyAuto-encodedOptimizationXiaoyuLu1JavierGonzález2ZhenwenDai2NeilD.Lawrence23Abstractwhichmakestheproblemspeciallyhardtotreatasdifferentnetworkconfigurationscannotberepresente...
StagewiseSafeBayesianOptimizationwithGaussianProcessesYananSui1VincentZhuang1JoelW.Burdick1YisongYue1AbstractManyoftheseapplicationsarealsosubjecttoavarietyofsafetyconstraints,sothatactionscannotbe...
Shampoo:PreconditionedStochasticTensorOptimizationVineetGupta1TomerKoren1YoramSinger21AbstractNocedal,1980)thatcanbeusedwheneversecond-orderinformationisunavailableortooexpensivetocompute.Precondit...
Projection-FreeOnlineOptimizationwithStochasticGradient:FromConvexitytoSubmodularityLinChen12ChristopherHarshaw13HamedHassani4AminKarbasi12Abstract1.IntroductionOnlineOptimizationhasbeenasuccessful...
PolicyOptimizationwithDemonstrationsBingyiKang1ZequnJie2JiashiFeng1Abstractonheuristicexplorationstrategies,e.g.,-greedyforvaluebasedmethods(VanHasseltetal.,2016)andnoise-basedExplorationremainsasi...
PolicyOptimizationasWassersteinGradientFlowsRuiyiZhang1ChangyouChen2ChunyuanLi1LawrenceCarin1Abstractwiththeenvironment.PolicyOptimizationisacorecomponentofrein-Astandardtechniqueforpolicylearningi...
Optimization,FastandSlow:OptimallySwitchingbetweenLocalandBayesianOptimizationMarkMcLeod1MichaelA.Osborne12StephenJ.Roberts12AbstractposteriorsproducedbytheGParemultivariateGaussian,soprovidebothth...
OptimizationLandscapeandExpressivityofDeepCNNsQuynhNguyen1MatthiasHein2AbstractTable1.Themaximumwidthofalllayersinseveralstate-of-the-artCNNarchitecturescomparedwiththesizeofImageNetdatasetWeanalyz...
OntheOptimizationofDeepNetworks:ImplicitAccelerationbyOverparameterizationSanjeevArora12NadavCohen2EladHazan13AbstractGiventhelongstandingconsensusonexpressivenessvs.op-timizationtrade-offs,thispap...
NonconvexOptimizationforRegressionwithFairnessConstraintsJunpeiKomiyama1AkikoTakeda12JunyaHonda12HajimeShimao3Abstractindefaultingonloans,directapplicationofmachinelearn-ingalgorithmwouldhighlylike...
Multi-FidelityBlack-BoxOptimizationwithHierarchicalPartitionsRajatSen1KirthevasanKandasamy2SanjayShakkottai1AbstractsimpleregretRn,f(x(n)).Motivatedbysettingssuchashyper-parameterRn=supf(x)tuningan...
Low-RankRiemannianOptimizationonPositiveSemidefiniteStochasticMatriceswithApplicationstoGraphClusteringAhmedDouik1BabakHassibi1overthesetofsymmetricpositivesemidefinitestochas-Abstractticmatrices.S...
Level-SetMethodsforFinite-SumConstrainedConvexOptimizationQihangLin1RunchaoMa1TianbaoYang2AbstractAsolutionx¯∈Xisε-optimaliff0(x¯)−f∗≤εandε-feasibleifmaxi=1,...,m[fi(x¯)−ri]≤ε.Weconsid...
LightweightStochasticOptimizationforMinimizingFiniteSumswithInfiniteDataShuaiZheng1JamesT.Kwok1Abstractiandgaresmoothandconvex.Stochasticgradientde-scent(SGD)(Robbins&Monro,1951)anditsvariantsVaria...
K-BeamMinimax:EfficientOptimizationforDeepAdversarialLearningJihunHamm1Yung-KyunNoh2AbstractTodefinetheproblem,considerareal-valuedfunctionf(u,v)onasubsetU×V⊆Rd×RD.A(continuous)min-Minimaxoptimi...
ImprovingOptimizationforModelsWithContinuousSymmetryBreakingRobertBamler1StephanMandt1AbstractWeakcontinuoussymmetrybreakingleadstoanill-conditionedOptimizationproblem.WhenalossfunctionisManylossfu...
GraphicalNonconvexOptimizationviaanAdaptiveConvexRelaxationQiangSun1KeanMingTan2HanLiu3TongZhang3AbstractdiagonalmatrixwithdiagonalelementsofΣ∗.Itiswellknownthatthejthandkthvariablesareconditiona...
GeodesicConvolutionalShapeOptimizationPierreBaque1EdoardoRemelli1Franc¸oisFleuret21PascalFua1AbstractXtrainFωy(Xtrain)Fωz(Xtrain)AerodynamicshapeOptimizationhasmanyindus-(a)GCNNFωy(Xtest)Fωz(X...
DistributedAsynchronousOptimizationwithUnboundedDelays:HowSlowCanYouGo?ZhengyuanZhou1PanayotisMertikopoulos2NicholasBambos1PeterGlynn1YinyuYe1Li-JiaLi3LiFei-Fei13Abstractcommensuratesurgeofinterest...
CharacterizingImplicitBiasinTermsofOptimizationGeometrySuriyaGunasekar1JasonLee2DanielSoudry3NathanSrebro1Abstractassociatedhyperparametercanchangetheimplicitbias.Forexample,Wilsonetal.(2017)showed...