ThinkGlobalandActLocal:BayesianOptimisationoverHigh-DimensionalCategoricalandMixedSearchSpacesXingchenWan1VuNguyen2HuongHa3BinxinRu1CongLu1MichaelA.Osborne1Abstractlow-dimensionalnorcontinuous:many...
LearningbyTurning:NeuralArchitectureAwareOptimisationYangLiu1JeremyBernstein2MarkusMeister2YisongYue2AbstractThisobservationmotivatesthecombinedstudyofarchi-tectureandOptimisation,andthispaperexplo...
BayesianOptimisticOptimisationwithExponentiallyDecayingRegretHungTran-The1SunilGupta1SantuRana1SvethaVenkatesh1AbstracttransformaglobalOptimisationproblemintoasequenceofauxiliaryOptimisationproblem...
Real-TimeOptimisationforOnlineLearninginAuctionsLorenzoCroissant1MarcAbeille1Cle´mentCalauze`nes1Abstractcommonlyacceptedcompromisebetweenoptimalityandtractability.Theyprovidea2-approximation(Roug...
BayesianOptimisationoverMultipleContinuousandCategoricalInputsBinxinRu∗1AhsanS.Alvi∗1VuNguyen1MichaelA.Osborne1StephenJRoberts1AbstractForexample,withadeepneuralnetwork,wemaywanttoadjustthelearni...
FingerprintPolicyOptimisationforRobustReinforcementLearningSupratikPaul1MichaelA.Osborne2ShimonWhiteson1Abstractacrossallpossiblesettings.Fortunately,policiescanoftenbetrainedandtestedinasimulatort...
AsynchronousBatchBayesianOptimisationwithImprovedLocalPenalisationAhsanS.Alvi12BinxinRu1JanCalliess13StephenJ.Roberts123MichaelA.Osborne12Abstractexample,considertheOptimisationofthenumberofunitsin...
SIGNSGD:CompressedOptimisationforNon-ConvexProblemsJeremyBernstein12Yu-XiangWang23KamyarAzizzadenesheli4AnimaAnandkumar12AbstractAlgorithm1SIGNSGDTraininglargeneuralnetworksrequiresdistribut-Input:...
FastInformation-theoreticBayesianOptimisationBinxinRu1MarkMcLeod1DiegoGranziol1MichaelA.Osborne12Abstractofproblemsaregenerallynon-convexandtheirclosed-formexpressionsandderivativesareunknown(Shahr...
PracticalGauss-NewtonOptimisationforDeepLearningAleksandarBotev1HippolytRitter1DavidBarber12Abstractthegradientsatthecurrentsettingoftheparameterswithvariousheuristicestimatesofthecurvaturefromprev...
Multi-fidelityBayesianOptimisationwithContinuousApproximationsKirthevasanKandasamy1GautamDasarathy2JeffSchneider1Barnaba´sPo´czos1AbstractTypically,insuchapplications,eachfunctionevaluationisexpe...