DescendingthroughaCrowdedValley—BenchmarkingDeepLearningOptimizersRobinM.Schmidt1FrankSchneider1PhilippHennig12Abstract1.IntroductionChoosingtheoptimizerisconsideredtobeamongLarge-scalestochastico...
OptimizerBenchmarkingNeedstoAccountforHyperparameterTuningPrabhuTejaS12FlorianMai12ThijsVogels2MartinJaggi2FrançoisFleuret12Abstractchoiceofhyperparametervaluessuchasthelearningrate.Inthemachinele...