Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers

DescendingthroughaCrowdedValley—BenchmarkingDeepLearningOptimizersRobinM.Schmidt1FrankSchneider1PhilippHennig12Abstract1.IntroductionChoosingtheoptimizerisconsideredtobeamongLarge-scalestochastico...