Understanding and correcting pathologies in the training of learned optimizers

UnderstandingandcorrectingpathologiesinthetrainingoflearnedoptimizersLukeMetz1NiruMaheswaranathan1JeremyNixon1C.DanielFreeman1JaschaSohl-Dickstein1Abstractperparametersearch.Ontheotherhand,acomplem...