StochasticGauss-NewtonAlgorithmsforNonconvexCompositionalOptimizationQuocTran-Dinh1NhanH.Pham1LamM.Nguyen2Abstractandnpi=1,thenbyintroductingFi(x):=i=1WedeveloptwonewstochasticGauss-Newtonalgorithm...
PracticalGauss-NewtonOptimisationforDeepLearningAleksandarBotev1HippolytRitter1DavidBarber12Abstractthegradientsatthecurrentsettingoftheparameterswithvariousheuristicestimatesofthecurvaturefromprev...
