Positive-Negative Momentum Manipulating Stochastic Gradient Noise to Improve Generalization

Positive-NegativeMomentum:ManipulatingStochasticGradientNoisetoImproveGeneralizationZekeXie1LiYuan2ZhanxingZhu3MasashiSugiyama41AbstractItiswell-knownthatstochasticgradientnoise(SGN)instochasticopt...