A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks

ATail-IndexAnalysisofStochasticGradientNoiseinDeepNeuralNetworksUmutS¸ims¸ekli1LeventSagun2MertGu¨rbu¨zbalaban3Abstractmanyapplicationdomains(LeCunetal.,2015;Krizhevskyetal.,2012;Hintonetal.,20...