TheHeavy-TailPhenomenoninSGDMertGürbüzbalaban1UmutS¸ims¸ekli2LingjiongZhu3Abstract1.IntroductionInrecentyears,variousnotionsofcapacityandThelearningprobleminneuralnetworkscanbeexpressedascomple...