The Shattered Gradients Problem If resnets are the answer, then what is the question

TheShatteredGradientsProblem:Ifresnetsaretheanswer,thenwhatisthequestion?DavidBalduzzi1MarcusFrean1LennoxLeary1JPLewis12KurtWan-DuoMa1BrianMcWilliams3AbstractHeetal.,2015)withbatchnormalization(Iof...