UnsupervisedRepresentationLearningviaNeuralActivationCodingYookoonPark1SanghoLee2GunheeKim2DavidM.Blei1Abstract(a)Atinitialization(b)AfterNACtrainingWepresentneuralActivationcoding(NAC)asaFigure1.D...
InducingandExploitingActivationSparsityforFastNeuralNetworkInferenceMarkKurtz1JustinKopinsky1RatiGelashvili1AlexanderMatveev1JohnCarr1MichaelGoin1WilliamLeiserson1SageMoore1BillNell1NirShavit1DanAl...
OntheImpactoftheActivationFunctiononDeepNeuralNetworksTrainingSoufianeHayou1ArnaudDoucet1JudithRousseau1Abstractobtainedsimilarresultsusingatopologicalmeasureofex-pressiveness.Theweightinitializati...
FastParametricLearningwithActivationMemorizationJackWRae12ChrisDyer1PeterDayan3TimothyPLillicrap12Abstractspondtoagivenclass.Whentrainedwithasupervisedloss,suchascross-entropy,eachstepofgradientdes...
LearningImportantFeaturesThroughPropagatingActivationDifferencesAvantiShrikumar1PeytonGreenside1AnshulKundaje1Abstracttionallygivingseparateconsiderationtotheeffectsofposi-tiveandnegativecontributi...