ActNN Reducing Training Memory Footprint via 2-Bit Activation Compressed Training

ActNN:ReducingTrainingMemoryFootprintvia2-BitActivationCompressedTrainingJianfeiChen1LianminZheng1ZheweiYao1DequanWang1IonStoica1MichaelW.Mahoney1JosephE.Gonzalez1AbstractTrainingThroughput60L0L1L3...