Boosting the Throughput and Accelerator Utilization of Specialized CNN Inference Beyond Increasing Batch Size

BoostingtheThroughputandAcceleratorUtilizationofSpecializedCNNInferenceBeyondIncreasingBatchSizeJackKosaian1AmarPhanishayee2MatthaiPhilipose2DebadeeptaDey2K.V.Rashmi1AbstractHsiehetal.,2018;Kangeta...