Quasi-global Momentum Accelerating Decentralized Deep Learning on Heterogeneous Data

Quasi-globalMomentum:AcceleratingDecentralizedDeepLearningonHeterogeneousDataTaoLin1SaiPraneethKarimireddy1SebastianU.Stich1MartinJaggi1Abstractiskeptlocally(nevertransmittedduringtraining).Decentr...