On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization

OntheLinearSpeedupAnalysisofCommunicationEfficientMomentumSGDforDistributedNon-ConvexOptimizationHaoYu1RongJin1SenYang1Abstractwherefi(x)=E⇠i⇠Di[Fi(x;⇠i)]aresmoothnon-convexfunctionswithpossibly...