Quasi-GlobalMomentum:AcceleratingDecentralizedDeepLearningonHeterogeneousDataTaoLin1SaiPraneethKarimireddy1SebastianU.Stich1MartinJaggi1Abstractiskeptlocally(nevertransmittedduringtraining).Decentr...
OpeningtheBlackbox:AcceleratingNeuralDifferentialEquationsbyRegularizingInternalSolverHeuristicsAvikPal12YingboMa2ViralShah2ChristopherRackauckas2345AbstractFigure1.TrainingandPredictionPerformance...
GraphNorm:APrincipledApproachtoAcceleratingGraphNeuralNetworkTrainingTianleCai12ShengjieLuo345KeyuluXu6DiHe7Tie-YanLiu7LiweiWang34Abstract2017).Empirically,GNNshavesucceededinavarietyoftaskssuchasc...
AcceleratingSafeReinforcementLearningwithConstraint-mismatchedBaselinePoliciesTsung-YenYang1JustinianRosca2KarthikNarasimhan1PeterJ.Ramadge1Abstractorothercosts.Forinstance,whenyoudriveanunfamiliar...
AcceleratingGossipSGDwithPeriodicGlobalAveragingYimingChen1KunYuan1YingyaZhang1PanPan1YinghuiXu1WotaoYin1AbstractMETHODEPOCHACC.%TIME(HRS.)CommunicationoverheadhindersthescalabilityPARALLELSGD12076...
AcceleratingFeedforwardComputationviaParallelNonlinearEquationSolvingYangSong1ChenlinMeng1RenjieLiao23StefanoErmon1Abstractaregeneratedinsequenceonebyone.Becauseofthein-herentlysequentialnature,iti...
PoWER-BERT:AcceleratingBERTInferenceviaProgressiveWord-vectorEliminationSaurabhGoyal1AnamitraRoyChoudhury1SaurabhM.Raje1VenkatesanT.Chakaravarthy1YogishSabharwal1AshishVerma2Abstractapplicationsran...
GenerativeTeachingNetworks:AcceleratingNeuralArchitectureSearchbyLearningtoGenerateSyntheticTrainingDataFelipePetroskiSuch1AdityaRawal1JoelLehman1KennethO.Stanley1JeffClune12Abstract1.Introductiona...
Acceleratingthediffusion-basedensemblesamplingbynon-reversibledynamicsFutoshiFutami12IsseiSato12MasashiSugiyama21AbstractMurphy,2012).Formanypracticalmodels,wecannotob-tainananalyticalexpressionoft...
AcceleratingLarge-ScaleInferencewithAnisotropicVectorQuantizationRuiqiGuo1PhilipSun1ErikLindgren1QuanGeng1DavidSimcha1FelixChern1SanjivKumar1Abstract(MIPS)problem,consideradatabaseX={xi}i=1,2,...,n...
UnderstandingandAcceleratingParticle-BasedVariationalInferenceChangLiu1JingweiZhuo1PengyuCheng2RuiyiZhang2JunZhu1LawrenceCarin2Abstractmethods(Geman&Geman,1987;Nealetal.,2011;Welling&Teh,2011;Dinge...
ExploringHiddenDimensionsinParallelizingConvolutionalNeuralNetworksZhihaoJia1SinaLin2CharlesR.Qi1AlexAiken1Abstracteachdevice.Anothercommonapproachismodelparal-lelism(Mirhoseinietal.,2017;Kimetal.,...
DissipativityTheoryforAcceleratingStochasticVarianceReduction:AUnifiedAnalysisofSVRGandKatyushaUsingSemidefiniteProgramsBinHu1StephenWright1LaurentLessard1AbstractMonro,1951;Bottou&LeCun,2003).Rece...
AcceleratingNaturalGradientwithHigher-OrderInvarianceYangSong1JiamingSong1StefanoErmon1Abstractetal.,2013),andfirst-ordermethodswillhavetroubleinmakingprogress.Thecurvature,however,dependsonhowAnap...
AcceleratingGreedyCoordinateDescentMethodsHaihaoLu1RobertM.Freund2VahabMirrokni3Abstractsentiallyrecoverthesameresults(inexpectation)asfullgradientdescent,includingobtaining“accelerated”(i.e.,Wei...
AcceleratingEulerianFluidSimulationWithConvolutionalNetworksJonathanTompson1KristoferSchlachter2PabloSprechmann23KenPerlin2AbstractThedynamicsofalargenumberofphysicalphenomenonaregovernedbytheincom...