MARINA:FasterNon-ConvexDistributedLearningwithCompressionEduardGorbunov123KonstantinBurlachenko3ZhizeLi3PeterRichta´rik3Abstractmentofnewefficientmethodsfornon-convexoptimizationproblems(Danilovae...
FasterKernelMatrixAlgebraviaDensityEstimationArtursBackurs1PiotrIndyk2CameronMusco3TalWagner4Abstractetal.(2008)foranoverview.Westudyfastalgorithmsforcomputingfunda-Kernelmethodstypicallyoperateusi...
EfficientNetV2:SmallerModelsandFasterTrainingMingxingTan1QuocV.Le1AbstractEffNetV2-XL(21k)87ThispaperintroducesEfficientNetV2,anewfam-ilyofconvolutionalnetworksthathaveFasterL(21k)trainingspeedandb...
“Hey,that’snotanODE”:FasterODEAdjointsviaSeminormsPatrickKidger12RickyT.Q.Chen34TerryLyons12AbstractarecomposedsuchthatNeuraldifferentialequationsmaybetrainedz(τ)=1(x,φ),bybackpropagatinggradi...
StrongerandFasterWassersteinAdversarialAttacksKaiwenWu12AllenHouzeWang12YaoliangYu12Abstract✏=0.05✏=0.10✏=0.20✏=0.40Deepmodels,whilebeingextremelyflexibleand`1accurate,aresurprisinglyvulnerable...
FasterGraphEmbeddingsviaCoarseningMatthewFahrbach1GramozGoranci2RichardPeng3SushantSachdeva2ChiWang4AbstractWhilesomeofthesegraphembeddingapproachesareex-plicitlybasedonmatrix-factorization(Tang&Li...
ExtragradientwithplayersamplingforFasterNashequilibriumfindingSamyJelassi1CarlesDomingo-Enrich2DamienScieur3ArthurMensch42JoanBruna2Abstractvexn-playergames,forwhichNashequilibriaexist(Rosen,1965)....
CanStochasticZeroth-OrderFrank-WolfeMethodConvergeFasterforNon-ConvexProblems?HongchangGao1HengHuang12Abstractwhere⌦⇢Rddenotesaclosedconvexfeasibleset,eachcomponentfunctionfiissmoothandnon-convex...
First-OrderAlgorithmsConvergeFasterthanO(1/k)onConvexProblemsChing-peiLee1StephenJ.Wright1Abstract(3)reliesonshowingthatItiswellknownthatbothgradientdescentandkstochasticcoordinatedescentachieveagl...
FasterStochasticAlternatingDirectionMethodofMultipliersforNonconvexOptimizationFeihuHuang1SongcanChen23HengHuang14Abstract1.IntroductionInthispaper,weproposeaFasterstochasticalter-Alternatingdirect...
FasterAttend-Infer-RepeatwithTractableProbabilisticModelsKarlStelzner1RobertPeharz2KristianKersting13AbstractRecently,deepneuralgenerativemodelssuchasvariationalautoencoders(VAEs)(Kingma&Welling,20...
FasterAlgorithmsforBinaryMatrixFactorizationRaviKumar1RinaPanigrahy1AliRahimi1DavidP.Woodruff2AbstractproximationisFrobeniusnormerror,whereoneseekstofindWegiveFasterapproximationalgorithmsforwell-U...
TowardsMoreEfficientStochasticDecentralizedLearning:FasterConvergenceandSparseCommunicationZebangShen12AryanMokhtari3TengfeiZhou1PeilinZhao4HuiQian1Abstractvariableofnoden,theproblemofinterestisRec...
MatrixNormsinDataStreams:Faster,Multi-PassandRow-OrderVladimirBraverman1StephenChestnut2RobertKrauthgamer3YiLi4DavidWoodruff5LinYang6Abstracturalorder(sortedwithiastheprimarykey,andjasthesec-ondary...
FasterDerivative-FreeStochasticAlgorithmforSharedMemoryMachinesBinGu1ZhouyuanHuo1ChengDeng2HengHuang12Abstractsianmatrixoritsapproximations)oftheobjectivefunction.Forexample,Hogwild!(Rechtetal.,201...
StochasticConvexOptimization:FasterLocalGrowthImpliesFasterGlobalConvergenceYiXu1QihangLin2TianbaoYang1Abstract1.IntroductionInthispaper,anewtheoryisdevelopedforfirst-Inthispaper,weareinterestedins...
ReducedSpaceandFasterConvergenceinImperfect-InformationGamesviaPruningNoamBrown1TuomasSandholm1AbstractwasusedtoessentiallysolveLimitTexasHold’em,thelargestimperfect-informationgameevertobeessenti...
Natasha:FasterNon-ConvexStochasticOptimizationviaStronglyNon-ConvexParameterZeyuanAllen-Zhu1Abstractrandom∇fi(x).Givenanon-convexfunctionf(x)thatisanav-•Theso-calledproximaltermψ(x)addsmoregener...
FollowtheCompressedLeader:FasterOnlineLearningofEigenvectorsandFasterMMWUZeyuanAllen-Zhu1YuanzhiLi2Abstractsymmetricandsatisfies0AkI.1Boththeseassump-tionsareforthesakeofsimplicityandcanberelaxed.2...
FasterPrincipalComponentRegressionandStableMatrixChebyshevApproximationZeyuanAllen-Zhu1YuanzhiLi2AbstracttasksofPCPandPCRbecometrivialbecausetheprojec-tionmatrixcanbeconstructedexplicitly.Wesolvepr...