RatesofConvergenceforSparseVariationalGaussianProcessRegressionDavidR.Burt1CarlEdwardRasmussen12MarkvanderWilk2AbstractWhilethecomputationalcostofaddinginducingvariablesiswellunderstood,resultsonho...
PROVEN:VerifyingRobustnessofNeuralNetworkswithaProbabilisticApproachTsui-WeiWeng1Pin-YuChen2LamM.Nguyen2MarkS.Squillante2AkhilanBoopathy1IvanOseledets3LucaDaniel1Abstractdevelopingeffectivecounterm...
PopulationBasedAugmentation:EfficientLearningofAugmentationPolicySchedulesDanielHo12EricLiang1IonStoica1PieterAbbeel13XiChen13AbstractBaselineAutoAugmentPopulationBasedAugmentation4Akeychallengeinl...
POPQORN:QuantifyingRobustnessofRecurrentNeuralNetworksChing-YunKo1ZhaoyangLyu2Tsui-WeiWeng3LucaDaniel3NgaiWong1DahuaLin2Abstractlini&Wagner,2018).Asmallperturbationthathumansaremostlyimmunetocanbec...
ParameterEfficientTrainingofDeepConvolutionalNeuralNetworksbyDynamicSparseReparameterizationHeshamMostafa1XinWang12Abstract1.IntroductionModerndeepneuralnetworksaretypicallyhighlyDeepneuralnetworks...
PA-GD:OntheConvergenceofPerturbedAlternatingGradientDescenttoSecond-OrderStationaryPointsforStructuredNonconvexOptimizationSongtaoLu1MingyiHong1ZhengdaoWang2AbstractTherearemanywaysofsolvingproblem...
PACLearnabilityofNodeFunctionsinNetworkedDynamicalSystemsAbhijinAdiga1ChrisJ.Kuhlman1MadhavV.Marathe12S.S.Ravi13AnilK.Vullikanti12Abstract(Beietal.,2016;Kleinbergetal.,2017;Adigaetal.,2018).Weconsi...
PACIdentificationofManyGoodArmsinStochasticMulti-ArmedBanditsArghyaRoyChaudhuri1ShivaramKalyanakrishnan1Abstractdecision,whichproducesareal-valuedreward.Therewardisdrawni.i.d.fromadistributioncorre...
OptimalKronecker-SumApproximationofRealTimeRecurrentLearningFrederikBenzing1MarceloMatheusGauy1AsierMujika1AndersMartinsson1AngelikaSteger1Abstractachievednotablesuccesses.However,fewimprovementsha...
OnVariationalBoundsofMutualInformationBenPoole1SherjilOzair12Aa¨ronvandenOord3AlexanderA.Alemi1GeorgeTucker1AbstractFigure1.Schematicofvariationalboundsofmutualinformationpresentedinthispaper.Node...
OntheUniversalityofInvariantNetworksHaggaiMaron1EthanFetaya23NimrodSegol1YaronLipman1AbstractwithrespecttosomegroupGwillbereferredhereasG-invariantnetworks.Constraininglinearlayersinneuralnetworkst...
Onthestatisticalrateofnonlinearrecoveryingenerativemodelswithheavy-taileddataXiaohanWei1ZhuoranYang2ZhaoranWang3Abstract1.IntroductionWeconsiderestimatingahigh-dimensionalvec-Considerarandompair(x,...
OntheLong-termImpactofAlgorithmicDecisionPolicies:EffortUnfairnessandFeatureSegregationthroughSocialLearningHodaHeidari1VedantNanda2KrishnaP.Gummadi2AbstractThisrealizationhasrecentlyspawnedanactiv...
OnThePowerofCurriculumLearninginTrainingDeepNetworksGuyHacohen12DaphnaWeinshall1Abstracttypicallyreflectstheircomplexity.Thestudentisthengrad-uallyintroducedtotheseconceptsbyincreasingcomplexity,Tr...
OntheLinearSpeedupAnalysisofCommunicationEfficientMomentumSGDforDistributedNon-ConvexOptimizationHaoYu1RongJin1SenYang1Abstractwherefi(x)=E⇠i⇠Di[Fi(x;⇠i)]aresmoothnon-convexfunctionswithpossibly...
OntheLimitationsofRepresentingFunctionsonSetsEdwardWagstaff1FabianB.Fuchs1MartinEngelcke1IngmarPosner1MichaelOsborne1AbstractInputOutputRecentworkontherepresentationoffunctionsϕ+ρf(x1,…,xM)onset...
OntheImpactoftheActivationFunctiononDeepNeuralNetworksTrainingSoufianeHayou1ArnaudDoucet1JudithRousseau1Abstractobtainedsimilarresultsusingatopologicalmeasureofex-pressiveness.Theweightinitializati...
OntheConvergenceandRobustnessofAdversarialTrainingYisenWang1XingjunMa2JamesBailey2JinfengYi1BowenZhou1QuanquanGu3Abstract2018),theyarevulnerabletoadversarialexamplescraftedbyaddingsmall,humanimperc...
OntheFeasibilityofLearning,RatherthanAssuming,HumanBiasesforRewardInferenceRohinShah1NoahGundotra1PieterAbbeel1AncaD.Dragan1Abstractp(as)µebQ(s,a;r)w!Ourgoalisforagentstooptimizetherightre-wwardfu...