Dropout:ExplicitFormsandCapacityControlRamanArora1PeterBartlett2PooryaMianjy1NathanSrebro3Abstracttion(Cavazzaetal.,2018;Mianjyetal.,2018),intwolayerlinearnetworks(Mianjyetal.,2018),andindeeplinear...
LandscapeConnectivityandDropoutStabilityofSGDSolutionsforOver-parameterizedNeuralNetworksAlexanderShevchenko1MarcoMondelli1Abstractanover-parameterizednetworkviaSGDtypicallyleadstoasolutionthathass...
InformativeDropoutforRobustRepresentationLearning:AShape-biasPerspectiveBaifengShi1DinghuaiZhang2QiDai3ZhanxingZhu245YadongMu6JingdongWang3AbstractFigure1.Comparisonofdifferentshape-biasedmethods.(...
OnDropoutandNuclearNormRegularizationPooryaMianjy1RamanArora1Abstractislinear,therepresentationinfactoredformmakestheop-timizationlandscapenon-convexandhence,challengingWegiveaformalandcompletechar...
Jumpout:ImprovedDropoutforDeepNeuralNetworkswithReLUsShengjieWang1TianyiZhou1JeffA.Bilmes2Abstractperfectly,resultinginanoverfittingproblemandtherebyweakeningthegeneralizationperformanceonunseendat...
DropoutasaStructuredShrinkagePriorEricNalisnick1JoséMiguelHernández-Lobato123PadhraicSmyth4AbstractexplainDropout’sinner-workingsandsuccessarealsoplen-tiful.Togiveafewexamples,Srivastavaetal.(20...
DemystifyingDropoutHongchangGao12JianPei34HengHuang12Abstractnetworksinvarioustasks.Dropoutisapopulartechniquetotrainlarge-scaleInspiredbythegoodperformanceofDropout,anumberdeepneuralnetworkstoalle...
DropoutTraining,Data-dependentRegularization,andGeneralizationBoundsWenlongMou1YuchenZhou2JunGao3LiweiWang34AbstractexperimentalstudieshaveshowntheregularizationeffectincurredbyDropout,asthegapbetw...
VariationalDropoutSparsifiesDeepNeuralNetworksDmitryMolchanov12ArseniiAshukha34DmitryVetrov31Abstractprobabilitiesofdroppinganeuron.TheDropoutratesaretypicallyoptimizedusinggridsearch.Toavoidtheex-...
DropoutInferenceinBayesianNeuralNetworkswithAlpha-divergencesYingzhenLi1YarinGal12Abstractinformationcanbeused,forexample,toidentifywhenavi-sionmodelisgivenanadversarialimage(studiedbelow),Toobtain...