Weight-CovarianceAlignmentforAdversariallyRobustNeuralNetworksPanagiotisEustratiadis1HenryGouk1DaLi12TimothyHospedales12Abstract2013).Inordertotacklethisproblem,manyadversarialdefensealgorithmshave...
WatermarkingDeepNeuralNetworkswithGreedyResidualsHanwenLiu1ZhenyuWeng1YueshengZhu1Abstractandprivacyissues(Shokrietal.,2017;Songetal.,2017;Salemetal.,2019),andthusthemodelsareconsideredtoDeepneural...
TrainingRecurrentNeuralNetworksviaForwardPropagationThroughTimeAnilKag1VenkateshSaligrama1Abstractempiricalriskfunction:Back-propagationthroughtime(BPTT)hasbeen[W∗,v∗]=argminL(W,v)=1NT(yi,yˆti)w...
TrainingQuantizedNeuralNetworkstoGlobalOptimalityviaSemidefiniteProgrammingBurakBartan1MertPilanci1Abstractdimensionsusingsemidefiniteprogramming(Bartan&Pi-lanci,2021).Inthiswork,wetakeasimilarconv...
TrainingGraphNeuralNetworkswith1000LayersGuohaoLi12MatthiasMu¨ller1BernardGhanem2VladlenKoltun1AbstractRevGNN-WideResGNN-224DeepgraphneuralNetworks(GNNs)have88achievedexcellentresultsonvarioustask...
TrainingAdversariallyRobustSparseNetworksviaBayesianConnectivitySamplingOzanO¨zdenizci12RobertLegenstein1AbstractSeminalworkby(Szegedyetal.,2013)showedthatsuchadversarialexamplescanbecreatedviaper...
TowardsUnderstandingLearninginNeuralNetworkswithLinearTeachersRoeiSarussi1AlonBrutzkus1AmirGloberson1Abstractwillseparatethedata.Whichofthesewillbefoundbygradientdescent?Cananeuralnetworkminimizing...
TowardsCertifying∞RobustnessusingNeuralNetworkswith∞-distNeuronsBohangZhang1TianleCai23ZhouLu4DiHe5LiweiWang16Abstract1.IntroductionItiswell-knownthatstandardneuralNetworks,ModernneuralNetworksar...
StructuredConvolutionalKernelNetworksforAirlineCrewSchedulingYassineYaakoubi12FrançoisSoumis1SimonLacoste-Julien†23Abstractlarge-scalemonthlyCPPs(upto50,000flights)andbuild-ingonthecolumngenerati...
SparsifyingNetworksviaSubdifferentialInclusionSagarVerma1Jean-ChristophePesquet1Abstracthumancapabilities,neuralNetworksmayremaindifficulttoapplyinreal-worldscenarios.DeepneuralNetworksSparsifyingd...
SiameseXML:SiameseNetworksmeetExtremeClassifierswith100MLabelsKunalDahiya1AnanyeAgarwal1DeepakSaini2GururajK3JianJiao3AmitSingh3SumeetAgarwal1PurushottamKar42ManikVarma21Abstractdescriptionse.g.,pr...
ScalingPropertiesofDeepResidualNetworksAlain–SamCohen1RamaCont2AlainRossier21RenyuanXu2Abstractwhereh(kL)isthehiddenstateatlayerk=0,...,L,h(0L)=x∈Rdtheinput,h(LL)∈Rdtheoutput,σ:R→Risanon-Resid...
RevealingtheStructureofDeepNeuralNetworksviaConvexDualityTolgaErgen1MertPilanci1Abstractwheretwo-layerReLUNetworkswiththeminimumEu-clideannormsolutionandzerotrainingerrorareprovenWestudyregularized...
Re-understandingFinite-StateRepresentationsofRecurrentPolicyNetworksMohamadH.Danesh1AnuragKoul1AlanFern1SaeedKhorram1Abstracttivehumaninterpretationoftheunderlying“strategicrole"oftheattended-toel...
Z-GCNETs:TimeZigzagsatGraphConvolutionalNetworksforTimeSeriesForecastingYuzhouChen12IgnacioSegovia-Dominguez34YuliaR.Gel32Abstract1.IntroductionThererecentlyhasbeenasurgeofinterestinde-Manyrealworl...
WhittleNetworks:ADeepLikelihoodModelforTimeSeriesZhongjieYu1FabrizioVentola1KristianKersting12Abstract2015).Consider,e.g.,thestockpricechangesofindus-trialsectorsshowninFig.1(Left).Thedropinlate201...
ProvableGeneralizationofSGD-trainedNeuralNetworksofAnyWidthinthePresenceofAdversarialLabelNoiseSpencerFrei1YuanCao2QuanquanGu2AbstractdefineWeconsideraone-hidden-layerleakyReLUnet-OPT:=minP(x,y)∼D...
Privacy-PreservingVideoClassificationwithConvolutionalNeuralNetworksSikhaPentyala1RafaelDowsley2MartineDeCock13AbstractMeinich-Bacheetal.,2020;Pengetal.,2020;Shahetal.,2019;Wuetal.,2019).Manyexisti...
PrincipledSimplicialNeuralNetworksforTrajectoryPredictionT.MitchellRoddenberry1NicholasGlaze1SantiagoSegarra1Abstractintheirabilitytoincorporatearbitrarypairwiserelationalstructuresintheircomputati...
PHEW:ConstructingSparseNetworksthatLearnFastandGeneralizeWellWithoutTrainingDataShreyasMalakarjunPatil1ConstantineDovrolis1Abstracterally,suchmethodsuseanedgescoringmechanismforeliminatingthelessim...