OnthePredictabilityofPruningAcrossScalesJonathanRosenfeld1JonathanFrankle1MichaelCarbin1NirShavit1AbstractAsafirsttry,wecouldattempttoanswerthisquestionusingbruteforce:wecouldpruneeverymemberofanet...
GroupFisherPruningforPracticalNetworkCompressionLiyangLiu1ShilongZhang2ZhanghuiKuang3AojunZhou3Jing-HaoXue4XinjiangWang3YiminChen3WenmingYang1QingminLiao1WayneZhang235Abstract78OursOursOursAOFPNetw...
AccelerateCNNsfromThreeDimensions:AComprehensivePruningFrameworkWenxiaoWang12MinghaoChen1ShuaiZhao1LongChen34JinmingHu1HaifengLiu1DengCai1XiaofeiHe1WeiLiu2Abstract57MostneuralnetworkPruningmethods,...
AProbabilisticApproachtoNeuralNetworkPruningXinQian1DiegoKlabjan1AbstractcalledtheLotteryTicketHypothesis(LTH).Ramanujanetal.(2020)furtherconjecturethat,asufficientlyover-NeuralnetworkPruningtechni...
ProvingtheLotteryTicketHypothesis:PruningisAllYouNeedEranMalach1GiladYehudai2ShaiShalev-shwartz1OhadShamir2Abstractwithoutanytraining.(Ramanujanetal.,2019)statedthefol-lowingconjecture:asufficientl...
Operation-AwareSoftChannelPruningusingDifferentiableMasksMinsooKang1BohyungHan1AbstractNotUpdated1.00.0UpdatedstrongweakBinaryMasksFeatureMapWeproposeasimplebuteffectivedata-drivenDifferentiableMas...
GoodSubnetworksProvablyExist:PruningviaGreedyForwardSelectionMaoYe1ChengyueGong1LizhenNie2DennyZhou3AdamKlivans1QiangLiu1Abstractachievinghuman-levelaccuracyoncomplexcognitivetasks,includingimagecl...
AdversarialNeuralPruningwithLatentVulnerabilitySuppressionDivyamMadaan1JinwooShin23SungJuHwang134Abstractever,DNNsareextremelybrittletocarefullycraftedimper-ceptibleadversarialperturbationsintentio...
EigenDamage:StructuredPruningintheKronecker-FactoredEigenbasisChaoqiWang12RogerGrosse12SanjaFidler123GuodongZhang12AbstractOriginalWeightspaceinput(32x32x512)Reducingthetesttimeresourcerequirements...
CollaborativeChannelPruningforDeepNetworksHanyuPeng1JiaxiangWu2ShifengChen1JunzhouHuang3AbstractTherearealargecollectionofresearchpapersfocusingonacceleratingandcompressingdeepnetworkstoimprovetheD...
ApproximatedOracleFilterPruningforDestructiveCNNWidthOptimizationXiaohanDing1GuiguangDing1YuchenGuo1JungongHan2ChenggangYan3Abstractincludestheusageofnon-linearities(ReLU,sigmoidornone),downsamplin...