ComposedFine-Tuning:FreezingPre-TrainedDenoisingAutoencodersforImprovedGeneralizationSangMichaelXie1TengyuMa1PercyLiang1AbstractPre-traineddenoiserWefocusonpredictionproblemswithstructuredoutputsth...
VariationalAutoencoderswithRiemannianBrownianMotionPriorsDimitrisKalatzis1DavidEklund2GeorgiosArvanitidis3SørenHauberg1AbstractFigure1.ThelatentspacepriorsoftwoVAEstrainedonthedigit1fromMNIST.Left...
TopologicalAutoencodersMichaelMoor†12MaxHorn†12BastianRieck‡12KarstenBorgwardt‡12Abstractthefollowingcontributions:Weproposeanovelapproachforpreservingtopo-1.Wedevelopanewtopologicallosstermfor...
PerceptualGenerativeAutoencodersZijunZhang1RuixiangZhang2ZongpengLi3YoshuaBengio2LiamPaull2Abstracteffortshavebeendevotedtoaddressingthesechallenges(Salimansetal.,2016;Arjovskyetal.,2017;GulrajaniM...
LearningAutoencoderswithRelationalRegularizationHongtengXu12DixinLuo2RicardoHenao2SvatiShah2LawrenceCarin2Abstractalatent-variablemodeldenotedpG,specifiedbyapriordistributionpzonlatentcodez∈Zandag...
ForecastingSequentialDataUsingConsistentKoopmanAutoencodersOmriAzencot1N.BenjaminErichson2VanessaLin2MichaelW.Mahoney2Abstractchallengeandmoreover,modelingshort-termdependenciesmightalsobeaffectedd...
EncodingMusicalStylewithTransformerAutoencodersKristyChoi1CurtisHawthorne2IanSimon2MonicaDinculescu2JesseEngel2Abstracttwofold.First,Transformers(Vaswanietal.,2017)andtheirvariantsexcelasunconditio...
EducatingTextAutoencoders:LatentRepresentationGuidanceviaDenoisingTianxiaoShen1JonasMueller2ReginaBarzilay1TommiJaakkola1AbstractFigure1.LatentrepresentationslearnedbyAAEandDAAEwhenmappingclustered...
AssociativeMemoryinIteratedOverparameterizedSigmoidAutoencodersYiboJiang1CengizPehlevan2AbstractWestudyauto-encodersinalimitofneuralnetworksthatmakestheoreticalanalysispossible.Specifically,astheRe...
VariationalLaplaceAutoencodersYookoonPark1ChrisDongjooKim1GunheeKim1AbstractVAEsare:(1)theconstrainedexpressivenessofthefully-factorizedGaussianposteriorassumptionand(2)theamor-Variationalautoencod...
LossLandscapesofRegularizedLinearAutoencodersDanielKunin1JonathanM.Bloom2AleksandrinaGoeva2CottonSeed2AbstractL(W1,W2)=X−W2W1X2F.Autoencodersareadeeplearningmodelforrepre-ParameterizingLbytheprodu...
HierarchicalImportanceWeightedAutoencodersChin-WeiHuang12KrisSankaran1EeshanDhekane1AlexandreLacoste2AaronCourville13Abstractboundswithprogressivelysmallergapusingmultiplei.i.d.samplesfromthevariat...
HierarchicalDecompositionalMixturesofVariationalAutoencodersPingLiangTan12RobertPeharz1AbstractSPNVariationalAutoencoders(VAEs)havereceivedz1z1z2z2...zLzLconsiderableattention,sincetheyallowustolea...
DisentanglingDisentanglementinVariationalAutoencodersEmileMathieu1TomRainforth1N.Siddharth2YeeWhyeTeh1Abstractindependentfactorsofvariation(Alemietal.,2017;AnsariandSoh,2019;Burgessetal.,2018;Chene...
ConcreteAutoencoders:DifferentiableFeatureSelectionandReconstructionAbubakarAbid1MuhammedFatihBalin2JamesZou134Abstracttoreducedimensionalityofdatabyidentifyingthesubsetofrelevantfeaturesinadataset...
Semi-AmortizedVariationalAutoencodersYoonKim1SamWiseman1AndrewC.Miller1DavidSontag2AlexanderM.Rush1AbstractInstochasticvariationalinference(SVI),thevariationalparametersforeachdatapointarerandomlyi...
LearningDynamicsofLinearDenoisingAutoencodersArnuPretorius12SteveKroon12HermanKamper3AbstractLarsson,2017),tonamejustafewareas.Denoisingau-toencoders(DAEs)areanextensionofAutoencoderswhichDenoising...
InferenceSuboptimalityinVariationalAutoencodersChrisCremer1XuechenLi1DavidDuvenaud1AbstractFig.1forasimpleillustrationofthegaps.InFig.1,L[q]referstotheELBOevaluatedusinganamortizeddistribu-Amortize...
ExploitingthePotentialofStandardConvolutionalAutoencodersforImageRestorationbyEvolutionarySearchMasanoriSuganuma12MeteOzay2TakayukiOkatani21Abstractthelimitationofthesehand-designedorsimplepriors,a...
DVAE++:DiscreteVariationalAutoencoderswithOverlappingTransformationsArashVahdat1WilliamG.Macready1ZhengbingBian1AmirKhoshaman1EvgenyAndriyash1AbstractSoftmaxtechnique(Maddisonetal.,2016;Jangetal.,2...
