Sparse within Sparse Gaussian Processes using Neighbor Information

SparsewithinSparseGaussianProcessesusingNeighborInformationGia-LacTran12DimitriosMilios1PietroMichiardi1MaurizioFilippone1Abstract&Ghahramani,2005;Naish-Guzman&Holden,2007;Tit-sias,2009;Hensmanetal...

Policy Information Capacity Information-Theoretic Measure for Task Complexity in Deep Reinforcement Learning

PolicyInformationCapacity:Information-TheoreticMeasureforTaskComplexityinDeepReinforcementLearningHirokiFuruta1TatsuyaMatsushima1TadashiKozuno2YutakaMatsuo1SergeyLevine3OfirNachum3ShixiangShaneGu3A...

Information Obfuscation of Graph Neural Networks

InformationObfuscationofGraphNeuralNetworksPeiyuanLiao1HanZhao2KeyuluXu3TommiJaakkola3GeoffreyGordon1StefanieJegelka3RuslanSalakhutdinov1Abstractthesocialnetwork.BytakingthestructuredInformationoff...

Finding Relevant Information via a Discrete Fourier Expansion

FindingRelevantInformationviaaDiscreteFourierExpansionMohsenHeidari1JithinK.Sreedharan2GilI.Shamir3WojciechSzpankowski1Abstractcapturenon-linearrelations(Grettonetal.,2005;Chenetal.,2017;Weietal.,2...

Decomposed Mutual Information Estimation for Contrastive Representation Learning

DecomposedMutualInformationEstimationforContrastiveRepresentationLearningAlessandroSordoni1NouhaDziri2HannesSchulz1GeoffGordon1PhilBachman1RemiTachet1Abstractsupervisedrepresentationlearningapproac...

Unsupervised Speech Decomposition via Triple Information Bottleneck

UnsupervisedSpeechDecompositionviaTripleInformationBottleneckKaizhiQian12YangZhang1ShiyuChang1DavidCox1MarkHasegawa-Johnson2Abstractofthetoneofthespeaker,andrhythmcharacterizeshowfastthespeakerutte...

Teaching with Limited Information on the Learners Behaviour

TeachingwithLimitedInformationontheLearner’sBehaviourFerdinandoCicalese1SergioFilho2EduardoLaber2MarcoMolinaro2Abstractbeenontheinteractivesetting(Liuetal.,2017;Chenetal.,2018;Liuetal.,2018;Dasgup...

More Information Supervised Probabilistic Deep Face Embedding Learning

MoreInformationSupervisedProbabilisticDeepFaceEmbeddingLearningYingHuang1ShangfengQiu1WenweiZhang1XianghuiLuo1JinzhuoWang2AbstractFigure1.Examplesofgeneratedfrontalfacefromdifferentiden-tity.Inrows...

Learning Efficient Multi-agent Communication An Information Bottleneck Approach

LearningEfficientMulti-agentCommunication:AnInformationBottleneckApproachRundongWang1XuHe1RunshengYu1Weiqiu1BoAn1ZinoviRabinovich1Abstractcorrelationthatbenefitsagroup’scooperation.Therefore,manyr...

Information Particle Filter Tree An Online Algorithm for POMDPs with Belief-Based Rewards on Continuous Domains

InformationParticleFilterTree:AnOnlineAlgorithmforPOMDPswithBelief-BasedRewardsonContinuousDomainsJohannesFischer12ÖmerS¸ahinTas¸12Abstractpadimitriou&Tsitsiklis,1987).Inreal-worldapplications,p...

Improving generalization by controlling label-noise Information in neural network weights

ImprovingGeneralizationbyControllingLabel-NoiseInformationinNeuralNetworkWeightsHrayrHarutyunyan1KyleReing1GregVerSteeg1AramGalstyan1Abstractproposednoregularizationdropout0.5weightdecay0.003Inthep...

All in the (Exponential) Family Information Geometry and Thermodynamic Variational Inference

AllintheExponentialFamily:BregmanDualityinThermodynamicVariationalInferenceRobBrekelmans1VadenMasrani2FrankWood2GregVerSteeg1AramGalstyan1AbstractFigure1.TheoriginalTVOpaperrecommendedusingtwoparti...

Adversarial Mutual Information for Text Generation

AdversarialMutualInformationforTextGenerationBoyuanPan1YazhengYang2KaizhaoLiang3BhavyaKailkhura4ZhongmingJin5Xian-ShengHua5DengCai1BoLi3Abstractdemonstrateddominantperformanceinvarioustasks,suchasd...

Submodular Observation Selection and Information Gathering for Quadratic Models

SubmodularObservationSelectionandInformationGatheringforQuadraticModelsAbolfazlHashemi1MahsaGhasemi1HarisVikalo1UfukTopcu1Abstractgoalistoselectasmallrepresentativesubsetofobserva-tionsgatheredbydi...

On Variational Bounds of Mutual Information

OnVariationalBoundsofMutualInformationBenPoole1SherjilOzair12Aa¨ronvandenOord3AlexanderA.Alemi1GeorgeTucker1AbstractFigure1.SchematicofvariationalboundsofmutualInformationpresentedinthispaper.Node...

New results on Information theoretic clustering

NewResultsonInformationTheoreticClusteringFerdinandoCicalese1EduardoLaber2LucasMurtinho2Abstracttropy)thatestimatethedissimilarityofagroupofitems(see,e.g.,(Dhillonetal.,2003)andreferencestherein)In...

Incorporating Grouping Information into Bayesian Decision Tree Ensembles

IncorporatingGroupingInformationintoBayesianDecisionTreeEnsemblesJunliangDu1AntonioR.Linero1Abstractmationtohelplearnthesestructures.Forexample,whencovariatesareassociatedtoknowngraphicalstructures...

Estimating Information Flow in Deep Neural Networks

EstimatingInformationFlowinDeepNeuralNetworksZivGoldfeld12EwoutvandenBerg23KristjanGreenewald23IgorMelnyk23NamNguyen23BrianKingsbury23YuryPolyanskiy12Abstractetal.,2018;Achille&Soatto,2018).Mutuali...

EMI Exploration with Mutual Information

EMI:ExplorationwithMutualInformationHyoungseokKim12JaekyeomKim12YeonwooJeong12SergeyLevine3HyunOhSong12Abstract83Reinforcementlearningalgorithmsstrugglewhen177therewardsignalisverysparse.Inthesecas...

EDDI Efficient Dynamic Discovery of High-Value Information with Partial VAE