UnsupervisedRepresentationLearningviaNeuralActivationCodingYookoonPark1SanghoLee2GunheeKim2DavidM.Blei1Abstract(a)Atinitialization(b)AfterNACtrainingWepresentneuralactivationCoding(NAC)asaFigure1.D...
TFix:LearningtoFixCodingErrorswithaText-to-TextTransformerBerkayBerabi12JingxuanHe1VeselinRaychev12MartinVechev1Abstractsuchasvariablemisuses(Allamanisetal.,2018)andintegertypeerrors(Coker&Hafiz,20...
TemporalPredictiveCodingForModel-BasedPlanningInLatentSpaceTungNguyen1RuiShu2TuanPham1HungBui1StefanoErmon2Abstractever,itiswellknownthatperformingRLdirectlyinthehigh-dimensionalobservationspaceiss...
ChebyshevPolynomialCodes:TaskEntanglement-basedCodingforDistributedMatrixMultiplicationSangwooHong1HeecheolYang2YeongseokYoon1TaehyeonCho1JungwooLee1Abstractagiventaskmuchslowerthanotherworkers,det...
VariationalBayesianQuantizationYiboYang1RobertBamler1StephanMandt1Abstractforaparticularcompressionobjective.Here,westudyarelatedbutdifferentproblem:givenatrainedmodel,whatWeproposeanovelalgorithmf...
PredictiveCodingforLocally-LinearControlRuiShu1TungNguyen2YinlamChow3TuanPham2KhoatThan2MohammadGhavamzadeh4StefanoErmon1HungBui2Abstractmonapproachistoemployvariousheuristicstoembedthehigh-dimensi...
Data-EfficientImageRecognitionwithContrastivePredictiveCodingOlivierJ.He´naff1AravindSrinivas2JeffreyDeFauw1AliRazavi1CarlDoersch1S.M.AliEslami1AaronvandenOord1Abstract2xfewerlabelsHumanobserversc...
NeuralJointSource-ChannelCodingKristyChoi1KedarTatwawadi2AdityaGrover1TsachyWeissman2StefanoErmon1AbstractHowever,thiselegantdecompositionsuffersfromtwocriti-callimitationsinthefinitebit-lengthregi...
DualEntangledPolynomialCode:Three-DimensionalCodingforDistributedMatrixMultiplicationPedroSoto1JunLi1XiaodiFan1Abstractetal.,2010),havebeenabletoprocessahighvolumeofdataatthescaleoftensofterabyteso...
θ(z1x)decodezwithqθ(zx)decodez1,z2,z3withqθ(z1,z2,z3x)(xz1)encodexwithpθ(xz)encodex,z1,z2withpθ(x,z1,z2z3)(z2z1)encodezwithp(z)(z1z2)encodez3withp(z3)(z3z2)(z2z3)ReceiverReceiverp(z3)Bit-Swap:...
OnlineConvolutionalSparseCodingwithSample-DependentDictionaryYaqingWang1QuanmingYao12JamesT.Kwok1LionelM.Ni3Abstract(Kavukcuogluetal.,2010;Zeileretal.,2010;Bristowetal.,2013;Heideetal.,2015;Sˇorel...
GradientCodingfromCyclicMDSCodesandExpanderGraphsNetanelRaviv1ItzhakTamo2RashishTandon3AlexandrosG.Dimakis4Abstractdistributedsynchronousgradientdescent.GradientCodingisatechniqueforstragglermit-Th...
DeepPredictiveCodingNetworkforObjectRecognitionHaiguangWen1KuanHan1JunxingShi1YizhenZhang1EugenioCulurciello12ZhongmingLiu12Abstractfeaturesbyafeedforwardpassthroughstacksofconvolu-tionallayers.Bas...
Communication-ComputationEfficientGradientCodingMinYe1EmmanuelAbbe2Abstractnicationcost(Guptaetal.,2015;Alistarhetal.,2017;Wenetal.,2017).ThispaperdevelopsCodingtechniquestoreducetherunningtimeofdi...
AdversarialLearningwithLocalCoordinateCodingJiezhangCao1YongGuo1QingyaoWu1ChunhuaShen2JunzhouHuang3MingkuiTan1Abstractbution,suchasGaussiandistributions(Goodfellowetal.,2014)anduniformdistributions...
GradientCoding:AvoidingStragglersinDistributedLearningRashishTandon1QiLei2AlexandrosG.Dimakis3NikosKarampatziakis4AbstractW1W2W3WeproposeanovelCodingtheoreticframeworkD1D2D3formitigatingstragglersi...