TemporallyCorrelatedTaskSchedulingforSequenceLearningXueqingWu1LewenWang2YingceXia2WeiqingLiu2LijunWu2ShufangXie2TaoQin2Tie-YanLiu2Abstractneousmachinetranslation,weneedtobegintranslationbeforeread...
OrderMatters:ProbabilisticModelingofNodeSequenceforGraphGenerationXiaohuiChen1XuHan1JiajingHu1FranciscoJ.R.Ruiz2LipingLiu1Abstract2018;Liaoetal.,2019;Daietal.,2020;Goyaletal.,2020;Yuanetal.,2020;Sh...
LearningtoRehearseinLongSequenceMemorizationZhuZhang12ChangZhou2JianxinMa2ZhijieLin1JingrenZhou2HongxiaYang2ZhouZhao1Abstract2020b),orpredictwhetherauserwillclickthegivenitembasedontheuserbehaviors...
Fold2Seq:AJointSequence(1D)-Fold(3D)Embedding-basedGenerativeModelforProteinDesignYueCao12PayelDas1VijilChenthamarakshan1Pin-YuChen1IgorMelnyk1YangShen2...Abstract1.IntroductionDesigningnovelprotei...
AStructuredObservationDistributionforGenerativeBiologicalSequencePredictionandForecastingEliN.Weinstein1DeboraS.Marks23AbstractSequencedata,makingpredictionsaboutunobservedorfu-tureSequences,andgen...
SequenceGenerationwithMixedRepresentationsLijunWu12ShufangXie2YingceXia2YangFan3TaoQin2JianhuangLai1Tie-YanLiu2AbstractTable1.AGermansentenceexample(Oristandsfororiginal)oftokenizationresultsbyBPE,...
Population-BasedBlack-boxOptimizationforBiologicalSequenceDesignChristofAngermueller1DavidBelanger1AndreeaGane1ZeldaMariet1DavidDohan1KevinMurphy1LucyColwell12DSculley1AbstractproposedSequencesrequ...
IncrementalSamplingWithoutReplacementforSequenceModelsKensenShi1DavidBieber1CharlesSutton1Abstractwithoutreplacementcouldbeevenmoredesirablebyavoid-ingduplicatesamples,especiallyinmachinelearningwh...
Imputer:SequenceModellingviaImputationandDynamicProgrammingWilliamChan1ChitwanSaharia1†GeoffreyHinton1MohammadNorouzi1NavdeepJaitly2Abstractnon-autoregressivemodelstypicallymakeastrongcondi-tional...
AnEMApproachtoNon-autoregressiveConditionalSequenceGenerationZhiqingSun1YimingYang1Abstractconditionalprobabilityofygivenxisfactorizedas:Autoregressive(AR)modelshavebeenthedomi-Tnatingapproachtocon...
AChance-ConstrainedGenerativeFrameworkforSequenceOptimizationXianggenLiu12QiangLiu3SenSong1JianPeng2Abstractlong-rangeconstraints(e.g.,valencyconditionsinmoleculargeneration),pushingthediscretesear...
MASS:MaskedSequencetoSequencePre-trainingforLanguageGenerationKaitaoSong1XuTan2TaoQin2JianfengLu1Tie-YanLiu2Abstractwhilepre-traininghasplentyofdata(Girshicketal.,2014;Szegedyetal.,2015;Ouyangetal....
LearningtoGroovewithInverseSequenceTransformationsJonGillick12AdamRoberts2JesseEngel2DouglasEck2DavidBamman1Abstractingwithdeepgenerativemodels,motivatingrecentworkonconditionalgenerationinseveralm...
InsertionTransformer:FlexibleSequenceGenerationviaInsertionOperationsMitchellStern12WilliamChan1JamieKiros1JakobUszkoreit1AbstractChanetal.,2016),speechsynthesis(Oordetal.,2016a;Wangetal.,2017),ima...
FocusedHierarchicalRNNsforConditionalSequenceProcessingNanRosemaryKe123KonradZ˙ołna41AlessandroSordoni3ZhouhanLin135AdamTrischler3YoshuaBengio167JoellePineau897LaurentCharlin110ChrisPal12Abstract...
FastDecodinginSequenceModelsUsingDiscreteLatentVariablesŁukaszKaiser1AurkoRoy1AshishVaswani1NikiParmar1SamyBengio1JakobUszkoreit1NoamShazeer1Abstractlation(Sutskeveretal.,2014;Bahdanauetal.,2014;C...
DynamicEvaluationofNeuralSequenceModelsBenKrause1EmmanuelKahembwe1IainMurray1SteveRenals1AbstracthavebeenshowntohaveproblemslearningtoreproduceSequenceelements(Marcus,2001;Prickett,2017).IntheWeexp...
SequenceTutor:ConservativeFine-TuningofSequenceGenerationModelswithKL-controlNatashaJaques12ShixiangGu134DzmitryBahdanau15Jose´MiguelHerna´ndez-Lobato3RichardE.Turner3DouglasEck1Abstractspelling,...
SequencetoBetterSequence:ContinuousRevisionofCombinatorialStructuresJonasMueller1DavidGifford1TommiJaakkola1Abstractthosewhichappearrealistic).Forexample:arandomse-quenceofwordswillalmostneverforma...
SequenceModelingviaSegmentationsChongWang1YiningWang2Po-SenHuang1AbdelrahmanMohamed3DengyongZhou1LiDeng4AbstractSequenceandinputxmayormaynotbeaSequence.Sup-posewehaveasegmentedSequence.Thentheproba...