RelativePositionalEncodingforTransformerswithLinearComplexityAntoineLiutkus1OndrˇejC´ıfka2Shih-LunWu345UmutS¸ims¸ekli6Yi-HsuanYang35Gae¨lRichard2AbstractFigure1.Examplesofattentionpatternsobs...