Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers.
Krzysztof Marcin ChoromanskiShanda LiValerii LikhosherstovKumar Avinava DubeyShengjie LuoDi HeYiming YangTamás SarlósThomas WeingartenAdrian WellerPublished in: CoRR (2023)