Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers.

Krzysztof Marcin Choromanski Shanda Li Valerii Likhosherstov Kumar Avinava Dubey Shengjie Luo Di He Yiming Yang Tamás Sarlós Thomas Weingarten Adrian Weller

Published in: CoRR (2023)

Keyphrases