Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers.

Krzysztof Choromanski Shanda Li Valerii Likhosherstov Kumar Avinava Dubey Shengjie Luo Di He Yiming Yang Tamás Sarlós Thomas Weingarten Adrian Weller

Published in: AISTATS (2024)

Keyphrases