Length Extrapolation of Transformers: A Survey from the Perspective of Position Encoding.

Liang Zhao Xiaocheng Feng Xiachong Feng Bing Qin Ting Liu

Published in: CoRR (2023)

Keyphrases

bit string
position and orientation
fixed length
position information
positional information
website
variable length
databases
information retrieval
decision making
image segmentation
data structure
viewpoint
encoding scheme
position estimation