Window Attention is Bugged: How not to Interpolate Position Embeddings.

Daniel Bolya Chaitanya Ryali Judy Hoffman Christoph Feichtenhofer

Published in: ICLR (2024)

Keyphrases

visual attention
real time
machine learning
sliding window
vector space
manifold learning
website
dimensionality reduction
real world
decision trees
color images
low dimensional
high dimensional data
window size
fixed size
initial position