Window Attention is Bugged: How not to Interpolate Position Embeddings.
Daniel BolyaChaitanya RyaliJudy HoffmanChristoph FeichtenhoferPublished in: CoRR (2023)
Keyphrases
- sliding window
- focus of attention
- visual attention
- window size
- dimensionality reduction
- vector space
- low dimensional
- hilbert space
- database
- relative position
- euclidean space
- saliency map
- distance measure
- semi supervised
- multi agent systems
- learning environment
- multi agent
- multiscale
- decision making
- information systems