Sign in

Functional Interpolation for Relative Positions Improves Long Context Transformers.

Shanda LiChong YouGuru GuruganeshJoshua AinslieSantiago OntañónManzil ZaheerSumit SanghaiYiming YangSanjiv KumarSrinadh Bhojanapalli
Published in: CoRR (2023)
Keyphrases
  • relative position
  • contextual information
  • context aware
  • geometric properties
  • data mining
  • input image
  • multi dimensional
  • similarity search
  • spatial information