Login / Signup

Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective.

Meizhi ZhongChen ZhangYikun LeiXikai LiuYan GaoYao HuKehai ChenMin Zhang
Published in: CoRR (2024)
Keyphrases
  • contextual information
  • data sets
  • subject matter
  • neural network
  • real world
  • relational databases
  • viewpoint
  • context aware
  • context sensitive
  • context dependent
  • multiple perspectives