Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilization.
Cheng-Yu HsiehYung-Sung ChuangChun-Liang LiZifeng WangLong T. LeAbhishek KumarJames R. GlassAlexander RatnerChen-Yu LeeRanjay KrishnaTomas PfisterPublished in: CoRR (2024)