Data Engineering for Scaling Language Models to 128K Context.

Yao Fu Rameswar Panda Xinyao Niu Xiang Yue Hannaneh Hajishirzi Yoon Kim Hao Peng

Published in: CoRR (2024)

Keyphrases

language model
language modeling
knowledge discovery
query expansion
feature selection
speech recognition
context sensitive