Login / Signup
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training.
Dawei Zhu
Nan Yang
Liang Wang
Yifan Song
Wenhao Wu
Furu Wei
Sujian Li
Published in:
ICLR (2024)
Keyphrases
</>
contextual information
computer vision
lightweight
pose estimation
cost effective
context sensitive
training set
pairwise
sliding window
efficient implementation
artificial neural networks
test set
context dependent
training process
window size