In-context Autoencoder for Context Compression in a Large Language Model.

Tao Ge Jing Hu Xun Wang Si-Qing Chen Furu Wei

Published in: CoRR (2023)

Keyphrases

language model
context sensitive
probabilistic model
co occurrence
model selection
unsupervised learning
mixture model
speech recognition
retrieval model
language modeling
context dependent