In-context Autoencoder for Context Compression in a Large Language Model.

Tao Ge Jing Hu Lei Wang Xun Wang Si-Qing Chen Furu Wei

Published in: ICLR (2024)

Keyphrases

language model
context sensitive
n gram
probabilistic model
language modeling
mixture model
machine learning
search engine
probability distribution
relevance model
language models for information retrieval