Headless Language Models: Learning without Predicting with Contrastive Weight Tying.

Nathan Godey Éric de la Clergerie Benoît Sagot

Published in: CoRR (2023)

Keyphrases

language model
language modeling
n gram
document retrieval
probabilistic model
query terms
information retrieval
pseudo relevance feedback
language modelling
context sensitive
vector space model
statistical language models
ad hoc information retrieval