Headless Language Models: Learning without Predicting with Contrastive Weight Tying.

Nathan Godey Éric Villemonte de la Clergerie Benoît Sagot

Published in: ICLR (2024)

Keyphrases

language model
n gram
language modeling
information retrieval
bayesian networks
active learning
probabilistic model
co occurrence
document collections
speech recognition
retrieval model
statistical language models
language models for information retrieval