On the Effect of (Near) Duplicate Subwords in Language Modelling.

Anton Schäfer Thomas Hofmann Imanol Schlag Tiago Pimentel

Published in: ACL (Findings) (2024)

Keyphrases

language modelling
language model
n gram
ad hoc retrieval
bag of words
pseudo relevance feedback
machine learning
tf idf
information retrieval
query expansion
document collections
image representation
document ranking