On the Effect of (Near) Duplicate Subwords in Language Modelling.

Anton Schäfer Thomas Hofmann Imanol Schlag Tiago Pimentel

Published in: CoRR (2024)

Keyphrases

language modelling
language model
n gram
bag of words
tf idf
pseudo relevance feedback
multimedia
query expansion
document retrieval
ad hoc retrieval
document ranking