Fewer Truncations Improve Language Modeling.

Hantian Ding Zijian Wang Giovanni Paolini Varun Kumar Anoop Deoras Dan Roth Stefano Soatto

Published in: CoRR (2024)

Keyphrases

language modeling
language model
retrieval model
information retrieval
query expansion
n gram
cross lingual
probabilistic model
statistical language models
test collection