Exploring Internal Numeracy in Language Models: A Case Study on ALBERT.

Ulme Wennberg Gustav Eje Henter

Published in: CoRR (2024)

Keyphrases

language model
language modeling
document retrieval
n gram
speech recognition
language modelling
probabilistic model

information retrieval
retrieval model
test collection
statistical language models
query expansion
context sensitive
language models for information retrieval

smoothing methods
query terms
translation model
language model for information retrieval
document length
query specific
clustering algorithm

web pages
document ranking
relevance model
pseudo relevance feedback
ad hoc information retrieval
feature selection