Statistical Knowledge Assessment for Generative Language Models.

Qingxiu Dong Jingjing Xu Lingpeng Kong Zhifang Sui Lei Li

Published in: CoRR (2023)

Keyphrases

language model
language modeling
language models for information retrieval
n gram
probabilistic model
language modelling
document retrieval

statistical language models
test collection
speech recognition
retrieval model
information retrieval
query expansion

language model for information retrieval
okapi bm
smoothing methods
context sensitive
term dependencies
translation model

knowledge discovery
word error rate
relevance model
vector space model
language modeling framework
query terms