NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application.

Chuhan Wu Fangzhao Wu Yang Yu Tao Qi Yongfeng Huang Qi Liu

Published in: EMNLP (Findings) (2021)

Keyphrases

language model
language modeling
n gram
pre trained
probabilistic model
speech recognition
ad hoc information retrieval
retrieval model
document retrieval
information retrieval
query expansion
context sensitive
data sets
test collection
mixture model
small number
relevance model
decision trees
word clouds