Searching for Efficient Transformers for Language Modeling.

David R. So Wojciech Manke Hanxiao Liu Zihang Dai Noam Shazeer Quoc V. Le

Published in: NeurIPS (2021)

Keyphrases

language modeling
language model
query expansion
n gram
information retrieval
retrieval model
cross lingual
probabilistic model
machine learning
trec collections
statistical language models
multimedia
co occurrence
relevance model
document length