Primer: Searching for Efficient Transformers for Language Modeling.

David R. So Wojciech Manke Hanxiao Liu Zihang Dai Noam Shazeer Quoc V. Le

Published in: CoRR (2021)

Keyphrases

language modeling
language model
information retrieval
probabilistic model
retrieval model
query expansion
n gram
cross lingual
relevance model
statistical language models
data mining
vector space
trec collections
pseudo feedback