Word Frequency Does Not Predict Grammatical Knowledge in Language Models.

Charles Yu Ryan Sie Nico Tedeschi Leon Bergen

Published in: EMNLP (1) (2020)

Keyphrases

language model
language modeling
probabilistic model
n gram
word frequency
document retrieval

information retrieval
query expansion
test collection
retrieval model
word order
natural language

co occurrence
semantic information
natural language processing
knowledge discovery
query terms

domain knowledge
vector space model
relevance model
semantic relatedness
document level