Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Models.

Joseph F. DeRose Jiayao Wang Matthew Berger

Published in: CoRR (2020)

Keyphrases

language model
language modeling
n gram
information retrieval
keywords
probabilistic model
speech recognition
document retrieval
query expansion
statistical language models
web search
context sensitive
smoothing methods