Naturalness of Attention: Revisiting Attention in Code Language Models.

Mootez Saad Tushar Sharma

Published in: CoRR (2023)

Keyphrases

language model
language modeling
probabilistic model
information retrieval
retrieval model
context sensitive
n gram
speech recognition
test collection
language modelling
hidden markov models
web documents
document retrieval
statistical language models