Analyzing Individual Neurons in Pre-trained Language Models.

Nadir Durrani Hassan Sajjad Fahim Dalvi Yonatan Belinkov

Published in: CoRR (2020)

Keyphrases

language model
pre trained
language modeling
n gram
probabilistic model
speech recognition

document retrieval
information retrieval
statistical language models
neural network
query expansion
retrieval model

language modelling
language models for information retrieval
smoothing methods
document ranking
training data

relevance model
test collection
training examples
semi supervised
computer vision