Do Attention Heads in BERT Track Syntactic Dependencies?

Phu Mon Htut Jason Phang Shikha Bordia Samuel R. Bowman

Published in: CoRR (2019)

Keyphrases

syntactic dependencies
semantic role labeling
syntactic and semantic dependencies
semantic dependencies
dependency parsing
dependency parser
active learning
data sources
probabilistic model
visual features
tf idf