Do Transformers Parse while Predicting the Masked Word?

Haoyu Zhao Abhishek Panigrahi Rong Ge Sanjeev Arora

Published in: EMNLP (2023)

Keyphrases

co occurrence
n gram
word sense disambiguation
keywords
linguistic knowledge
word recognition
real time
machine learning
search engine
natural language
word pairs
linguistic information