When classifying grammatical role, BERT doesn't care about word order... except when it matters.

Isabel Papadimitriou Richard Futrell Kyle Mahowald

Published in: CoRR (2022)

Keyphrases

word order
natural language generation
bag of words
latent semantic indexing
target language
artificial intelligence
machine learning
feature vectors
least squares
phrase structure