Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks.

Weicheng Ma Kai Zhang Renze Lou Lili Wang Soroush Vosoughi

Published in: CoRR (2021)

Keyphrases

cross lingual
machine translation
cross lingual information retrieval
language independent
event extraction
language modeling
transfer learning
cross language
cluster analysis
news articles
word sense