It's All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense Reasoning.
Alexey TikhonovMax RyabininPublished in: CoRR (2021)
Keyphrases
- cross lingual
- commonsense reasoning
- transfer learning
- machine translation
- cross lingual information retrieval
- language modeling
- incomplete information
- text classification
- event calculus
- nonmonotonic reasoning
- formal theory
- information retrieval
- knowledge representation
- belief revision
- document clustering
- partially ordered