It's All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense Reasoning.
Alexey TikhonovMax RyabininPublished in: ACL/IJCNLP (Findings) (2021)
Keyphrases
- cross lingual
- commonsense reasoning
- transfer learning
- machine translation
- cross lingual information retrieval
- nonmonotonic reasoning
- language modeling
- event calculus
- text classification
- formal theory
- machine learning
- knowledge representation
- incomplete information
- news articles
- information retrieval
- autoepistemic logic
- natural language
- expert systems
- co occurrence
- natural language processing
- query expansion
- language model
- information retrieval systems
- domain specific