DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks.
Ziyang LuoYadong XiJing MaZhiwei YangXiaoxi MaoChangjie FanRongsheng ZhangPublished in: CoRR (2022)
Keyphrases
- language understanding
- natural language understanding
- dialogue management
- language processing
- spoken dialogue systems
- dialogue system
- contextual constraints
- general knowledge
- natural language
- semantic interpretation
- cognitive psychology
- knowledge representation
- focus of attention
- visual attention
- logic programs
- hidden markov models
- data mining