Login / Signup

Paying More Attention to Self-attention: Improving Pre-trained Language Models via Attention Guiding.

Shanshan WangZhumin ChenZhaochun RenHuasheng LiangQiang YanPengjie Ren
Published in: CoRR (2022)
Keyphrases
  • language model
  • language modeling
  • machine learning
  • information retrieval
  • training data
  • n gram
  • visual tracking