• search
    search
  • reviewers
    reviewers
  • feeds
    feeds
  • assignments
    assignments
  • settings
  • logout

Paying More Attention to Self-attention: Improving Pre-trained Language Models via Attention Guiding.

Shanshan WangZhumin ChenZhaochun RenHuasheng LiangQiang YanPengjie Ren
Published in: CoRR (2022)
Keyphrases
  • language model
  • language modeling
  • machine learning
  • information retrieval
  • training data
  • n gram
  • visual tracking