RealFormer: Transformer Likes Residual Attention.

Ruining HeAnirudh RavulaBhargav KanagalJoshua Ainslie
Published in: ACL/IJCNLP (Findings) (2021)