RealFormer: Transformer Likes Residual Attention.

Ruining He Anirudh Ravula Bhargav Kanagal Joshua Ainslie

Published in: ACL/IJCNLP (Findings) (2021)

Keyphrases

fuzzy logic
database
data sets
artificial intelligence
selective attention
high voltage
partial discharge