RealFormer: Transformer Likes Residual Attention.

Ruining He Anirudh Ravula Bhargav Kanagal Joshua Ainslie

Published in: ACL/IJCNLP (Findings) (2021)

Keyphrases

fuzzy logic
database

data sets
artificial intelligence

selective attention
high voltage

partial discharge