What Matters in Transformers? Not All Attention is Needed.

Shwai He Guoheng Sun Zheyu Shen Ang Li

Published in: CoRR (2024)

Keyphrases

database
e learning
visual attention
saliency map
high voltage