Login / Signup
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned.
Elena Voita
David Talbot
Fedor Moiseev
Rico Sennrich
Ivan Titov
Published in:
CoRR (2019)
Keyphrases
</>
magnetic recording
general purpose
real time
real world
data sets
visual field
search engine
information systems
multiresolution
wavelet transform
visual attention
pruning algorithm