Grouped self-attention mechanism for a memory-efficient Transformer.

Bumjun Jung Yusuke Mukuta Tatsuya Harada

Published in: CoRR (2022)

Keyphrases

memory efficient
attention mechanism
visual attention
saliency map
fuzzy logic
visual attention model
fault diagnosis
external memory
power transformers
iterative deepening
integral image
real time
high quality
eye movements
eye tracking