Mimetic Initialization of Self-Attention Layers.

Asher Trockman J. Zico Kolter

Published in: CoRR (2023)

Keyphrases

multi layer
multiple layers
computer vision
clustering algorithm
database systems
visual attention
focus of attention
initial conditions
evolution process
selective attention