Understanding Self-attention Mechanism via Dynamical System Perspective.

Zhongzhan Huang Mingfu Liang Jinghui Qin Shanshan Zhong Liang Lin

Published in: ICCV (2023)

Keyphrases

dynamical systems
attention mechanism
differential equations
dynamical behavior
phase space
nonlinear dynamical systems
visual attention
state space
image processing
computational intelligence
biologically inspired
visual attention model