Understanding Self-attention Mechanism via Dynamical System Perspective.

Zhongzhan Huang Mingfu Liang Jinghui Qin Shanshan Zhong Liang Lin

Published in: CoRR (2023)

Keyphrases

dynamical systems
attention mechanism
nonlinear dynamical systems
differential equations
state space
phase space
predictive state representations
dynamical behavior
visual attention
visual attention model
reinforcement learning