Self-attention Mechanism at the Token Level: Gradient Analysis and Algorithm Optimization.

Linqing Liu Xiaolong Xu

Published in: Knowl. Based Syst. (2023)

Keyphrases

optimization algorithm
optimization method
computational complexity
gradient method
learning algorithm
gradient information
image sequences
similarity measure
high quality
multiscale
optimal solution
higher level