Linear Attention via Orthogonal Memory.

Jun Zhang Shuyang Jiang Jiangtao Feng Lin Zheng Lingpeng Kong

Published in: CoRR (2023)

Keyphrases

linear space
visual attention
memory requirements
memory space
memory usage
low memory
memory size
closed form
computing power
piecewise linear
linear complexity
simple linear
focus of attention
neural network
linear model
image sequences
website
information systems
artificial intelligence
learning algorithm