Momentum Stiefel Optimizer, with Applications to Suitably-Orthogonal Attention, and Optimal Transport.

Lingkai Kong Yuqing Wang Molei Tao

Published in: CoRR (2022)

Keyphrases

query optimization
information retrieval
optimal solution
dynamic programming
euclidean space
optimal design
neural network
information systems
relational databases
worst case
optimization algorithm
visual attention
feature subset
optimal control
finding optimal