Zero-th Order Algorithm for Softmax Attention Optimization.
Yichuan DengZhihang LiSridhar MahadevanZhao SongPublished in: CoRR (2023)
Keyphrases
- optimization algorithm
- dynamic programming
- cost function
- computational cost
- preprocessing
- times faster
- learning algorithm
- computational complexity
- detection algorithm
- optimization method
- experimental evaluation
- k means
- optimal solution
- probabilistic model
- optimization process
- objective function
- matching algorithm
- particle swarm optimization
- similarity measure
- optimization strategies
- constrained optimization
- genetic algorithm
- ant colony optimization
- metaheuristic
- optimization criteria
- computationally efficient
- expectation maximization
- linear programming
- optimization problems
- high accuracy
- support vector machine
- scheduling problem
- multi objective
- reinforcement learning