Stochastic Learning Rate With Memory: Optimization in the Stochastic Approximation and Online Learning Settings.
Theodoros MamalisDusan M. StipanovicPetros G. VoulgarisPublished in: IEEE Control. Syst. Lett. (2023)
Keyphrases
- stochastic approximation
- learning rate
- online learning
- monte carlo
- learning algorithm
- convergence rate
- optimization algorithm
- rapid convergence
- convergence speed
- e learning
- adaptive learning rate
- policy iteration
- weight vector
- global optimization
- temporal difference learning
- multi class
- active learning
- evolutionary algorithm
- search space
- reinforcement learning