Neural Optimizer Equation, Decay Function, and Learning Rate Schedule Joint Evolution.
Brandon MorganDean HougenPublished in: GECCO (2024)
Keyphrases
- learning rate
- error function
- weight vector
- convergence rate
- learning algorithm
- hidden layer
- convergence theorem
- convergence speed
- neural network
- network architecture
- scheduling problem
- rapid convergence
- multilayer neural networks
- evolutionary robotics
- adaptive learning rate
- delta bar delta
- training algorithm
- activation function
- optimization algorithm
- particle swarm optimization
- multi class
- machine learning