How gradient estimator variance and bias impact learning in neural networks.
Arna GhoshYuhan Helena LiuGuillaume LajoieKonrad P. KördingBlake Aaron RichardsPublished in: ICLR (2023)
Keyphrases
- neural network
- online learning
- variance reduction
- neural nets
- maximum likelihood
- genetic algorithm
- learning systems
- learning algorithm
- prior knowledge
- artificial neural networks
- learning tasks
- learning problems
- learning scheme
- learning rules
- active learning
- pattern recognition
- feedforward neural networks
- inductive bias
- low variance