FAdam: Adam is a natural gradient optimizer using diagonal empirical Fisher information.
Dongseong HwangPublished in: CoRR (2024)
Keyphrases
- fisher information
- natural gradient
- independent component analysis
- learning rate
- blind source separation
- positive definite
- covariance matrix
- probability density function
- euclidean space
- geodesic distance
- machine learning
- estimation error
- signal processing
- bayesian networks
- monte carlo
- noise level
- clustering method
- principal component analysis
- computer vision