Efficient Approximations of the Fisher Matrix in Neural Networks using Kronecker Product Singular Value Decomposition.
Abdoulaye KorokoAni Anciaux-SedastrianIbtihel Ben GharbiaValérie GarèsMounir HaddouQuang-Huy TranPublished in: CoRR (2022)
Keyphrases
- singular value decomposition
- neural network
- singular values
- kronecker product
- low rank
- least squares
- dimension reduction
- linear algebra
- reconstruction error
- dimensionality reduction
- latent semantic indexing
- singular vectors
- principal component analysis
- qr decomposition
- low rank approximation
- factorization method
- correlation matrix
- measurement matrix
- matrix decomposition
- pattern recognition
- null space
- matrix completion
- low rank matrix
- data matrix
- face recognition