Mutual Information of Neural Network Initialisations: Mean Field Approximations.
Jared TannerGiuseppe UghiPublished in: ISIT (2021)
Keyphrases
- mutual information
- neural network
- free energy
- information theoretic
- closed form
- mutual information maximization
- image registration
- similarity measure
- competitive learning
- markov random field
- medical image registration
- partition function
- variational methods
- variational approximation
- pattern recognition
- information gain
- artificial neural networks
- feature selection
- conditional mutual information
- information theoretic measures
- kullback leibler divergence
- fuzzy logic
- statistical mechanics
- machine learning
- neural network is trained
- approximate inference
- network model
- genetic algorithm
- bp neural network
- self organizing maps
- belief networks
- recurrent neural networks
- neural nets
- back propagation
- loopy belief propagation
- feed forward
- bayesian inference
- linear complexity
- prediction model
- fixed point
- markov networks
- posterior distribution
- graph cuts
- semi supervised
- multiresolution
- computer vision