Understanding Convolutional Neural Network Training with Information Theory.
Shujian YuRobert JenssenJosé C. PríncipePublished in: CoRR (2018)
Keyphrases
- information theory
- convolutional neural network
- information theoretic
- statistical mechanics
- jensen shannon divergence
- statistical learning
- conditional entropy
- face detection
- training set
- supervised learning
- relative entropy
- rate distortion theory
- shannon entropy
- mdl principle
- mutual information
- support vector
- kullback leibler divergence
- statistical physics
- image analysis
- pattern recognition
- neural network