Do Deep Learning Models Have Too Many Parameters? An Information Theory Viewpoint.
Léonard BlierYann OllivierPublished in: CoRR (2018)
Keyphrases
- information theory
- learning models
- viewpoint
- information theoretic
- statistical learning
- jensen shannon divergence
- machine learning
- conditional entropy
- loss function
- classification models
- learning tasks
- conditional random fields
- learning algorithm
- mutual information
- semi supervised learning
- machine learning algorithms
- learning problems
- graphical models
- active learning
- data mining
- video coding
- maximum likelihood
- higher order
- training data
- shannon entropy