Information theory, complexity and neural networks.
Yaser S. Abu-MostafaPublished in: IEEE Commun. Mag. (1989)
Keyphrases
- information theory
- neural network
- information theoretic
- statistical learning
- jensen shannon divergence
- statistical mechanics
- pattern recognition
- conditional entropy
- kullback leibler divergence
- shannon entropy
- mutual information
- computational complexity
- machine learning
- supervised learning
- mdl principle
- relative entropy
- image analysis
- similarity measure