Information-Theoretic Methods in Deep Neural Networks: Recent Advances and Emerging Opportunities.
Shujian YuLuis G. Sánchez GiraldoJosé C. PríncipePublished in: IJCAI (2021)
Keyphrases
- recent advances
- information theoretic
- neural network
- mutual information
- information theory
- field of pattern recognition
- entropy measure
- data mining
- kullback leibler divergence
- theoretic framework
- relative entropy
- pattern recognition
- information bottleneck
- image data
- researchers and practitioners
- competitive learning
- image processing