Machine learning and information theory concepts towards an AI Mathematician.
Yoshua BengioNikolay MalkinPublished in: CoRR (2024)
Keyphrases
- text mining
- information theory
- machine learning
- information theoretic
- statistical learning
- statistical mechanics
- jensen shannon divergence
- artificial intelligence
- conditional entropy
- data mining
- expert systems
- mutual information
- kullback leibler divergence
- knowledge representation
- support vector machine
- decision trees
- computer science
- active learning
- pattern recognition
- similarity measure
- shannon entropy
- computer vision
- rate distortion theory
- information geometry
- statistical physics
- mdl principle
- feature selection