Information theoretic approaches to model selection.
Jonathan HamakerAravind GanapathirajuJoseph PiconePublished in: ICSLP (1998)
Keyphrases
- model selection
- information theoretic
- mutual information
- cross validation
- information theory
- theoretic framework
- hyperparameters
- feature selection
- selection criterion
- model selection criteria
- parameter estimation
- machine learning
- variable selection
- jensen shannon divergence
- statistical inference
- information theoretic measures
- information bottleneck
- sample size
- generalization error
- regression model
- log likelihood
- bayesian information criterion
- mixture model
- bayesian networks
- maximum likelihood
- marginal likelihood
- gaussian process