Measuring convergence in language model estimation using relative entropy.
Abhinav SethyShrikanth S. NarayananBhuvana RamabhadranPublished in: INTERSPEECH (2004)
Keyphrases
- language model
- relative entropy
- language modeling
- n gram
- probabilistic model
- information theory
- document retrieval
- information theoretic
- log likelihood
- query expansion
- mixture model
- information retrieval
- retrieval model
- covariance matrix
- context sensitive
- query terms
- density estimation
- mutual information
- mahalanobis distance
- bregman divergences
- maximum entropy
- latent variables
- graphical models
- co occurrence
- decision trees