Analogies between linguistics and information theory.
Julian WarnerPublished in: J. Assoc. Inf. Sci. Technol. (2007)
Keyphrases
- information theory
- information theoretic
- statistical learning
- jensen shannon divergence
- kullback leibler divergence
- statistical mechanics
- semantic relations
- computer science
- cognitive science
- relative entropy
- conditional entropy
- mdl principle
- shannon entropy
- statistical physics
- natural language processing
- image analysis
- natural language
- biological systems
- machine learning