Word-valued sources: an ergodic theorem, an AEP, and the conservation of entropy.
Roy TimoKim L. BlackmoreLeif HanlenPublished in: IEEE Trans. Inf. Theory (2010)
Keyphrases
- information theory
- data sources
- co occurrence
- information sources
- information theoretic
- mutual information
- word sense disambiguation
- linguistic information
- word recognition
- linguistic knowledge
- multiple sources
- valued logic
- markov chain
- keywords
- databases
- english words
- relative entropy
- digital topology
- von neumann
- information entropy
- natural language text
- n gram
- feature selection