Information-Theoretic Limits on Compression of Semantic Information.
Jiancheng TangQianqian YangZhaoyang ZhangPublished in: CoRR (2023)
Keyphrases
- information theoretic
- semantic information
- information theory
- mutual information
- wordnet
- theoretic framework
- domain knowledge
- semantic features
- information bottleneck
- semantic analysis
- semantic knowledge
- keywords
- entropy measure
- visual information
- low level features
- jensen shannon divergence
- contextual information
- semantic meaning
- log likelihood
- information theoretic measures
- semantic similarity
- relative entropy
- metadata
- background knowledge
- kullback leibler divergence
- databases
- kl divergence
- low level
- xml documents
- high level
- image classification
- minimum description length
- bregman divergences
- co occurrence
- feature vectors
- conceptual information