Entropy Penalty: Towards Generalization Beyond the IID Assumption.
Devansh ArpitCaiming XiongRichard SocherPublished in: CoRR (2019)
Keyphrases
- independent and identically distributed
- independently and identically distributed
- mutual information
- information theory
- identically distributed
- information theoretic
- objective function
- expert systems
- information content
- method assumes
- entropy measure
- relative entropy
- learning machines
- databases
- lower bound
- database systems
- three dimensional
- information systems