The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation.
Kushal AroraTimothy J. O'DonnellDoina PrecupJason WestonJackie Chi Kit CheungPublished in: CoRR (2023)
Keyphrases
- natural language generation
- learning algorithm
- detection algorithm
- optimal solution
- relative entropy
- search space
- information entropy
- objective function
- k means
- dynamic programming
- worst case
- mutual information
- computationally efficient
- simulated annealing
- probabilistic model
- computational complexity
- knowledge acquisition
- information theoretic
- np hard
- human computer
- minimum error
- euler number