Hard Prompts Made Interpretable: Sparse Entropy Regularization for Prompt Tuning with RL.
Yunseon ChoiSangmin BaeSeonghyun BanMinchan JeongChuheng ZhangLei SongLi ZhaoJiang BianKee-Eung KimPublished in: ACL (1) (2024)
Keyphrases
- sparsity regularization
- reinforcement learning
- mixed norm
- structured sparsity
- elastic net
- rank minimization
- information theoretic
- information theory
- high dimensional
- mutual information
- sparse approximation
- sparse data
- regularization parameter
- model free
- sparse representation
- sparse coding
- optimal policy
- state space
- multi agent
- parameter settings
- action selection
- information entropy
- canonical correlation analysis
- image restoration
- function approximation
- mental models
- sparsity constraints
- semi supervised
- sparse regression