No Free Prune: Information-Theoretic Barriers to Pruning at Initialization.
Tanishq KumarKevin LuoMark SellkePublished in: CoRR (2024)
Keyphrases
- information theoretic
- search space
- mutual information
- information theory
- pruning strategy
- information bottleneck
- theoretic framework
- jensen shannon divergence
- relative entropy
- kullback leibler divergence
- candidate pruning
- multi modality
- kl divergence
- k means
- entropy measure
- information theoretic measures
- log likelihood
- graphical models
- computational learning theory
- pattern recognition
- similarity measure
- data mining