Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes.
Lucio M. DerySteven KolawoleJean-Francois KageyVirginia SmithGraham NeubigAmeet TalwalkarPublished in: CoRR (2024)
Keyphrases
- search space
- pruning strategy
- pruning method
- pruning algorithm
- structured data
- structured learning
- search algorithm
- candidate pruning
- forward and backward
- mining algorithm
- effective pruning
- bi directional
- machine learning
- bayesian networks
- database systems
- image processing
- pruning methods
- search engine
- artificial intelligence