Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning.

Naibin Gu Peng Fu Xiyu Liu Bowen Shen Zheng Lin Weiping Wang

Published in: ACL (Findings) (2024)

Keyphrases

fine tuning
fine tune
search space
effective pruning
pruning strategy
input parameters
tree pruning
pruning method
viable alternative
tree construction
database
transfer function
cost effective
lightweight
information systems
machine learning
real world
data sets