From PEFT to DEFT: Parameter Efficient Finetuning for Reducing Activation Density in Transformers.

Bharat Runwal Tejaswini Pedapati Pin-Yu Chen

Published in: CoRR (2024)

Keyphrases

genetic algorithm
real world
decision trees
search algorithm
neural network
data mining
decision making
three dimensional
relational databases
parameter estimation
cost effective
parameter settings