Login / Signup
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning.
Yupeng Chen
Senmiao Wang
Zhihang Lin
Zeyu Qin
Yushun Zhang
Tian Ding
Ruoyu Sun
Published in:
CoRR (2024)
Keyphrases
</>
fine tuning
fine tune
viable alternative
learning rate
optimization algorithm
incremental learning
query optimization
fine tuned
risk management
low pass
general purpose
learning process
relational databases
decision making
feature extraction
database systems
data mining
neural network