Better Fine-Tuning by Reducing Representational Collapse.

Armen Aghajanyan Akshat Shrivastava Anchit Gupta Naman Goyal Luke Zettlemoyer Sonal Gupta

Published in: CoRR (2020)

Keyphrases

fine tuning
viable alternative
fine tune
fine tuned
data structure
significantly reduced
real time
management system
general purpose
least squares
case based reasoning
evolutionary algorithm
relational databases
pairwise
objective function
training data
decision making
neural network