Faster Convergence for Transformer Fine-tuning with Line Search Methods.
Philip KennewegLeonardo GalliTristan KennewegBarbara HammerPublished in: IJCNN (2023)
Keyphrases
- search methods
- fine tuning
- faster convergence
- search algorithm
- viable alternative
- convergence speed
- step size
- search strategies
- metaheuristic
- fine tune
- global optimization
- pso algorithm
- global optimum
- fuzzy logic
- fault diagnosis
- beam search
- exhaustive search
- particle swarm optimization
- systematic search
- unconstrained optimization
- nearest neighbor search
- ant colony optimization
- fine tuned
- graph search
- genetic programming