Memory-efficient Training of LLMs with Larger Mini-batches.

Dang Nguyen Wenhan Yang Rathul Anand Yu Yang Baharan Mirzasoleiman

Published in: CoRR (2024)

Keyphrases

memory efficient
training set
external memory
case study
training process
iterative deepening
database
neural network
support vector
search space
text classification
training examples
matching algorithm
multiple sequence alignment
computer software