ProTrain: Efficient LLM Training via Memory-Aware Techniques.

Hanmei Yang Jin Zhou Yao Fu Xiaoqun Wang Ramine Roane Hui Guan Tongping Liu

Published in: CoRR (2024)

Keyphrases

neural network
computationally expensive
high efficiency
limited memory
data sets
genetic algorithm
knowledge base
case study
training data
expert systems
evolutionary algorithm
computationally efficient
parallel algorithm
memory requirements
serious games
training process