ROAM: memory-efficient large DNN training via optimized operator ordering and memory layout.

Huiyao Shu Ang Wang Ziji Shi Hanyu Zhao Yong Li Lu Lu

Published in: CoRR (2023)

Keyphrases

memory efficient
external memory
training process
memory size
memory requirements
mobile users
training phase
test set
partial order
training examples
memory space
online learning
training algorithm
computing power
supervised learning
iterative deepening
training data