PatrickStar: Parallel Training of Pre-trained Models via a Chunk-based Memory Management.

Jiarui Fang Yang Yu Shenggui Li Yang You Jie Zhou

Published in: CoRR (2021)

Keyphrases

pre trained
memory management
probabilistic model
operating system
computer vision
information systems
database systems
data sets
feature extraction
video sequences
support vector
viewpoint
small number
computer systems
generative model
hardware implementation