In-memory Activation Compression for GPT Training.
Seungyong LeeGeonu YunHyuk-Jae LeePublished in: AICAS (2023)
Keyphrases
- random access
- compression ratio
- data compression
- training set
- compression algorithm
- training examples
- training process
- online learning
- supervised learning
- image compression
- training samples
- information processing
- test set
- machine learning
- main memory
- multiresolution
- support vector
- video sequences
- training phase
- memory usage
- lossless compression
- training data