ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking.
Wenshuo LiXinghao ChenHan ShuYehui TangYunhe WangPublished in: CoRR (2024)
Keyphrases
- data compression
- image compression
- fault tolerance
- learning rate
- compression ratio
- compression algorithm
- text compression
- joint optimization
- weighting scheme
- compression scheme
- computer vision
- neural network
- fault tolerant
- evolutionary algorithm
- objective function
- social networks
- compression rate
- search engine
- joint estimation
- optimal weights
- real world