Demystifying the Compression of Mixture-of-Experts Through a Unified Framework.
Shwai HeDaize DongLiang DingAng LiPublished in: CoRR (2024)
Keyphrases
- compression scheme
- image compression
- data compression
- mixture model
- compression ratio
- domain experts
- text compression
- compression algorithm
- data sets
- compression rate
- expectation maximization
- expert finding
- mixture modeling
- real time
- human experts
- gaussian mixture model
- gaussian distribution
- high quality
- image processing
- compressed data
- logit model