EasyQuant: An Efficient Data-free Quantization Algorithm for LLMs.
Hanlin TangYifu SunDecheng WuKai LiuJianchen ZhuZhanhui KangPublished in: EMNLP (2023)
Keyphrases
- input data
- data sets
- learning algorithm
- high quality
- dynamic programming
- computational complexity
- original data
- incomplete data
- np hard
- cost function
- optimization algorithm
- k means
- preprocessing
- data structure
- synthetic datasets
- data sources
- prior information
- database
- detection algorithm
- data collection
- information loss
- data reduction
- dimensional data
- recognition algorithm
- noisy data
- matching pursuit
- single scan
- computationally efficient
- worst case
- image data
- knowledge discovery
- training data
- neural network
- particle swarm optimization
- synthetic data
- dimensionality reduction
- probabilistic model
- search space
- data analysis
- objective function
- similarity measure