Zero-Shot Sharpness-Aware Quantization for Pre-trained Language Models.
Miaoxi ZhuQihuang ZhongLi ShenLiang DingJuhua LiuBo DuDacheng TaoPublished in: CoRR (2023)
Keyphrases
- language model
- pre trained
- language modeling
- training data
- n gram
- probabilistic model
- information retrieval
- document retrieval
- query expansion
- training examples
- speech recognition
- language modelling
- retrieval model
- statistical language models
- language models for information retrieval
- test collection
- control signals
- relevance model
- document ranking
- supervised learning
- small number
- semi supervised learning
- smoothing methods
- multi modal
- multimedia