LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation.
Xiaoqi JiaoYichun YinLifeng ShangXin JiangXiao ChenLinlin LiFang WangQun LiuPublished in: CoRR (2021)
Keyphrases
- experimental evaluation
- main contribution
- preprocessing
- optimization method
- cost function
- detection method
- similarity measure
- fully automatic
- high accuracy
- highly efficient
- synthetic data
- clustering method
- optimization algorithm
- theoretical analysis
- computational cost
- dynamic programming
- principal component analysis
- support vector machine
- classification method
- pairwise
- high quality