ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalization.
Weixin LiuXuyi ChenJiaxiang LiuShikun FengYu SunHao TianHua WuPublished in: CoRR (2023)
Keyphrases
- evaluation method
- high precision
- main contribution
- theoretical analysis
- similarity measure
- high accuracy
- clustering method
- experimental evaluation
- classification accuracy
- segmentation method
- statistical model
- objective function
- computational cost
- significant improvement
- k means
- detection algorithm
- pairwise
- detection method
- preprocessing