Weight-Inherited Distillation for Task-Agnostic BERT Compression.

Taiqiang Wu Cheng Hou Zhe Zhao Shanshan Lao Jiayi Li Ngai Wong Yujiu Yang

Published in: CoRR (2023)

Keyphrases

data compression
image compression
compression ratio
compression scheme
compression algorithm
weight assignment
weight function
hyperspectral image compression
database
compression rate
lossless compression
weighting scheme
shortest path
hidden markov models
case study
machine learning
databases