BERT-EMD: Many-to-Many Layer Mapping for BERT Compression with Earth Mover's Distance.
Jianquan LiXiaokang LiuHonghong ZhaoRuifeng XuMin YangYaohong JinPublished in: EMNLP (1) (2020)
Keyphrases
- distance measure
- information preserving
- distance function
- euclidean distance
- data compression
- image compression
- compression algorithm
- compression ratio
- case study
- multi layer
- distance metric
- cross bin
- data sets
- hamming distance
- compression scheme
- euclidean space
- image data
- similarity search
- distance transform
- non stationary
- inter frame
- bit rate
- feature vectors
- lossless compression
- compressed data
- data structure
- information systems