RefBERT: Compressing BERT by Referencing to Pre-computed Representations.

Xinyi Wang Haiqin Yang Liang Zhao Yang Mo Jianping Shen

Published in: IJCNN (2021)

Keyphrases

pre computed
database
index tree
disk space
neural network
data cube
information content
storage cost
multiple representations
category specific
database systems
symbolic representation
distributed representations