Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT.

Jing Zhao Yifan Wang Junwei Bao Youzheng Wu Xiaodong He

Published in: CoRR (2022)

Keyphrases

coarse to fine
information retrieval
computer vision
databases
real world
data mining
multiscale
lightweight
cost effective
high efficiency
hybrid learning