Know what you don't need: Single-Shot Meta-Pruning for attention heads.

Zhengyan Zhang Fanchao Qi Zhiyuan Liu Qun Liu Maosong Sun

Published in: AI Open (2021)

Keyphrases

single shot
search space
light field
visual attention
multimedia
pairwise
high dynamic range