Fine-tune BERT with Sparse Self-Attention Mechanism.

Baiyun Cui Yingming Li Ming Chen Zhongfei Zhang

Published in: EMNLP/IJCNLP (1) (2019)

Keyphrases

fine tune
attention mechanism
visual attention
fine tuning
saliency map
pid controller
neural network
high level
visual attention model
particle swarm optimization
genetic algorithm
computer vision
fuzzy logic
control strategy