Improve Transformer Models with Better Relative Position Embeddings.

Zhiheng Huang Davis Liang Peng Xu Bing Xiang

Published in: CoRR (2020)

Keyphrases

relative position
probabilistic model
neural network
image processing
closely related
multiscale
fault diagnosis