RoFormer: Enhanced Transformer with Rotary Position Embedding.

Jianlin Su Yu Lu Shengfeng Pan Bo Wen Yunfeng Liu

Published in: CoRR (2021)

Keyphrases

fuzzy logic
vector space
power system
position information
graph embedding
robust image watermarking
multiresolution
probabilistic model
computational intelligence
fault diagnosis
dynamic model
initial position