On Position Embeddings in BERT.

Benyou Wang Lifeng Shang Christina Lioma Xin Jiang Hao Yang Qun Liu Jakob Grue Simonsen

Published in: ICLR (2021)

Keyphrases

low dimensional
high dimensional data
vector space
database systems
wide range
dimensionality reduction
manifold learning
euclidean space
databases
information retrieval
computer vision
web pages
support vector
expert systems
semi supervised