Rare Words: A Major Problem for Contextualized Embeddings and How to Fix it by Attentive Mimicking.

Timo Schick Hinrich Schütze

Published in: AAAI (2020)

Keyphrases

keywords
euclidean space
word sense disambiguation
machine learning
biologically inspired
pre attentive
real time
word segmentation
text corpora
manifold learning
visual attention
vector space
text documents
n gram
dimensionality reduction
similarity measure
knowledge base
computer vision