Rare Words: A Major Problem for Contextualized Embeddings And How to Fix it by Attentive Mimicking.

Timo Schick Hinrich Schütze

Published in: CoRR (2019)

Keyphrases

data sets
computer vision
biologically inspired
neural network
n gram
keywords
natural language processing
dimensionality reduction
word sense disambiguation
euclidean space