What Happens To BERT Embeddings During Fine-tuning?

Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney

Published in: BlackboxNLP@EMNLP (2020)

Keyphrases

fine tuning
vector space
fine tune
viable alternative
low dimensional
manifold learning
euclidean space
dimensionality reduction
fine tuned
hilbert space
neural network
relational databases
distance measure
high dimensional data
image retrieval
feature space
data analysis
high level
clustering algorithm
database