What Happens To BERT Embeddings During Fine-tuning?

Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney

Published in: CoRR (2020)

Keyphrases

fine tuning
low dimensional
viable alternative
vector space
euclidean space
fine tune
fine tuned
manifold learning
dimensionality reduction
decision making
high dimensional data
information retrieval
hidden markov models
query processing
multiscale
image sequences
database systems
binary codes
neural network