Why bother with geometry? On the relevance of linear decompositions of Transformer embeddings.

Timothee Mickus Raúl Vázquez

Published in: CoRR (2023)

Keyphrases

hilbert space
low dimensional
information retrieval
vector space
manifold learning
linear subspace
relevance feedback
dimensionality reduction
linear systems
computer vision
three dimensional
fuzzy logic
least squares
search engine
closed form
linear model
linear constraints
genetic algorithm