Towards Understanding the Word Sensitivity of Attention Layers: A Study via Random Features.

Simone Bombari Marco Mondelli

Published in: CoRR (2024)

Keyphrases

statistical analysis
co occurrence
feature vectors
low level
feature set
neural network
web pages
similarity measure
image features
empirical studies
n gram
word sense disambiguation
deeper understanding