Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions.

Clement Neo Shay B. Cohen Fazl Barez

Published in: CoRR (2024)

Keyphrases

contextual information
information systems
genetic algorithm
multi layer perceptron
context dependent
context sensitive
data sets
context aware
artificial neural networks
human interactions
activation function
visual attention
multi agent
website
decision making
real world
neural network