Neural Attention: Enhancing QKV Calculation in Self-Attention Mechanism with Neural Networks.
Muhan ZhangPublished in: CoRR (2023)
Keyphrases
- attention mechanism
- neural network
- visual attention
- network architecture
- saliency map
- visual attention model
- neural computation
- neural fuzzy
- neural model
- back propagation
- neural learning
- associative memory
- learning rules
- eye movements
- higher level
- artificial neural networks
- connectionist models
- feed forward
- neural network model
- computer vision
- bio inspired
- multi modal
- vision system
- high quality
- high level