Self-attention Networks Localize When QK-eigenspectrum Concentrates.

Han Bao Ryuichiro Hataya Ryo Karakida

Published in: CoRR (2024)

Keyphrases

social networks
cellular networks
network structure
network analysis
telecommunication networks
cooperative
visual attention
databases
genetic algorithm
artificial intelligence
information systems
high bandwidth
information transfer