Data-Informed Global Sparseness in Attention Mechanisms for Deep Neural Networks.
Ileana RuginaRumen DangovskiLi JingPreslav NakovMarin SoljacicPublished in: LREC/COLING (2024)
Keyphrases
- neural network
- data sets
- data processing
- data structure
- experimental data
- pattern recognition
- input data
- global information
- database
- data analysis
- high quality
- artificial neural networks
- global scale
- knowledge discovery
- image data
- data mining techniques
- genetic algorithm
- multi layer
- data acquisition
- raw data
- application domains
- historical data
- original data
- missing values
- decision trees
- sensor data
- missing data
- xml documents