Data-Informed Global Sparseness in Attention Mechanisms for Deep Neural Networks.
Ileana RuginaRumen DangovskiLi JingPreslav NakovMarin SoljacicPublished in: CoRR (2020)
Keyphrases
- neural network
- data sets
- data structure
- data analysis
- data collection
- image data
- global scale
- database
- complex data
- original data
- application domains
- statistical analysis
- data processing
- knowledge discovery
- data sources
- pattern recognition
- spatial data
- genetic algorithm
- high dimensional data
- data streams
- experimental data
- data points
- historical data
- information systems
- data objects
- decision trees
- raw data
- multimedia data
- data acquisition
- training data
- probability distribution
- sensor data
- missing data
- prior knowledge
- high quality
- input data