The Sparsity Roofline: Understanding the Hardware Limits of Sparse Neural Networks.
Cameron ShinnCollin McCarthySaurav MuralidharanMuhammad OsamaJohn D. OwensPublished in: CoRR (2023)
Keyphrases
- neural network
- sparse representation
- high dimensional
- low cost
- sparsity constraints
- real time
- sparse approximation
- hardware and software
- image processing
- pattern recognition
- basis pursuit
- genetic algorithm
- neural nets
- sparse data
- massively parallel
- fuzzy systems
- feed forward
- fault diagnosis
- compressed sensing
- mixed norm
- sparse approximations
- dictionary learning
- training process
- sparse coding
- denoising
- fuzzy logic
- learning algorithm