SPION: Layer-Wise Sparse Training of Transformer via Convolutional Flood Filling.
Bokyeong YoonYoonsang HanGordon Euhyun MoonPublished in: CoRR (2023)
Keyphrases
- restricted boltzmann machine
- sparse coding
- deep learning
- avoid overfitting
- sparse representation
- fuzzy logic
- genetic algorithm
- deep belief networks
- compressive sensing
- multi layer
- unsupervised learning
- high dimensional
- fault diagnosis
- recurrent neural networks
- training algorithm
- natural images
- compressed sensing
- image classification
- linear svm
- application layer
- decision making
- data sets