Layer-Wise Sparse Training of Transformer via Convolutional Flood Filling.
Bokyeong YoonYoonsang HanGordon Euhyun MoonPublished in: PAKDD (2) (2024)
Keyphrases
- restricted boltzmann machine
- sparse coding
- high dimensional
- training set
- pairwise
- test set
- deep learning
- training process
- multi layer
- avoid overfitting
- deep belief networks
- fuzzy logic
- sparse representation
- artificial intelligence
- feed forward neural networks
- fault diagnosis
- application layer
- training algorithm
- conditional random fields
- online learning
- image classification
- expert systems
- object recognition