Spectral Pruning: Compressing Deep Neural Networks via Spectral Analysis and its Generalization Error.
Taiji SuzukiHiroshi AbeTomoya MurataShingo HoriuchiKotaro ItoTokuma WachiSo HiraiMasatoshi YukishimaTomoaki NishimuraPublished in: IJCAI (2020)
Keyphrases
- spectral analysis
- generalization error
- neural network
- cross validation
- model selection
- upper bound
- learning algorithm
- active learning
- training set
- spectral methods
- training data
- spectral features
- training error
- pattern recognition
- sample size
- supervised learning
- autoregressive
- artificial neural networks
- back propagation
- multilayer perceptron
- subspace information criterion
- training process
- filter bank
- neural nets
- data sets
- speech signal
- heart rate variability
- feed forward
- boosting algorithms
- hidden layer
- image segmentation
- lower bound
- reinforcement learning