S-Cyc: A Learning Rate Schedule for Iterative Pruning of ReLU-based Networks.
Shiyu LiuChong Min John TanMehul MotaniPublished in: CoRR (2021)
Keyphrases
- learning rate
- convergence rate
- learning algorithm
- error function
- knowledge base
- hidden layer
- rapid convergence
- convergence speed
- multilayer neural networks
- adaptive learning rate
- training algorithm
- scheduling problem
- search space
- neural network
- activation function
- weight vector
- social networks
- upper level
- state space
- convergence theorem
- bp neural network algorithm
- delta bar delta