Excess Risk of Two-Layer ReLU Neural Networks in Teacher-Student Settings and its Superiority to Kernel Methods.

Shunta Akiyama Taiji Suzuki

Published in: CoRR (2022)

Keyphrases

kernel methods
neural network
teacher student
kernel function
support vector
machine learning
support vector machine
feature space
kernel matrix
reproducing kernel hilbert space
online learning
kernel pca
kernel matrices
kernel ridge regression
multiple kernel
multiple kernel learning
teaching strategies