Locality defeats the curse of dimensionality in convolutional teacher-student scenarios.