How Uniform Random Weights Induce Non-uniform Bias: Typical Interpolating Neural Networks Generalize with Narrow Teachers.
Gon BuzagloItamar HarelMor Shpigel NacsonAlon BrutzkusNathan SrebroDaniel SoudryPublished in: CoRR (2024)
Keyphrases
- uniform random
- neural network
- learning environment
- weight update
- professional development
- learning community
- pattern recognition
- learning process
- linear combination
- artificial neural networks
- authoring tool
- hidden neurons
- student learning
- basis functions
- constraint networks
- fuzzy logic
- learning scenarios
- neural network model
- high school
- activation function
- high school students
- multilayer perceptron
- back propagation
- hidden layer
- educational technology
- teaching materials
- science education
- elementary school
- secondary school