On-line learning dynamics of ReLU neural networks using statistical physics techniques.

Michiel Straat Michael Biehl

Published in: ESANN (2019)

Keyphrases

statistical physics
neural network
game theory
learning curves
information theory
belief propagation
computer science
information theoretic
machine learning
learning curve
learning algorithm
multi agent systems
worst case
average case
competitive learning
deterministic annealing
data mining