An Information-Theoretic Analysis of Compute-Optimal Neural Scaling Laws.

Hong Jun Jeon Benjamin Van Roy

Published in: CoRR (2022)

Keyphrases

neural network
optimal solution
network architecture
hidden markov models
dynamic programming
closed form
learning rules
optimal design
data sets
databases
evolutionary algorithm
associative memory
finding optimal