Transformers as Algorithms: Generalization and Implicit Model Selection in In-context Learning.
Yingcong LiM. Emrullah IldizDimitris S. PapailiopoulosSamet OymakPublished in: CoRR (2023)
Keyphrases
- model selection
- learning algorithm
- learning machines
- statistical learning
- bayesian learning
- generalization bounds
- cross validation
- bayesian methods
- meta learning
- hyperparameters
- learning problems
- error estimation
- parameter estimation
- learning models
- statistical inference
- unsupervised learning
- automatic model selection
- gaussian process
- incremental learning
- learning tasks
- mutual information
- supervised learning
- selection criterion
- machine learning
- feature selection
- bayesian approaches
- posterior distribution
- machine learning algorithms
- closed form
- kernel machines
- parameter determination