Introducing inductive bias on vision transformers through Gram matrix similarity based regularization.
Luiz Henrique MormilleClifford Broni-BediakoMasayasu AtsumiPublished in: Artif. Life Robotics (2023)
Keyphrases
- inductive bias
- gram matrix
- inductive learning
- machine learning
- pac learning
- positive definite
- domain knowledge
- supervised learning
- multitask learning
- domain theory
- hypothesis space
- prior knowledge
- training examples
- gaussian processes
- kernel function
- kernel pca
- sparse matrix
- computer vision
- training set
- active learning
- learning algorithm
- semi supervised learning
- rows and columns
- decision trees
- feature extraction
- high dimensional
- special case
- sample complexity
- uniform distribution
- semi supervised
- learning theory
- dimensionality reduction
- sample size