Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers.
Diana-Nicoleta GrigoreMariana-Iuliana GeorgescuJon Álvarez JustoTor Arne JohansenAndreea Iuliana IonescuRadu Tudor IonescuPublished in: CoRR (2024)
Keyphrases
- low rank
- missing data
- linear combination
- matrix factorization
- low rank matrix
- convex optimization
- singular value decomposition
- matrix completion
- rank minimization
- computer vision
- high dimensional data
- semi supervised
- high order
- matrix decomposition
- kernel matrix
- trace norm
- video data
- robust principal component analysis
- singular values
- video sequences
- data analysis
- low rank matrices
- image processing
- image restoration
- small number
- training set