Asymmetric Masked Distillation for Pre-Training Small Foundation Models.

Zhiyu Zhao Bingkun Huang Sen Xing Gangshan Wu Yu Qiao Limin Wang

Published in: CoRR (2023)

Keyphrases

complex systems
statistical models
image sequences
training examples
experimental data
artificial intelligence
social networks
bayesian networks
multi agent
probabilistic model
semi supervised
supervised learning
training samples
statistically significant
training algorithm
labeled data for training