data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language.
Alexei BaevskiWei-Ning HsuQiantong XuArun BabuJiatao GuMichael AuliPublished in: CoRR (2022)
Keyphrases
- data sets
- database
- real time
- language acquisition
- original data
- image data
- learning algorithm
- prior knowledge
- high quality
- synthetic data
- computer vision
- noisy data
- learning process
- background knowledge
- statistical analysis
- data collection
- data quality
- raw data
- learning systems
- high dimensional data
- probability distribution
- data sources
- data analysis
- natural language
- metadata
- data mining
- online learning
- learning tasks
- learning models
- databases