data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language.
Alexei BaevskiWei-Ning HsuQiantong XuArun BabuJiatao GuMichael AuliPublished in: ICML (2022)
Keyphrases
- training data
- data sets
- data collection
- data sources
- language acquisition
- raw data
- data processing
- database
- learning process
- prior knowledge
- learning models
- synthetic data
- online learning
- learning algorithm
- high dimensional data
- end users
- input data
- bayesian networks
- data analysis
- supervised learning
- spatial data
- language learning
- databases
- data structure
- object oriented programming
- pattern languages
- relational databases