W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training.
Yu-An ChungYu ZhangWei HanChung-Cheng ChiuJames QinRuoming PangYonghui WuPublished in: CoRR (2021)
Keyphrases
- language modeling
- language model
- information retrieval
- learning algorithm
- learning process
- supervised learning
- active learning
- query expansion
- probabilistic model
- retrieval model
- speech recognition
- n gram
- text categorization
- knowledge discovery
- data mining
- natural language
- bayesian networks
- feature extraction
- machine learning