Transformer based unsupervised pre-training for acoustic representation learning.
Ruixiong ZhangHaiwei WuWubo LiDongwei JiangWei ZouXiangang LiPublished in: CoRR (2020)
Keyphrases
- supervised learning
- learning speed
- unsupervised learning
- learning algorithm
- semi supervised
- training set
- online learning
- training samples
- learning process
- feature hierarchies
- deep architectures
- probabilistic model
- reinforcement learning
- recurrent networks
- learning problems
- data sets
- fault diagnosis
- online training
- learning stage
- multiple representations
- deep learning
- weakly supervised
- learning systems
- training data
- knowledge acquisition
- hidden markov models
- prior knowledge