Transformer Based Unsupervised Pre-Training for Acoustic Representation Learning.
Ruixiong ZhangHaiwei WuWubo LiDongwei JiangWei ZouXiangang LiPublished in: ICASSP (2021)
Keyphrases
- supervised learning
- deep architectures
- online learning
- unsupervised learning
- learning process
- reinforcement learning
- learning stage
- learning systems
- learning algorithm
- online training
- learning tasks
- training set
- fuzzy logic
- power system
- background knowledge
- expert systems
- cognitive load
- feedforward neural networks
- deep learning
- object recognition
- recurrent networks
- e learning
- computer based training
- data sets
- feature hierarchies