Improving Audio-Visual Speech Recognition by Lip-Subword Correlation Based Visual Pre-training and Cross-Modal Fusion Encoder.
Yusheng DaiHang ChenJun DuXiaofei DingNing DingFeijun JiangChin-Hui LeePublished in: ICME (2023)
Keyphrases
- cross modal
- audio visual speech recognition
- multi modal
- audio visual
- multi stream
- visual data
- multimedia retrieval
- speech recognition
- visual speech
- image retrieval
- perceptual information
- multimedia databases
- noisy environments
- visual recognition
- visual similarity
- visual features
- training set
- retrieval systems
- gaussian mixture model
- visual information
- information retrieval
- language model