Freetalker: Controllable Speech and Text-Driven Gesture Generation Based on Diffusion Models for Enhanced Speaker Naturalness.
Sicheng YangZunnan XuHaiwei XueYongkang ChengShaoli HuangMingming GongZhiyong WuPublished in: CoRR (2024)
Keyphrases
- diffusion models
- speech recognition
- automatic speech recognition
- speaker recognition
- synthesized speech
- audio visual
- text to speech
- diffusion model
- speaker verification
- prosodic features
- hidden markov models
- english text
- gesture recognition
- information diffusion
- speech signal
- speaker identification
- multimodal interfaces
- speaker diarization
- spontaneous speech
- vocal tract
- speaker dependent
- speech synthesis
- social networks
- influence maximization
- text mining