Frank K. Soong

ORCID

Publication Activity (10 Years)

Years Active: 1978-2024
Publications (10 Years): 79

Top Venues

CoRR

ICASSP

INTERSPEECH

IEEE ACM Trans. Audio Speech Lang. Process.

Publications

Xu Tan, Jiawei Chen, Haohe Liu, Jian Cong, Chen Zhang, Yanqing Liu, Xi Wang, Yichong Leng, Yuanhao Yi, Lei He, Sheng Zhao, Tao Qin, Frank K. Soong, Tie-Yan Liu
NaturalSpeech: End-to-End Text-to-Speech Synthesis With Human-Level Quality. IEEE Trans. Pattern Anal. Mach. Intell. 46 (6) (2024)
Yujia Xiao, Shaofei Zhang, Xi Wang, Xu Tan, Lei He, Sheng Zhao, Frank K. Soong, Tan Lee
ContextSpeech: Expressive and Efficient Text-to-Speech for Paragraph Reading. CoRR (2023)
Haohan Guo, Fenglong Xie, Xixin Wu, Frank K. Soong, Helen Meng
MSMC-TTS: Multi-Stage Multi-Codebook VQ-VAE Based Neural TTS. IEEE ACM Trans. Audio Speech Lang. Process. 31 (2023)
Yujia Xiao, Shaofei Zhang, Xi Wang, Xu Tan, Lei He, Sheng Zhao, Frank K. Soong, Tan Lee
ContextSpeech: Expressive and Efficient Text-to-Speech for Paragraph Reading. INTERSPEECH (2023)
Xiaochun An, Frank K. Soong, Lei Xie
Disentangling Style and Speaker Attributes for TTS Style Transfer. IEEE ACM Trans. Audio Speech Lang. Process. 30 (2022)
Bin Su, Shaoguang Mao, Frank K. Soong, Zhiyong Wu
Ordinal Regression via Binary Preference vs Simple Regression: Statistical and Experimental Perspectives. CoRR (2022)
Xiaochun An, Frank K. Soong, Lei Xie
Disentangling Style and Speaker Attributes for TTS Style Transfer. CoRR (2022)
Shaoguang Mao, Frank K. Soong, Yan Xia, Jonathan Tien
A Universal Ordinal Regression for Assessing Phoneme-Level Pronunciation. ICASSP (2022)
Xu Tan, Jiawei Chen, Haohe Liu, Jian Cong, Chen Zhang, Yanqing Liu, Xi Wang, Yichong Leng, Yuanhao Yi, Lei He, Frank K. Soong, Tao Qin, Sheng Zhao, Tie-Yan Liu
NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality. CoRR (2022)
Haohan Guo, Feng-Long Xie, Frank K. Soong, Xixin Wu, Helen Meng
A Multi-Stage Multi-Codebook VQ-VAE Approach to High-Performance Neural TTS. CoRR (2022)
Yujia Xiao, Xi Wang, Lei He, Frank K. Soong
Improving Fastspeech TTS with Efficient Self-Attention and Compact Feed-Forward Network. ICASSP (2022)
Liumeng Xue, Frank K. Soong, Shaofei Zhang, Lei Xie
ParaTTS: Learning Linguistic and Prosodic Cross-sentence Information in Paragraph-based TTS. CoRR (2022)
Liumeng Xue, Frank K. Soong, Shaofei Zhang, Lei Xie
ParaTTS: Learning Linguistic and Prosodic Cross-Sentence Information in Paragraph-Based TTS. IEEE ACM Trans. Audio Speech Lang. Process. 30 (2022)
Mutian He, Jingzhou Yang, Lei He, Frank K. Soong
Neural Lexicon Reader: Reduce Pronunciation Errors in End-to-end TTS by Leveraging External Textual Knowledge. INTERSPEECH (2022)
Wenxuan Ye, Shaoguang Mao, Frank K. Soong, Wenshan Wu, Yan Xia, Jonathan Tien, Zhiyong Wu
An Approach to Mispronunciation Detection and Diagnosis with Acoustic, Phonetic and Linguistic (APL) Embeddings. ICASSP (2022)
Haohan Guo, Feng-Long Xie, Frank K. Soong, Xixin Wu, Helen Meng
A Multi-Stage Multi-Codebook VQ-VAE Approach to High-Performance Neural TTS. INTERSPEECH (2022)
Liping Chen, Yan Deng, Xi Wang, Frank K. Soong, Lei He
Speech Bert Embedding for Improving Prosody in Neural TTS. ICASSP (2021)
Mutian He, Jingzhou Yang, Lei He, Frank K. Soong
Neural Lexicon Reader: Reduce Pronunciation Errors in End-to-end TTS by Leveraging External Textual Knowledge. CoRR (2021)
Mutian He, Jingzhou Yang, Lei He, Frank K. Soong
Multilingual Byte2Speech Models for Scalable Low-resource Speech Synthesis. CoRR (2021)
Wenxuan Ye, Shaoguang Mao, Frank K. Soong, Wenshan Wu, Yan Xia, Jonathan Tien, Zhiyong Wu
An Approach to Mispronunciation Detection and Diagnosis with Acoustic, Phonetic and Linguistic (APL) Embeddings. CoRR (2021)
Liping Chen, Yan Deng, Xi Wang, Frank K. Soong, Lei He
Speech BERT Embedding For Improving Prosody in Neural TTS. CoRR (2021)
Liumeng Xue, Shifeng Pan, Lei He, Lei Xie, Frank K. Soong
Cycle consistent network for end-to-end style transfer TTS training. Neural Networks 140 (2021)
Xiaochun An, Frank K. Soong, Lei Xie
Improving Performance of Seen and Unseen Speech Style Transfer in End-to-end Neural TTS. CoRR (2021)
Xu Tan, Tao Qin, Frank K. Soong, Tie-Yan Liu
A Survey on Neural Speech Synthesis. CoRR (2021)
Xiaochun An, Frank K. Soong, Shan Yang, Lei Xie
Effective and direct control of neural TTS prosody by removing interactions between different attributes. Neural Networks 143 (2021)
Xiaochun An, Frank K. Soong, Lei Xie
Improving Performance of Seen and Unseen Speech Style Transfer in End-to-End Neural TTS. Interspeech (2021)
Bin Su, Shaoguang Mao, Frank K. Soong, Yan Xia, Jonathan Tien, Zhiyong Wu
Improving Pronunciation Assessment Via Ordinal Regression with Anchored Reference Samples. ICASSP (2021)
Yichong Leng, Xu Tan, Sheng Zhao, Frank K. Soong, Xiangyang Li, Tao Qin
MBNet: MOS Prediction for Synthesized Speech with Mean-Bias Network. CoRR (2021)
Feng-Long Xie, Xinhui Li, Wen-Chao Su, Li Lu, Frank K. Soong
A New High Quality Trajectory Tiling Based Hybrid TTS In Real Time. ICASSP (2021)
Yichong Leng, Xu Tan, Sheng Zhao, Frank K. Soong, Xiang-Yang Li, Tao Qin
MBNET: MOS Prediction for Synthesized Speech with Mean-Bias Network. ICASSP (2021)
Haohan Guo, Shaofei Zhang, Frank K. Soong, Lei He, Lei Xie
Conversational End-to-End TTS for Voice Agents. SLT (2021)
Liping Chen, Kong-Aik Lee, Lei He, Frank K. Soong
On Early-stop Clustering for Speaker Diarization. Odyssey (2020)
Yang Cui, Xi Wang, Lei He, Frank K. Soong
An Efficient Subband Linear Prediction for LPCNet-Based Neural Synthesis. INTERSPEECH (2020)
Bin Su, Shaoguang Mao, Frank K. Soong, Yan Xia, Jonathan Tien, Zhiyong Wu
Improving pronunciation assessment via ordinal regression with anchored reference samples. CoRR (2020)
Min-Jae Hwang, Eunwoo Song, Ryuichi Yamamoto, Frank K. Soong, Hong-Goo Kang
Improving LPCNET-Based Text-to-Speech with Linear Prediction-Structured Mixture Density Network. ICASSP (2020)
Xi Wang, Huaiping Ming, Lei He, Frank K. Soong
s-Transformer: Segment-Transformer for Robust Neural Speech Synthesis. CoRR (2020)
Min-Jae Hwang, Frank K. Soong, Eunwoo Song, Xi Wang, Hyeonjoo Kang, Hong-Goo Kang
LP-WaveNet: Linear Prediction-based WaveNet Speech Synthesis. APSIPA (2020)
Yujia Xiao, Lei He, Huaiping Ming, Frank K. Soong
Improving Prosody with Linguistic and Bert Derived Features in Multi-Speaker Based Mandarin Chinese Neural TTS. ICASSP (2020)
Feng-Long Xie, Xinhui Li, Bo Liu, Yibin Zheng, Li Meng, Li Lu, Frank K. Soong
An Improved Frame-Unit-Selection Based Voice Conversion System Without Parallel Training Data. ICASSP (2020)
Yao Qian, Rutuja Ubale, Patrick L. Lange, Keelan Evanini, Vikram Ramanarayanan, Frank K. Soong
Spoken Language Understanding of Human-Machine Conversations for Language Learning Applications. J. Signal Process. Syst. 92 (8) (2020)
Yuanbo Hou, Frank K. Soong, Jian Luan, Shengchen Li
Transfer Learning for Improving Singing-voice Detection in Polyphonic Instrumental Music. CoRR (2020)
Haohan Guo, Shaofei Zhang, Frank K. Soong, Lei He, Lei Xie
Conversational End-to-End TTS for Voice Agent. CoRR (2020)
Yuanbo Hou, Frank K. Soong, Jian Luan, Shengchen Li
Transfer Learning for Improving Singing-Voice Detection in Polyphonic Instrumental Music. INTERSPEECH (2020)
Haohan Guo, Frank K. Soong, Lei He, Lei Xie
Exploiting Syntactic Features in a Parsed Tree to Improve End-to-End TTS. INTERSPEECH (2019)
Yibin Zheng, Xi Wang, Lei He, Shifeng Pan, Frank K. Soong, Zhengqi Wen, Jianhua Tao
Forward-Backward Decoding for Regularizing End-to-End TTS. CoRR (2019)
Haohan Guo, Frank K. Soong, Lei He, Lei Xie
A New GAN-Based End-to-End TTS Training Algorithm. INTERSPEECH (2019)
Feng-Long Xie, Frank K. Soong, Haifeng Li
Voice conversion with SI-DNN and KL divergence based mapping without parallel training data. Speech Commun. 106 (2019)
Huaiping Ming, Lei He, Haohan Guo, Frank K. Soong
Feature reinforcement with word embedding and parsing information in neural TTS. CoRR (2019)
Yibin Zheng, Xi Wang, Lei He, Shifeng Pan, Frank K. Soong, Zhengqi Wen, Jianhua Tao
Forward-Backward Decoding for Regularizing End-to-End TTS. INTERSPEECH (2019)
Shaoguang Mao, Zhiyong Wu, Jingshuai Jiang, Peiyun Liu, Frank K. Soong
NN-based Ordinal Regression for Assessing Fluency of ESL Speech. ICASSP (2019)
Haohan Guo, Frank K. Soong, Lei He, Lei Xie
Exploiting Syntactic Features in a Parsed Tree to Improve End-to-End TTS. CoRR (2019)
Jingyong Hou, Pengcheng Guo, Sining Sun, Frank K. Soong, Wenping Hu, Lei Xie
Domain Adversarial Training for Improving Keyword Spotting Performance of ESL Speech. ICASSP (2019)
Haohan Guo, Frank K. Soong, Lei He, Lei Xie
A New GAN-based End-to-End TTS Training Algorithm. CoRR (2019)
Ke Wang, Frank K. Soong, Lei Xie
A Pitch-aware Approach to Single-channel Speech Separation. ICASSP (2019)
Liping Chen, Yong Zhao, Shi-Xiong Zhang, Jie Li, Guoli Ye, Frank K. Soong
Exploring Sequential Characteristics in Speaker Bottleneck Feature for Text-Dependent Speaker Verification. ICASSP (2018)
Yan Deng, Lei He, Frank K. Soong
Modeling Multi-speaker Latent Space to Improve Neural TTS: Quick Enrolling New Speaker and Enhancing Premium Voice. CoRR (2018)
Jingyong Hou, Wenping Hu, Frank K. Soong, Lei Xie
A Refined Query-by-Example Approach to Spoken-Term-Detection on ESL learners' Speech. ISCSLP (2018)
Yang Cui, Xi Wang, Lei He, Frank K. Soong
A New Glottal Neural Vocoder for Speech Synthesis. INTERSPEECH (2018)
Yujia Xiao, Frank K. Soong, Wenping Hu
Paired Phone-Posteriors Approach to ESL Pronunciation Quality Assessment. INTERSPEECH (2018)
Yao Qian, Rutuja Ubale, Patrick L. Lange, Keelan Evanini, Frank K. Soong
From Speech Signals to Semantics - Tagging Performance at Acoustic, Phonetic and Word Levels. ISCSLP (2018)
Min-Jae Hwang, Frank K. Soong, Feng-Long Xie, Xi Wang, Hong-Goo Kang
LP-WaveNet: Linear Prediction-based WaveNet Speech Synthesis. CoRR (2018)
Feng-Long Xie, Frank K. Soong, Xi Wang, Lei He, Haifeng Li
Frame Selection in SI-DNN Phonetic Space with WaveNet Vocoder for Voice Conversion without Parallel Training Data. ISCSLP (2018)
Eunwoo Song, Frank K. Soong, Hong-Goo Kang
Perceptual quality and modeling accuracy of excitation parameters in DLSTM-based speech synthesis systems. ASRU (2017)
Yao Qian, Keelan Evanini, Patrick L. Lange, Robert A. Pugh, Rutuja Ubale, Frank K. Soong
Improving native language (L1) identifation with better VAD and TDNN trained separately on native and non-native English corpora. ASRU (2017)
Eunwoo Song, Frank K. Soong, Hong-Goo Kang
Effective Spectral and Excitation Modeling Techniques for LSTM-RNN-Based Speech Synthesis Systems. IEEE ACM Trans. Audio Speech Lang. Process. 25 (11) (2017)
Jinghua Zhong, Wenping Hu, Frank K. Soong, Helen Meng
DNN i-Vector Speaker Verification with Short, Text-Constrained Test Utterances. INTERSPEECH (2017)
Yao Qian, Keelan Evanini, Xinhao Wang, David Suendermann-Oeft, Robert A. Pugh, Patrick L. Lange, Hillary R. Molloy, Frank K. Soong
Improving Sub-Phone Modeling for Better Native Language Identification with Non-Native English Speech. INTERSPEECH (2017)
Yujia Xiao, Frank K. Soong
Proficiency Assessment of ESL Learner's Sentence Prosody with TTS Synthesized Voice as Reference. INTERSPEECH (2017)
Linlin Wang, Jun Wang, Lantian Li, Thomas Fang Zheng, Frank K. Soong
Improving speaker verification performance against long-term speaker variability. Speech Commun. 79 (2016)
Yuchen Fan, Yao Qian, Frank K. Soong, Lei He
Speaker and language factorization in DNN-based TTS synthesis. ICASSP (2016)
Feng-Long Xie, Frank K. Soong, Haifeng Li
A KL divergence and DNN approach to cross-lingual TTS. ICASSP (2016)
Peilu Wang, Yao Qian, Frank K. Soong, Lei He, Hai Zhao
Learning Distributed Word Representations For Bidirectional LSTM Recurrent Neural Network. HLT-NAACL (2016)
Feng-Long Xie, Frank K. Soong, Haifeng Li
A KL Divergence and DNN-Based Approach to Voice Conversion without Parallel Training Sentences. INTERSPEECH (2016)
Bo Fan, Lei Xie, Shan Yang, Lijuan Wang, Frank K. Soong
A deep bidirectional LSTM approach for video-realistic talking head. Multim. Tools Appl. 75 (9) (2016)
Xiang Yin, Ming Lei, Yao Qian, Frank K. Soong, Lei He, Zhen-Hua Ling, Li-Rong Dai
Modeling F0 trajectories in hierarchically structured deep neural networks. Speech Commun. 76 (2016)
Eunwoo Song, Frank K. Soong, Hong-Goo Kang
Improved Time-Frequency Trajectory Excitation Vocoder for DNN-Based Speech Synthesis. INTERSPEECH (2016)
Xiaojun Qian, Helen M. Meng, Frank K. Soong
A Two-Pass Framework of Mispronunciation Detection and Diagnosis for Computer-Aided Pronunciation Training. IEEE ACM Trans. Audio Speech Lang. Process. 24 (6) (2016)
Wenping Hu, Frank K. Soong
KL-divergence based mispronunciation detection via DNN and decision tree in the phonetic space. APSIPA (2016)
Yuchen Fan, Yao Qian, Frank K. Soong, Lei He
Unsupervised speaker adaptation for DNN-based TTS synthesis. ICASSP (2016)
Xiaojun Qian, Helen M. Meng, Frank K. Soong
A two-pass framework of mispronunciation detection & diagnosis for computer-aided pronunciation training. APSIPA (2015)
Peilu Wang, Yao Qian, Frank K. Soong, Lei He, Hai Zhao
Word embedding for recurrent neural network based TTS synthesis. ICASSP (2015)
Wenping Hu, Yao Qian, Frank K. Soong, Yong Wang
Improved mispronunciation detection with deep neural network trained acoustic models and transfer learning based logistic regression classifiers. Speech Commun. 67 (2015)
Peilu Wang, Yao Qian, Frank K. Soong, Lei He, Hai Zhao
A Unified Tagging Solution: Bidirectional LSTM Recurrent Neural Network with Word Embedding. CoRR (2015)
Frank K. Soong, Lijuan Wang
From text-to-speech (TTS) to talking head - a machine learning approach to A/V speech modeling and rendering. AVSP (2015)
Lijuan Wang, Frank K. Soong
HMM trajectory-guided sample selection for photo-realistic talking head. Multim. Tools Appl. 74 (22) (2015)
Bo Fan, Lijuan Wang, Frank K. Soong, Lei Xie
Photo-real talking head with deep bidirectional LSTM. ICASSP (2015)
Yuchen Fan, Yao Qian, Frank K. Soong, Lei He
Multi-speaker modeling and speaker adaptation for DNN-based TTS synthesis. ICASSP (2015)
Peilu Wang, Yao Qian, Frank K. Soong, Lei He, Hai Zhao
Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Recurrent Neural Network. CoRR (2015)
Yuchen Fan, Yao Qian, Frank K. Soong, Lei He
Sequence generation error (SGE) minimization based deep neural networks training for text-to-speech synthesis. INTERSPEECH (2015)
Hao Wang, Frank K. Soong, Helen Meng
AA spectral space warping approach to cross-lingual voice transformation in HMM-based TTS. ICASSP (2015)
Wenping Hu, Yao Qian, Frank K. Soong
An improved DNN-based approach to mispronunciation detection and diagnosis of L2 learners' speech. SLaTE (2015)
Yuchen Fan, Yao Qian, Feng-Long Xie, Frank K. Soong
TTS synthesis with bidirectional LSTM based recurrent neural networks. INTERSPEECH (2014)
Jun Wang, Dong Wang, Ziwei Zhu, Thomas Fang Zheng, Frank K. Soong
Discriminative scoring for speaker recognition based on I-vectors. APSIPA (2014)
Yao Qian, Yuchen Fan, Wenping Hu, Frank K. Soong
On the training aspects of Deep Neural Network (DNN) for parametric TTS synthesis. ICASSP (2014)
Feng-Long Xie, Yao Qian, Yuchen Fan, Frank K. Soong, Haifeng Li
Sequence error (SE) minimization training of neural network for voice conversion. INTERSPEECH (2014)
Feng-Long Xie, Yao Qian, Frank K. Soong, Haifeng Li
Pitch transformation in neural network based voice conversion. ISCSLP (2014)
Wenping Hu, Yao Qian, Frank K. Soong
A new Neural Network based logistic regression classifier for improving mispronunciation detection of L2 language learners. ISCSLP (2014)
Xiang Yin, Ming Lei, Yao Qian, Frank K. Soong, Lei He, Zhen-Hua Ling, Li-Rong Dai
Modeling DCT parameterized F0 trajectory at intonation phrase level with DNN or decision tree. INTERSPEECH (2014)
Wenping Hu, Yao Qian, Frank K. Soong
A DNN-based acoustic modeling of tonal language and its application to Mandarin pronunciation training. ICASSP (2014)
Hyunson Seo, Hong-Goo Kang, Frank K. Soong
A maximum a Posterior-based reconstruction approach to speech bandwidth expansion in noise. ICASSP (2014)

Frank K. Soong.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Frank K. Soong