Ye Jia

Publication Activity (10 Years)

Years Active: 2018-2024
Publications (10 Years): 56

Top Topics

Language Modeling

University Courses

Speech Synthesis

Weakly Supervised

Top Venues

Publications

Ye Jia, Xiangzhi Eric Wang, Zackary P. T. Sin, Chen Li, Peter H. F. Ng, Xiao Huang, George Baciu, Jiannong Cao, Qing Li
Knowledge-Graph-Driven Mind Mapping for Immersive Collaborative Learning: A Pilot Study in Edu-Metaverse. IEEE Trans. Learn. Technol. 17 (2024)
Alex Agranovich, Eliya Nachmani, Oleg Rybakov, Yifan Ding, Ye Jia, Nadav Bar, Heiga Zen, Michelle Tadmor Ramanovich
SimulTron: On-Device Simultaneous Speech to Speech Translation. CoRR (2024)
Zackary P. T. Sin, Ye Jia, Richard Chen Li, Hong Va Leong, Qing Li, Peter H. F. Ng
illumotion: An Optical-illusion-based VR Locomotion Technique for Long-Distance 3D Movement. VR (2024)
Hagen Soltau, Izhak Shafran, Mingqiu Wang, Abhinav Rastogi, Jeffrey Zhao, Ye Jia, Wei Han, Yuan Cao, Aramys Miranda
Speech Aware Dialog System Technology Challenge (DSTC11). INTERSPEECH (2023)
Zackary P. T. Sin, Ye Jia, Astin C. H. Wu, Isaac Dan Zhao, Richard Chen Li, Peter H. F. Ng, Xiao Huang, George Baciu, Jiannong Cao, Qing Li
Toward an Edu-Metaverse of Knowledge: Immersive Exploration of University Courses. IEEE Trans. Learn. Technol. 16 (6) (2023)
Xinjian Li, Ye Jia, Chung-Cheng Chiu
Textless Direct Speech-to-Speech Translation with Discrete Speech Representation. ICASSP (2023)
Haotian Zhang, Semujju Stuart Dereck, Zhicheng Wang, Xianwei Lv, Kang Xu, Liang Wu, Ye Jia, Jing Wu, Zhuo Long, Wensheng Liang, X. G. Ma, Ruiyan Zhuang
Large Scale Foundation Models for Intelligent Manufacturing Applications: A Survey. CoRR (2023)
Peter H. F. Ng, Peter Q. Chen, Zackary P. T. Sin, Ye Jia, Richard Chen Li, George Baciu, Jiannong Cao, Qing Li
From Classroom to Metaverse: A Study on Gamified Constructivist Teaching in Higher Education. ICWL (2023)
Xinjian Li, Ye Jia, Chung-Cheng Chiu
Textless Direct Speech-to-Speech Translation with Discrete Speech Representation. CoRR (2022)
Ye Jia, Yifan Ding, Ankur Bapna, Colin Cherry, Yu Zhang, Alexis Conneau, Nobuyuki Morioka
Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation. CoRR (2022)
Ye Jia, Michelle Tadmor Ramanovich, Quan Wang, Heiga Zen
CVSS Corpus and Massively Multilingual Speech-to-Speech Translation. CoRR (2022)
Ye Jia, Michelle Tadmor Ramanovich, Tal Remez, Roi Pomerantz
Translatotron 2: High-quality direct speech-to-speech translation with voice preservation. ICML (2022)
Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson
XTREME-S: Evaluating Cross-lingual Speech Representations. CoRR (2022)
Ye Jia, Yifan Ding, Ankur Bapna, Colin Cherry, Yu Zhang, Alexis Conneau, Nobu Morioka
Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation. INTERSPEECH (2022)
Hagen Soltau, Izhak Shafran, Mingqiu Wang, Abhinav Rastogi, Jeffrey Zhao, Ye Jia, Wei Han, Yuan Cao, Aramys Miranda
Speech Aware Dialog System Technology Challenge (DSTC11). CoRR (2022)
Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson
XTREME-S: Evaluating Cross-lingual Speech Representations. INTERSPEECH (2022)
Lev Finkelstein, Heiga Zen, Norman Casagrande, Chun-an Chan, Ye Jia, Tom Kenter, Alexey Petelin, Jonathan Shen, Vincent Wan, Yu Zhang, Yonghui Wu, Rob Clark
Training Text-To-Speech Systems From Synthetic Data: A Practical Approach For Accent Transfer Tasks. CoRR (2022)
Ye Jia, Michelle Tadmor Ramanovich, Quan Wang, Heiga Zen
CVSS Corpus and Massively Multilingual Speech-to-Speech Translation. LREC (2022)
Ankur Bapna, Colin Cherry, Yu Zhang, Ye Jia, Melvin Johnson, Yong Cheng, Simran Khanuja, Jason Riesa, Alexis Conneau
mSLAM: Massively multilingual joint pre-training for speech and text. CoRR (2022)
Lev Finkelstein, Heiga Zen, Norman Casagrande, Chun-an Chan, Ye Jia, Tom Kenter, Alexey Petelin, Jonathan Shen, Vincent Wan, Yu Zhang, Yonghui Wu, Rob Clark
Training Text-To-Speech Systems From Synthetic Data: A Practical Approach For Accent Transfer Tasks. INTERSPEECH (2022)
Michael Hassid, Michelle Tadmor Ramanovich, Brendan Shillingford, Miaosen Wang, Ye Jia, Tal Remez
More than Words: In-the-Wild Visually-Driven Prosody for Text-to-Speech. CVPR (2022)
Ye Jia, Michelle Tadmor Ramanovich, Tal Remez, Roi Pomerantz
Translatotron 2: Robust direct speech-to-speech translation. CoRR (2021)
Isaac Elias, Heiga Zen, Jonathan Shen, Yu Zhang, Ye Jia, R. J. Skerry-Ryan, Yonghui Wu
Parallel Tacotron 2: A Non-Autoregressive Neural TTS Model with Differentiable Duration Modeling. Interspeech (2021)
Isaac Elias, Heiga Zen, Jonathan Shen, Yu Zhang, Ye Jia, Ron J. Weiss, Yonghui Wu
Parallel Tacotron: Non-Autoregressive and Controllable TTS. ICASSP (2021)
Ye Jia, Heiga Zen, Jonathan Shen, Yu Zhang, Yonghui Wu
PnG BERT: Augmented BERT on Phonemes and Graphemes for Neural TTS. Interspeech (2021)
Shaojin Ding, Ye Jia, Ke Hu, Quan Wang
Textual Echo Cancellation. ASRU (2021)
Ankur Bapna, Yu-An Chung, Nan Wu, Anmol Gulati, Ye Jia, Jonathan H. Clark, Melvin Johnson, Jason Riesa, Alexis Conneau, Yu Zhang
SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training. CoRR (2021)
Ye Jia, Heiga Zen, Jonathan Shen, Yu Zhang, Yonghui Wu
PnG BERT: Augmented BERT on Phonemes and Graphemes for Neural TTS. CoRR (2021)
Michael Hassid, Michelle Tadmor Ramanovich, Brendan Shillingford, Miaosen Wang, Ye Jia, Tal Remez
More than Words: In-the-Wild Visually-Driven Prosody for Text-to-Speech. CoRR (2021)
Shaojin Ding, Ye Jia, Ke Hu, Quan Wang
Textual Echo Cancellation. CoRR (2020)
Jonathan Shen, Ye Jia, Mike Chrzanowski, Yu Zhang, Isaac Elias, Heiga Zen, Yonghui Wu
Non-Attentive Tacotron: Robust and Controllable Neural TTS Synthesis Including Unsupervised Duration Modeling. CoRR (2020)
Daniel S. Park, Yu Zhang, Ye Jia, Wei Han, Chung-Cheng Chiu, Bo Li, Yonghui Wu, Quoc V. Le
Improved Noisy Student Training for Automatic Speech Recognition. CoRR (2020)
Isaac Elias, Heiga Zen, Jonathan Shen, Yu Zhang, Ye Jia, Ron J. Weiss, Yonghui Wu
Parallel Tacotron: Non-Autoregressive and Controllable TTS. CoRR (2020)
Daniel S. Park, Yu Zhang, Ye Jia, Wei Han, Chung-Cheng Chiu, Bo Li, Yonghui Wu, Quoc V. Le
Improved Noisy Student Training for Automatic Speech Recognition. INTERSPEECH (2020)
Yu Zhang, Ron J. Weiss, Heiga Zen, Yonghui Wu, Zhifeng Chen, R. J. Skerry-Ryan, Ye Jia, Andrew Rosenberg, Bhuvana Ramabhadran
Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloning. CoRR (2019)
Quan Wang, Hannah Muckenhirn, Kevin W. Wilson, Prashant Sridhar, Zelin Wu, John R. Hershey, Rif A. Saurous, Ron J. Weiss, Ye Jia, Ignacio Lopez-Moreno
VoiceFilter: Targeted Voice Separation by Speaker-Conditioned Spectrogram Masking. INTERSPEECH (2019)
Andrew Rosenberg, Yu Zhang, Bhuvana Ramabhadran, Ye Jia, Pedro J. Moreno, Yonghui Wu, Zelin Wu
Speech Recognition with Augmented Synthesized Speech. ASRU (2019)
Andrew Rosenberg, Yu Zhang, Bhuvana Ramabhadran, Ye Jia, Pedro J. Moreno, Yonghui Wu, Zelin Wu
Speech Recognition with Augmented Synthesized Speech. CoRR (2019)
Ye Jia, Melvin Johnson, Wolfgang Macherey, Ron J. Weiss, Yuan Cao, Chung-Cheng Chiu, Naveen Ari, Stella Laurenzo, Yonghui Wu
Leveraging Weakly Supervised Data to Improve End-to-end Speech-to-text Translation. ICASSP (2019)
Ye Jia, Ron J. Weiss, Fadi Biadsy, Wolfgang Macherey, Melvin Johnson, Zhifeng Chen, Yonghui Wu
Direct speech-to-speech translation with a sequence-to-sequence model. CoRR (2019)
Heiga Zen, Viet Dang, Rob Clark, Yu Zhang, Ron J. Weiss, Ye Jia, Zhifeng Chen, Yonghui Wu
LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speech. CoRR (2019)
Yu Zhang, Ron J. Weiss, Heiga Zen, Yonghui Wu, Zhifeng Chen, R. J. Skerry-Ryan, Ye Jia, Andrew Rosenberg, Bhuvana Ramabhadran
Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloning. INTERSPEECH (2019)
Fadi Biadsy, Ron J. Weiss, Pedro J. Moreno, Dimitri Kanvesky, Ye Jia
Parrotron: An End-to-End Speech-to-Speech Conversion Model and its Applications to Hearing-Impaired Speech and Speech Separation. INTERSPEECH (2019)
Fadi Biadsy, Ron J. Weiss, Pedro J. Moreno, Dimitri Kanvesky, Ye Jia
Parrotron: An End-to-End Speech-to-Speech Conversion Model and its Applications to Hearing-Impaired Speech and Speech Separation. CoRR (2019)
Jonathan Shen, Patrick Nguyen, Yonghui Wu, Zhifeng Chen, Mia Xu Chen, Ye Jia, Anjuli Kannan, Tara N. Sainath, Yuan Cao, Chung-Cheng Chiu, Yanzhang He, Jan Chorowski, Smit Hinsu, Stella Laurenzo, James Qin, Orhan Firat, Wolfgang Macherey, Suyog Gupta, Ankur Bapna, Shuyuan Zhang, Ruoming Pang, Ron J. Weiss, Rohit Prabhavalkar, Qiao Liang, Benoit Jacob, Bowen Liang, HyoukJoong Lee, Ciprian Chelba, Sébastien Jean, Bo Li, Melvin Johnson, Rohan Anil, Rajat Tibrewal, Xiaobing Liu, Akiko Eriguchi, Navdeep Jaitly, Naveen Ari, Colin Cherry, Parisa Haghani, Otavio Good, Youlong Cheng, Raziel Alvarez, Isaac Caswell, Wei-Ning Hsu, Zongheng Yang, Kuan-Chieh Wang, Ekaterina Gonina, Katrin Tomanek, Ben Vanik, Zelin Wu, Llion Jones, Mike Schuster, Yanping Huang, Dehao Chen, Kazuki Irie, George F. Foster, John Richardson, Klaus Macherey, Antoine Bruguier, Heiga Zen, Colin Raffel, Shankar Kumar, Kanishka Rao, David Rybach, Matthew Murray, Vijayaditya Peddinti, Maxim Krikun, Michiel Bacchiani, Thomas B. Jablin, Robert Suderman, Ian Williams, Benjamin Lee, Deepti Bhatia, Justin Carlson, Semih Yavuz, Yu Zhang, Ian McGraw, Max Galkin, Qi Ge, Golan Pundak, Chad Whipkey, Todd Wang, Uri Alon, Dmitry Lepikhin, Ye Tian, Sara Sabour, William Chan, Shubham Toshniwal, Baohua Liao, Michael Nirschl, Pat Rondon
Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling. CoRR (2019)
Heiga Zen, Viet Dang, Rob Clark, Yu Zhang, Ron J. Weiss, Ye Jia, Zhifeng Chen, Yonghui Wu
LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speech. INTERSPEECH (2019)
Wei-Ning Hsu, Yu Zhang, Ron J. Weiss, Heiga Zen, Yonghui Wu, Yuxuan Wang, Yuan Cao, Ye Jia, Zhifeng Chen, Jonathan Shen, Patrick Nguyen, Ruoming Pang
Hierarchical Generative Modeling for Controllable Speech Synthesis. ICLR (Poster) (2019)
Xin Wang, Junichi Yamagishi, Massimiliano Todisco, Héctor Delgado, Andreas Nautsch, Nicholas W. D. Evans, Md. Sahidullah, Ville Vestman, Tomi Kinnunen, Kong Aik Lee, Lauri Juvela, Paavo Alku, Yu-Huai Peng, Hsin-Te Hwang, Yu Tsao, Hsin-Min Wang, Sébastien Le Maguer, Markus Becker, Fergus Henderson, Rob Clark, Yu Zhang, Quan Wang, Ye Jia, Kai Onuma, Koji Mushika, Takashi Kaneda, Yuan Jiang, Li-Juan Liu, Yi-Chiao Wu, Wen-Chin Huang, Tomoki Toda, Kou Tanaka, Hirokazu Kameoka, Ingmar Steiner, Driss Matrouf, Jean-François Bonastre, Avashna Govender, Srikanth Ronanki, Jing-Xuan Zhang, Zhen-Hua Ling
The ASVspoof 2019 database. CoRR (2019)
Ye Jia, Ron J. Weiss, Fadi Biadsy, Wolfgang Macherey, Melvin Johnson, Zhifeng Chen, Yonghui Wu
Direct Speech-to-Speech Translation with a Sequence-to-Sequence Model. INTERSPEECH (2019)
Quan Wang, Hannah Muckenhirn, Kevin W. Wilson, Prashant Sridhar, Zelin Wu, John R. Hershey, Rif A. Saurous, Ron J. Weiss, Ye Jia, Ignacio Lopez-Moreno
VoiceFilter: Targeted Voice Separation by Speaker-Conditioned Spectrogram Masking. CoRR (2018)
Ye Jia, Yu Zhang, Ron J. Weiss, Quan Wang, Jonathan Shen, Fei Ren, Zhifeng Chen, Patrick Nguyen, Ruoming Pang, Ignacio Lopez-Moreno, Yonghui Wu
Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis. NeurIPS (2018)
Ye Jia, Melvin Johnson, Wolfgang Macherey, Ron J. Weiss, Yuan Cao, Chung-Cheng Chiu, Naveen Ari, Stella Laurenzo, Yonghui Wu
Leveraging Weakly Supervised Data to Improve End-to-End Speech-to-Text Translation. CoRR (2018)
Wei-Ning Hsu, Yu Zhang, Ron J. Weiss, Heiga Zen, Yonghui Wu, Yuxuan Wang, Yuan Cao, Ye Jia, Zhifeng Chen, Jonathan Shen, Patrick Nguyen, Ruoming Pang
Hierarchical Generative Modeling for Controllable Speech Synthesis. CoRR (2018)
Ye Jia, Yu Zhang, Ron J. Weiss, Quan Wang, Jonathan Shen, Fei Ren, Zhifeng Chen, Patrick Nguyen, Ruoming Pang, Ignacio Lopez-Moreno, Yonghui Wu
Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis. CoRR (2018)
Yuxuan Wang, Daisy Stanton, Yu Zhang, R. J. Skerry-Ryan, Eric Battenberg, Joel Shor, Ying Xiao, Fei Ren, Ye Jia, Rif A. Saurous
Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesis. CoRR (2018)
Yuxuan Wang, Daisy Stanton, Yu Zhang, R. J. Skerry-Ryan, Eric Battenberg, Joel Shor, Ying Xiao, Ye Jia, Fei Ren, Rif A. Saurous
Style Tokens: Unsupervised Style Modeling, Control and Transfer in End-to-End Speech Synthesis. ICML (2018)