Hongyu Gong

Publication Activity (10 Years)

Years Active: 2015-2024
Publications (10 Years): 80

Top Topics

Tensor Decomposition

Robust Optimization

Training Corpus

Speech Synthesis

Top Venues

Publications

Min-Jae Hwang, Ilia Kulikov, Benjamin Peloquin, Hongyu Gong, Peng-Jen Chen, Ann Lee
Textless Acoustic Model with Self-Supervised Distillation for Noise-Robust Expressive Speech-to-Speech Translation. CoRR (2024)
Yifan Peng, Ilia Kulikov, Yilin Yang, Sravya Popuri, Hui Lu, Changhan Wang, Hongyu Gong
MSLM-S2ST: A Multitask Speech Language Model for Textless Speech-to-Speech Translation with Speaker Style Preservation. CoRR (2024)
Hongyu Gong, Bandhav Veluri
SeamlessExpressiveLM: Speech Language Model for Expressive Speech-to-Speech Translation with Chain-of-Thought. CoRR (2024)
Jianing Zhou, Ziheng Zeng, Hongyu Gong, Suma Bhat
CLASP: Cross-modal Alignment Using Pre-trained Unimodal Models. ACL (Findings) (2024)
Chao-Wei Huang, Hui Lu, Hongyu Gong, Hirofumi Inaguma, Ilia Kulikov, Ruslan Mavlyutov, Sravya Popuri
Investigating Decoder-only Large Language Models for Speech-to-text Translation. CoRR (2024)
Yifan Peng, Ilia Kulikov, Yilin Yang, Sravya Popuri, Hui Lu, Changhan Wang, Hongyu Gong
An Empirical Study of Speech Language Models for Prompt-Conditioned Speech Synthesis. CoRR (2024)
Min-Jae Hwang, Ilia Kulikov, Benjamin Peloquin, Hongyu Gong, Peng-Jen Chen, Ann Lee
Textless Acoustic Model with Self-Supervised Distillation for Noise-Robust Expressive Speech-to-Speech Translation. ACL (Findings) (2024)
Marco Gaido, Yun Tang, Ilia Kulikov, Rongqing Huang, Hongyu Gong, Hirofumi Inaguma
Named Entity Detection and Injection for Direct Speech Translation. ICASSP (2023)
Phuong-Hang Le, Hongyu Gong, Changhan Wang, Juan Pino, Benjamin Lecouteux, Didier Schwab
Pre-training for Speech Translation: CTC Meets Optimal Transport. CoRR (2023)
Jianing Zhou, Ziheng Zeng, Hongyu Gong, Suma Bhat
Non-compositional Expression Generation Based on Curriculum Learning and Continual Learning. EMNLP (Findings) (2023)
Phuong-Hang Le, Hongyu Gong, Changhan Wang, Juan Pino, Benjamin Lecouteux, Didier Schwab
Pre-training for Speech Translation: CTC Meets Optimal Transport. ICML (2023)
Jiatong Shi, Yun Tang, Hirofumi Inaguma, Hongyu Gong, Juan Pino, Shinji Watanabe
Exploration on HuBERT with Multiple Resolution. INTERSPEECH (2023)
Seamless Communication, Loïc Barrault, Yu-An Chung, Mariano Cora Meglioli, David Dale, Ning Dong, Paul-Ambroise Duquenne, Hady Elsahar, Hongyu Gong, Kevin Heffernan, John Hoffman, Christopher Klaiber, Pengwei Li, Daniel Licht, Jean Maillard, Alice Rakotoarison, Kaushik Ram Sadagopan, Guillaume Wenzek, Ethan Ye, Bapi Akula, Peng-Jen Chen, Naji El Hachem, Brian Ellis, Gabriel Mejia Gonzalez, Justin Haaheim, Prangthip Hansanti, Russ Howes, Bernie Huang, Min-Jae Hwang, Hirofumi Inaguma, Somya Jain, Elahe Kalbassi, Amanda Kallet, Ilia Kulikov, Janice Lam, Daniel Li, Xutai Ma, Ruslan Mavlyutov, Benjamin Peloquin, Mohamed Ramadan, Abinesh Ramakrishnan, Anna Y. Sun, Kevin Tran, Tuan Tran, Igor Tufanov, Vish Vogeti, Carleigh Wood, Yilin Yang, Bokai Yu, Pierre Andrews, Can Balioglu, Marta R. Costa-jussà, Onur Celebi, Maha Elbayad, Cynthia Gao, Francisco Guzmán, Justine Kao, Ann Lee, Alexandre Mourachko, Juan Pino, Sravya Popuri, Christophe Ropers, Safiyyah Saleem, Holger Schwenk, Paden Tomasello, Changhan Wang, Jeff Wang, Skyler Wang
SeamlessM4T-Massively Multilingual & Multimodal Machine Translation. CoRR (2023)
Paul-Ambroise Duquenne, Hongyu Gong, Ning Dong, Jingfei Du, Ann Lee, Vedanuj Goswami, Changhan Wang, Juan Pino, Benoît Sagot, Holger Schwenk
SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations. ACL (1) (2023)
Xuan-Phi Nguyen, Sravya Popuri, Changhan Wang, Yun Tang, Ilia Kulikov, Hongyu Gong
Improving Speech-to-Speech Translation Through Unlabeled Text. ICASSP (2023)
Hongyu Gong, Ning Dong, Sravya Popuri, Vedanuj Goswami, Ann Lee, Juan Pino
Multilingual Speech-to-Speech Translation into Multiple Target Languages. CoRR (2023)
Wen-Chin Huang, Benjamin Peloquin, Justine Kao, Changhan Wang, Hongyu Gong, Elizabeth Salesky, Yossi Adi, Ann Lee, Peng-Jen Chen
A Holistic Cascade System, Benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translation. ICASSP (2023)
Loïc Barrault, Yu-An Chung, Mariano Cora Meglioli, David Dale, Ning Dong, Mark Duppenthaler, Paul-Ambroise Duquenne, Brian Ellis, Hady Elsahar, Justin Haaheim, John Hoffman, Min-Jae Hwang, Hirofumi Inaguma, Christopher Klaiber, Ilia Kulikov, Pengwei Li, Daniel Licht, Jean Maillard, Ruslan Mavlyutov, Alice Rakotoarison, Kaushik Ram Sadagopan, Abinesh Ramakrishnan, Tuan Tran, Guillaume Wenzek, Yilin Yang, Ethan Ye, Ivan Evtimov, Pierre Fernandez, Cynthia Gao, Prangthip Hansanti, Elahe Kalbassi, Amanda Kallet, Artyom Kozhevnikov, Gabriel Mejia Gonzalez, Robin San Roman, Christophe Touret, Corinne Wong, Carleigh Wood, Bokai Yu, Pierre Andrews, Can Balioglu, Peng-Jen Chen, Marta R. Costa-jussà, Maha Elbayad, Hongyu Gong, Francisco Guzmán, Kevin Heffernan, Somya Jain, Justine Kao, Ann Lee, Xutai Ma, Alexandre Mourachko, Benjamin Peloquin, Juan Pino, Sravya Popuri, Christophe Ropers, Safiyyah Saleem, Holger Schwenk, Anna Sun, Paden Tomasello, Changhan Wang, Jeff Wang, Skyler Wang, Mary Williamson
Seamless: Multilingual Expressive and Streaming Speech Translation. CoRR (2023)
Peng-Jen Chen, Kevin Tran, Yilin Yang, Jingfei Du, Justine Kao, Yu-An Chung, Paden Tomasello, Paul-Ambroise Duquenne, Holger Schwenk, Hongyu Gong, Hirofumi Inaguma, Sravya Popuri, Changhan Wang, Juan Pino, Wei-Ning Hsu, Ann Lee
Speech-to-Speech Translation for a Real-world Unwritten Language. ACL (Findings) (2023)
Jiatong Shi, Yun Tang, Hirofumi Inaguma, Hongyu Gong, Juan Pino, Shinji Watanabe
Exploration on HuBERT with Multiple Resolutions. CoRR (2023)
Wen-Chin Huang, Benjamin Peloquin, Justine Kao, Changhan Wang, Hongyu Gong, Elizabeth Salesky, Yossi Adi, Ann Lee, Peng-Jen Chen
A Holistic Cascade System, benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translation. CoRR (2023)
Ann Lee, Hongyu Gong, Paul-Ambroise Duquenne, Holger Schwenk, Peng-Jen Chen, Changhan Wang, Sravya Popuri, Yossi Adi, Juan Pino, Jiatao Gu, Wei-Ning Hsu
Textless Speech-to-Speech Translation on Real Data. NAACL-HLT (2022)
Paul-Ambroise Duquenne, Hongyu Gong, Ning Dong, Jingfei Du, Ann Lee, Vedanuj Goswami, Changhan Wang, Juan Pino, Benoît Sagot, Holger Schwenk
SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations. CoRR (2022)
Antonios Anastasopoulos, Loïc Barrault, Luisa Bentivogli, Marcely Zanon Boito, Ondrej Bojar, Roldano Cattoni, Anna Currey, Georgiana Dinu, Kevin Duh, Maha Elbayad, Clara Emmanuel, Yannick Estève, Marcello Federico, Christian Federmann, Souhir Gahbiche, Hongyu Gong, Roman Grundkiewicz, Barry Haddow, Benjamin Hsu, Dávid Javorský, Vera Kloudová, Surafel Melaku Lakew, Xutai Ma, Prashant Mathur, Paul McNamee, Kenton Murray, Maria Nadejde, Satoshi Nakamura, Matteo Negri, Jan Niehues, Xing Niu, John Ortega, Juan Miguel Pino, Elizabeth Salesky, Jiatong Shi, Matthias Sperber, Sebastian Stüker, Katsuhito Sudoh, Marco Turchi, Yogesh Virkar, Alexander Waibel, Changhan Wang, Shinji Watanabe
Findings of the IWSLT 2022 Evaluation Campaign. IWSLT@ACL (2022)
Xuan-Phi Nguyen, Hongyu Gong, Yun Tang, Changhan Wang, Philipp Koehn, Shafiq R. Joty
Contrastive Clustering to Mine Pseudo Parallel Data for Unsupervised Translation. ICLR (2022)
Paul-Ambroise Duquenne, Hongyu Gong, Benoît Sagot, Holger Schwenk
T-Modules: Translation Modules for Zero-Shot Cross-Modal Machine Translation. EMNLP (2022)
Danni Liu, Changhan Wang, Hongyu Gong, Xutai Ma, Yun Tang, Juan Pino
From Start to Finish: Latency Reduction Strategies for Incremental Speech Synthesis in Simultaneous Speech-to-Speech Translation. INTERSPEECH (2022)
Yun Tang, Hongyu Gong, Ning Dong, Changhan Wang, Wei-Ning Hsu, Jiatao Gu, Alexei Baevski, Xian Li, Abdelrahman Mohamed, Michael Auli, Juan Pino
Unified Speech-Text Pre-training for Speech Translation and Recognition. CoRR (2022)
Marco Gaido, Yun Tang, Ilia Kulikov, Rongqing Huang, Hongyu Gong, Hirofumi Inaguma
Named Entity Detection and Injection for Direct Speech Translation. CoRR (2022)
Yun Tang, Hongyu Gong, Ning Dong, Changhan Wang, Wei-Ning Hsu, Jiatao Gu, Alexei Baevski, Xian Li, Abdelrahman Mohamed, Michael Auli, Juan Pino
Unified Speech-Text Pre-training for Speech Translation and Recognition. ACL (1) (2022)
Ping Yu, Mikel Artetxe, Myle Ott, Sam Shleifer, Hongyu Gong, Ves Stoyanov, Xian Li
Efficient Language Modeling with Sparse all-MLP. CoRR (2022)
Xuan-Phi Nguyen, Sravya Popuri, Changhan Wang, Yun Tang, Ilia Kulikov, Hongyu Gong
Improving Speech-to-Speech Translation Through Unlabeled Text. CoRR (2022)
Paul-Ambroise Duquenne, Hongyu Gong, Benoît Sagot, Holger Schwenk
T-Modules: Translation Modules for Zero-Shot Cross-Modal Machine Translation. CoRR (2022)
Peng-Jen Chen, Kevin Tran, Yilin Yang, Jingfei Du, Justine Kao, Yu-An Chung, Paden Tomasello, Paul-Ambroise Duquenne, Holger Schwenk, Hongyu Gong, Hirofumi Inaguma, Sravya Popuri, Changhan Wang, Juan Pino, Wei-Ning Hsu, Ann Lee
Speech-to-Speech Translation For A Real-world Unwritten Language. CoRR (2022)
Jianing Zhou, Ziheng Zeng, Hongyu Gong, Suma Bhat
Idiomatic Expression Paraphrasing without Strong Supervision. AAAI (2022)
Jianing Zhou, Hongyu Gong, Suma Bhat
PIE: A Parallel Idiomatic Expression Corpus for Idiomatic Sentence Generation and Paraphrasing. MWE@ACL-IJCNLP (2021)
Holger Schwenk, Vishrav Chaudhary, Shuo Sun, Hongyu Gong, Francisco Guzmán
WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia. EACL (2021)
Ann Lee, Hongyu Gong, Paul-Ambroise Duquenne, Holger Schwenk, Peng-Jen Chen, Changhan Wang, Sravya Popuri, Juan Pino, Jiatao Gu, Wei-Ning Hsu
Textless Speech-to-Speech Translation on Real Data. CoRR (2021)
Hongyu Gong, Alberto Valido, Katherine M. Ingram, Giulia Fanti, Suma Bhat, Dorothy L. Espelage
Abusive Language Detection in Heterogeneous Contexts: Dataset Collection and the Role of Supervised Attention. CoRR (2021)
Jianing Zhou, Hongyu Gong, Suma Bhat
From Solving a Problem Boldly to Cutting the Gordian Knot: Idiomatic Text Generation. CoRR (2021)
Yun Tang, Hongyu Gong, Xian Li, Changhan Wang, Juan Miguel Pino, Holger Schwenk, Naman Goyal
FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task. IWSLT (2021)
Xian Li, Hongyu Gong
Robust Optimization for Multilingual Translation with Imbalanced Data. NeurIPS (2021)
Hongyu Gong, Yun Tang, Juan Miguel Pino, Xian Li
Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling. CoRR (2021)
Hongyu Gong, Vishrav Chaudhary, Yuqing Tang, Francisco Guzmán
LAWDR: Language-Agnostic Weighted Document Representations from Pre-trained Models. CoRR (2021)
Wanzheng Zhu, Hongyu Gong, Rohan Bansal, Zachary Weinberg, Nicolas Christin, Giulia Fanti, Suma Bhat
Self-Supervised Euphemism Detection and Identification for Content Moderation. CoRR (2021)
Hongyu Gong, Xian Li, Dmitriy Genzel
Adaptive Sparse Transformer for Multilingual Translation. CoRR (2021)
Jianing Zhou, Ziheng Zeng, Hongyu Gong, Suma Bhat
Idiomatic Expression Paraphrasing without Strong Supervision. CoRR (2021)
Hongyu Gong, Alberto Valido, Katherine M. Ingram, Giulia Fanti, Suma Bhat, Dorothy L. Espelage
Abusive Language Detection in Heterogeneous Contexts: Dataset Collection and the Role of Supervised Attention. AAAI (2021)
Danni Liu, Changhan Wang, Hongyu Gong, Xutai Ma, Yun Tang, Juan Miguel Pino
Incremental Speech Synthesis For Speech-To-Speech Translation. CoRR (2021)
Hongyu Gong, Yun Tang, Juan Pino, Xian Li
Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling. NeurIPS (2021)
Wanzheng Zhu, Hongyu Gong, Rohan Bansal, Zachary Weinberg, Nicolas Christin, Giulia Fanti, Suma Bhat
Self-Supervised Euphemism Detection and Identification for Content Moderation. IEEE Symposium on Security and Privacy (2021)
Paul-Ambroise Duquenne, Hongyu Gong, Holger Schwenk
Multimodal and Multilingual Embeddings for Large-Scale Speech Mining. NeurIPS (2021)
Yun Tang, Hongyu Gong, Xian Li, Changhan Wang, Juan Miguel Pino, Holger Schwenk, Naman Goyal
FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task. CoRR (2021)
Xutai Ma, Hongyu Gong, Danni Liu, Ann Lee, Yun Tang, Peng-Jen Chen, Wei-Ning Hsu, Kenneth Heafield, Phillip Koehn, Juan Pino
Direct simultaneous speech to speech translation. CoRR (2021)
Xian Li, Hongyu Gong
Demystify Optimization Challenges in Multilingual Transformers. CoRR (2021)
Hongyu Gong, Linfeng Song, Suma Bhat
Rich Syntactic and Semantic Information Helps Unsupervised Text Style Transfer. INLG (2020)
Wanzheng Zhu, Hongyu Gong, Jiaming Shen, Chao Zhang, Jingbo Shang, Suma Bhat, Jiawei Han
FUSE: Multi-faceted Set Expansion by Coherent Clustering of Skip-Grams. ECML/PKDD (3) (2020)
Hongyu Gong, Yelong Shen, Dian Yu, Jianshu Chen, Dong Yu
Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehension. CoRR (2020)
Hongyu Gong, Suma Bhat, Pramod Viswanath
Enriching Word Embeddings with Temporal and Spatial Information. CoRR (2020)
Hongyu Gong, Yelong Shen, Dian Yu, Jianshu Chen, Dong Yu
Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehension. ACL (2020)
Hongyu Gong, Suma Bhat, Pramod Viswanath
Enriching Word Embeddings with Temporal and Spatial Information. CoNLL (2020)
Hongyu Gong, Kshitij Gupta, Akriti Jain, Suma Bhat
IlliniMet: Illinois System for Metaphor Detection with Contextual and Linguistic Information. Fig-Lang@ACL (2020)
Hongyu Gong, Suma Bhat, Lingfei Wu, Jinjun Xiong, Wen-Mei W. Hwu
Reinforcement Learning Based Text Style Transfer without Parallel Training Corpus. NAACL-HLT (1) (2019)
Holger Schwenk, Vishrav Chaudhary, Shuo Sun, Hongyu Gong, Francisco Guzmán
WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia. CoRR (2019)
Tarek Sakakini, Hongyu Gong, Jong Yoon Lee, Robert Schloss, Jinjun Xiong, Suma Bhat
Equipping Educational Applications with Domain Knowledge. BEA@ACL (2019)
Omer Anjum, Hongyu Gong, Suma Bhat, Wen-Mei Hwu, Jinjun Xiong
PaRe: A Paper-Reviewer Matching Approach Using a Common Topic Space. EMNLP/IJCNLP (1) (2019)
Hongyu Gong, Yuchen Li, Suma Bhat, Pramod Viswanath
Context-Sensitive Malicious Spelling Error Correction. CoRR (2019)
Omer Anjum, Hongyu Gong, Suma Bhat, Wen-Mei Hwu, Jinjun Xiong
PaRe: A Paper-Reviewer Matching Approach Using a Common Topic Space. CoRR (2019)
Hongyu Gong, Tarek Sakakini, Suma Bhat, Jinjun Xiong
Document Similarity for Texts of Varying Lengths via Hidden Topics. CoRR (2019)
Hongyu Gong, Suma Bhat, Lingfei Wu, Jinjun Xiong, Wen-Mei Hwu
Reinforcement Learning Based Text Style Transfer without Parallel Training Corpus. CoRR (2019)
Wanzheng Zhu, Hongyu Gong, Jiaming Shen, Chao Zhang, Jingbo Shang, Suma Bhat, Jiawei Han
FUSE: Multi-Faceted Set Expansion by Coherent Clustering of Skip-grams. CoRR (2019)
Hongyu Gong, Yuchen Li, Suma Bhat, Pramod Viswanath
Context-Sensitive Malicious Spelling Error Correction. WWW (2019)
Hongyu Gong, Suma Bhat, Pramod Viswanath
Embedding Syntax and Semantics of Prepositions via Tensor Decomposition. NAACL-HLT (2018)
Hongyu Gong, Jiaqi Mu, Suma Bhat, Pramod Viswanath
Preposition Sense Disambiguation and Representation. EMNLP (2018)
Hongyu Gong, Suma Bhat, Pramod Viswanath
Embedding Syntax and Semantics of Prepositions via Tensor Decomposition. CoRR (2018)
Hongyu Gong, Tarek Sakakini, Suma Bhat, Jinjun Xiong
Document Similarity for Texts of Varying Lengths via Hidden Topics. ACL (1) (2018)
Hongyu Gong, Suma Bhat, Pramod Viswanath
Geometry of Compositionality. AAAI (2017)
Hongyu Gong, Jiaqi Mu, Suma Bhat, Pramod Viswanath
Prepositions in Context. CoRR (2017)
Hongyu Gong, Luoyi Fu, Xinzhe Fu, Lutian Zhao, Kainan Wang, Xinbing Wang
Distributed Multicast Tree Construction in Wireless Sensor Networks. IEEE Trans. Inf. Theory 63 (1) (2017)
Hongyu Gong, Suma Bhat, Pramod Viswanath
Geometry of Compositionality. CoRR (2016)
Hongyu Gong, Lutian Zhao, Kainan Wang, Weijie Wu, Xinbing Wang
A distributed algorithm to construct multicast trees in wireless multi-hop networks. ICC (2015)
Hongyu Gong, Lutian Zhao, Kainan Wang, Weijie Wu, Xinbing Wang
A Distributed Algorithm to Construct Multicast Trees in WSNs: An Approximate Steiner Tree Approach. MobiHoc (2015)