Hung-Yi Lee

Publication Activity (10 Years)

Years Active: 2018-2024
Publications (10 Years): 65

Top Topics

Vector Quantization

Speaker Verification

Benchmark Suite

Keyword Spotting

Top Venues

IEEE ACM Trans. Audio Speech Lang. Process.

Publications

Haibin Wu, Heng-Cheng Kuo, Yu Tsao, Hung-Yi Lee
Scalable Ensemble-Based Detection Method Against Adversarial Attacks For Speaker Verification. ICASSP (2024)
Hung-Ting Su, Chun-Tong Chao, Ya-Ching Hsu, Xudong Lin, Yulei Niu, Hung-Yi Lee, Winston H. Hsu
Investigating Video Reasoning Capability of Large Language Models with Tropes in Movies. CoRR (2024)
Kai-Wei Chang, Haibin Wu, Yu-Kai Wang, Yuan-Kuei Wu, Hua Shen, Wei-Cheng Tseng, Iu-thing Kang, Shang-wen Li, Hung-Yi Lee
SpeechPrompt: Prompting Speech Language Models for Speech Processing Tasks. IEEE ACM Trans. Audio Speech Lang. Process. 32 (2024)
Chen-An Li, Hung-Yi Lee
Examining Forgetting in Continual Pre-training of Aligned Large Language Models. CoRR (2024)
Yuan Tseng, Layne Berry, Yiting Chen, I-Hsiang Chiu, Hsuan-Hao Lin, Max Liu, Puyuan Peng, Yi-Jen Shih, Hung-Yu Wang, Haibin Wu, Poyao Huang, Chun-Mao Lai, Shang-Wen Li, David Harwath, Yu Tsao, Abdelrahman Mohamed, Chi-Luen Feng, Hung-Yi Lee
AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models. ICASSP (2024)
Xuanjun Chen, Haibin Wu, Chung-Che Wang, Hung-Yi Lee, Jyh-Shing Roger Jang
Multimodal Transformer Distillation for Audio-Visual Synchronization. ICASSP (2024)
Kuan-Po Huang, Chih-Kai Yang, Yu-Kuan Fu, Ewan Dunbar, Hung-Yi Lee
Zero Resource Code-Switched Speech Benchmark Using Speech Utterance Pairs for Multiple Spoken Languages. ICASSP (2024)
Haibin Wu, Huang-Cheng Chou, Kai-Wei Chang, Lucas Goncalves, Jiawei Du, Jyh-Shing Roger Jang, Chi-Chun Lee, Hung-Yi Lee
EMO-SUPERB: An In-depth Look at Speech Emotion Recognition. CoRR (2024)
Kevin Everson, Yile Gu, Chao-Han Huck Yang, Prashanth Gurunath Shivakumar, Guan-Ting Lin, Jari Kolehmainen, Ivan Bulyko, Ankur Gandhe, Shalini Ghosh, Wael Hamza, Hung-Yi Lee, Ariya Rastrow, Andreas Stolcke
Towards ASR Robust Spoken Language Understanding Through in-Context Learning with Word Confusion Networks. ICASSP (2024)
Chyi-Jiunn Lin, Guan-Ting Lin, Yung-Sung Chuang, Wei-Lun Wu, Shang-Wen Li, Abdelrahman Mohamed, Hung-Yi Lee, Lin-Shan Lee
SpeechDPR: End-To-End Spoken Passage Retrieval For Open-Domain Spoken Question Answering. ICASSP (2024)
Chien-Yu Huang, Ke-Han Lu, Shih-Heng Wang, Chi-Yuan Hsiao, Chun-Yi Kuan, Haibin Wu, Siddhant Arora, Kai-Wei Chang, Jiatong Shi, Yifan Peng, Roshan S. Sharma, Shinji Watanabe, Bhiksha Ramakrishnan, Shady Shehata, Hung-Yi Lee
Dynamic-Superb: Towards a Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark For Speech. ICASSP (2024)
Guan-Ting Lin, Prashanth Gurunath Shivakumar, Ankur Gandhe, Chao-Han Huck Yang, Yile Gu, Shalini Ghosh, Andreas Stolcke, Hung-Yi Lee, Ivan Bulyko
Paralinguistics-Enhanced Large Language Modeling of Spoken Dialogue. ICASSP (2024)
David Cheng-Han Chiang, Hung-Yi Lee
Over-Reasoning and Redundant Calculation of Large Language Models. CoRR (2024)
Min-Han Shih, Ho-Lam Chung, Yu-Chi Pai, Ming-Hao Hsu, Guan-Ting Lin, Shang-Wen Li, Hung-Yi Lee
GSQA: An End-to-End Model for Generative Spoken Question Answering. CoRR (2023)
Chan-Jan Hsu, Ho-Lam Chung, Hung-Yi Lee, Yu Tsao
T5lephone: Bridging Speech and Text Self-Supervised Models for Spoken Language Understanding Via Phoneme Level T5. ICASSP (2023)
Kuan-Po Huang, Tzu-hsun Feng, Yu-Kuan Fu, Tsu-Yuan Hsu, Po-Chieh Yen, Wei-Cheng Tseng, Kai-Wei Chang, Hung-Yi Lee
Ensemble Knowledge Distillation of Self-Supervised Speech Models. ICASSP (2023)
Dongji Gao, Jiatong Shi, Shun-Po Chuang, Leibny Paola García, Hung-Yi Lee, Shinji Watanabe, Sanjeev Khudanpur
Euro: Espnet Unsupervised ASR Open-Source Toolkit. ICASSP (2023)
Guan-Ting Liu, En-Pei Hu, Pu-Jen Cheng, Hung-Yi Lee, Shao-Hua Sun
Hierarchical Programmatic Reinforcement Learning via Learning to Compose Programs. CoRR (2023)
Sung-Feng Huang, Chia-Ping Chen, Zhi-Sheng Chen, Yu-Pao Tsai, Hung-Yi Lee
Personalized Lightweight Text-to-Speech: Voice Cloning with Adaptive Structured Pruning. ICASSP (2023)
Layne Berry, Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Hung-Yi Lee, David Harwath
M-SpeechCLIP: Leveraging Large-Scale, Pre-Trained Models for Multilingual Speech to Image Retrieval. ICASSP (2023)
Guan-Ting Liu, En-Pei Hu, Pu-Jen Cheng, Hung-Yi Lee, Shao-Hua Sun
Hierarchical Programmatic Reinforcement Learning via Learning to Compose Programs. ICML (2023)
Jiatong Shi, William Chen, Dan Berrebbi, Hsiu-Hsuan Wang, Wei-Ping Huang, En-Pei Hu, Ho-Lam Chuang, Xuankai Chang, Yuxun Tang, Shang-Wen Li, Abdelrahman Mohamed, Hung-Yi Lee, Shinji Watanabe
Findings of the 2023 ML-Superb Challenge: Pre-Training And Evaluation Over More Languages And Beyond. ASRU (2023)
Tzu-Quan Lin, Hung-Yi Lee, Hao Tang
MelHuBERT: A Simplified Hubert on Mel Spectrograms. ASRU (2023)
Kai-Wei Chang, Ming-Hsin Chen, Yun-Ping Lin, Jing Neng Hsu, Paul Kuo-Ming Huang, Chien-Yu Huang, Shang-Wen Li, Hung-Yi Lee
Prompting and Adapter Tuning For Self-Supervised Encoder-Decoder Speech Model. ASRU (2023)
Jiatong Shi, Chan-Jan Hsu, Ho-Lam Chung, Dongji Gao, Paola García, Shinji Watanabe, Ann Lee, Hung-Yi Lee
Bridging Speech and Textual Pre-Trained Models With Unsupervised ASR. ICASSP (2023)
Yu-Kuan Fu, Liang-Hsuan Tseng, Jiatong Shi, Chen-An Li, Tsu-Yuan Hsu, Shinji Watanabe, Hung-Yi Lee
Improving Cascaded Unsupervised Speech Translation with Denoising Back-translation. CoRR (2023)
Yu-Hsiang Wang, Huang-Yu Chen, Kai-Wei Chang, Winston H. Hsu, Hung-Yi Lee
Minisuperb: Lightweight Benchmark for Self-Supervised Speech Models. ASRU (2023)
Wei-Ping Huang, Sung-Feng Huang, Hung-Yi Lee
Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initialization. ASRU (2023)
Zih-Ching Chen, Yu-Shun Sung, Hung-Yi Lee
Chapter: Exploiting Convolutional Neural Network Adapters for Self-Supervised Speech Models. ICASSP Workshops (2023)
Yun-Yen Chuang, Hung-Min Hsu, Kevin Lin, Ray-I Chang, Hung-Yi Lee
MetaEx-GAN: Meta Exploration to Improve Natural Language Generation via Generative Adversarial Networks. IEEE ACM Trans. Audio Speech Lang. Process. 31 (2023)
Chun-Yi Kuan, Chen-An Li, Tsu-Yuan Hsu, Tse-Yang Lin, Ho-Lam Chung, Kai-Wei Chang, Shuo-Yiin Chang, Hung-Yi Lee
Towards General-Purpose Text-Instruction-Guided Voice Conversion. ASRU (2023)
Jun-You Wang, Hung-Yi Lee, Jyh-Shing Roger Jang, Li Su
Zero-Shot Singing Voice Synthesis from Musical Score. ASRU (2023)
Yuan Tseng, Cheng-I Jeff Lai, Hung-Yi Lee
Cascading and Direct Approaches to Unsupervised Constituency Parsing on Spoken Sentences. ICASSP (2023)
Wei-Tsung Kao, Yuan-Kuei Wu, Chia-Ping Chen, Zhi-Sheng Chen, Yu-Pao Tsai, Hung-Yi Lee
On the Efficiency of Integrating Self-Supervised Learning and Meta-Learning for User-Defined Few-Shot Keyword Spotting. SLT (2022)
Yang Zhang, Zhiqiang Lv, Haibin Wu, Shanshan Zhang, Pengfei Hu, Zhiyong Wu, Hung-Yi Lee, Helen Meng
MFA-Conformer: Multi-scale Feature Aggregation Conformer for Automatic Speaker Verification. CoRR (2022)
David Cheng-Han Chiang, Hung-Yi Lee
Understanding, Detecting, and Separating Out-of-Distribution Samples and Adversarial Samples in Text Classification. CoRR (2022)
Haibin Wu, Bo Zheng, Xu Li, Xixin Wu, Hung-Yi Lee, Helen Meng
Characterizing the Adversarial Vulnerability of Speech self-Supervised Learning. ICASSP (2022)
Chien-yu Huang, Kai-Wei Chang, Hung-Yi Lee
Toward Degradation-Robust Voice Conversion. ICASSP (2022)
Yi-Long Liou, Jui-Yang Hsu, Chen-Sheng Chen, Alexander H. Liu, Hung-Yi Lee, Tsung-Te Liu
A Fully Integrated 1.7mW Attention-Based Automatic Speech Recognition Processor. IEEE Trans. Circuits Syst. II Express Briefs 69 (10) (2022)
Suwon Shon, Siddhant Arora, Chyi-Jiunn Lin, Ankita Pasad, Felix Wu, Roshan Sharma, Wei-Lun Wu, Hung-Yi Lee, Karen Livescu, Shinji Watanabe
SLUE Phase-2: A Benchmark Suite of Diverse Spoken Language Understanding Tasks. CoRR (2022)
Haibin Wu, Xu Li, Andy T. Liu, Zhiyong Wu, Helen Meng, Hung-Yi Lee
Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning. IEEE ACM Trans. Audio Speech Lang. Process. 30 (2022)
Haibin Wu, Heng-Cheng Kuo, Naijun Zheng, Kuo-Hsuan Hung, Hung-Yi Lee, Yu Tsao, Hsin-Min Wang, Helen Meng
Partially Fake Audio Detection by Self-attention-based Fake Span Discovery. CoRR (2022)
Haibin Wu, Po-chun Hsu, Ji Gao, Shanshan Zhang, Shen Huang, Jian Kang, Zhiyong Wu, Helen Meng, Hung-Yi Lee
Adversarial Sample Detection for Speaker Verification by Neural Vocoders. ICASSP (2022)
Haibin Wu, Heng-Cheng Kuo, Naijun Zheng, Kuo-Hsuan Hung, Hung-Yi Lee, Yu Tsao, Hsin-Min Wang, Helen Meng
Partially Fake Audio Detection by Self-Attention-Based Fake Span Discovery. ICASSP (2022)
Hsuan Su, Po-Han Chi, Shih-Cheng Huang, Ho-Lam Chung, Saurav Sahay, Shang-Tse Chen, Hung-Yi Lee
Few-shot Prompting Towards Controllable Response Generation. CoRR (2022)
Wen-Chin Huang, Shu-Wen Yang, Tomoki Hayashi, Hung-Yi Lee, Shinji Watanabe, Tomoki Toda
S3PRL-VC: Open-Source Voice Conversion Framework with Self-Supervised Speech Representations. ICASSP (2022)
Guan-Ting Lin, Chan-Jan Hsu, Da-Rong Liu, Hung-Yi Lee, Yu Tsao
Analyzing The Robustness of Unsupervised Speech Recognition. ICASSP (2022)
Hung-Yi Lee, Shinji Watanabe, Karen Livescu, Abdelrahman Mohamed, Tara N. Sainath
Editorial Editorial of Special Issue on Self-Supervised Learning for Speech and Audio Processing. IEEE J. Sel. Top. Signal Process. 16 (6) (2022)
Wei-Tsung Kao, Yuen-Kwei Wu, Chia-Ping Chen, Zhi-Sheng Chen, Yu-Pao Tsai, Hung-Yi Lee
On the Efficiency of Integrating Self-supervised Learning and Meta-learning for User-defined Few-shot Keyword Spotting. CoRR (2022)
David Cheng-Han Chiang, Hung-Yi Lee
Re-Examining Human Annotations for Interpretable NLP. CoRR (2022)
David Cheng-Han Chiang, Hung-Yi Lee
On the Transferability of Pre-trained Language Models: A Study from Artificial Datasets. AAAI (2022)
Tung-Yu Wu, Chen-An Li, Tzu-Han Lin, Tsu-Yuan Hsu, Hung-Yi Lee
The Ability of Self-Supervised Speech Models for Audio Representations. CoRR (2022)
Yung-Sung Chuang, Mingye Gao, Hongyin Luo, James R. Glass, Hung-Yi Lee, Yun-Nung Chen, Shang-Wen Li
Mitigating Biases in Toxic Language Detection through Invariant Rationalization. CoRR (2021)
Jiun-Hao Jhan, Chao-Peng Liu, Shyh-Kang Jeng, Hung-Yi Lee
CheerBots: Chatbots toward Empathy and Emotionusing Reinforcement Learning. CoRR (2021)
Wei-Tsung Kao, Hung-Yi Lee
Is BERT a Cross-Disciplinary Knowledge Learner? A Surprising Finding of Pre-trained Models' Transferability. CoRR (2021)
Wen-Chin Huang, Shu-Wen Yang, Tomoki Hayashi, Hung-Yi Lee, Shinji Watanabe, Tomoki Toda
S3PRL-VC: Open-source Voice Conversion Framework with Self-supervised Speech Representations. CoRR (2021)
Cheng-I Lai, Yung-Sung Chuang, Hung-Yi Lee, Shang-Wen Li, James R. Glass
Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining. ICASSP (2021)
Fan-Keng Sun, Cheng-Hao Ho, Hung-Yi Lee
LAMOL: LAnguage MOdeling for Lifelong Language Learning. ICLR (2020)
Da-Yi Wu, Hung-Yi Lee
One-Shot Voice Conversion by Vector Quantization. ICASSP (2020)
Da-Yi Wu, Yen-Hao Chen, Hung-Yi Lee
VQVC+: One-Shot Voice Conversion by Vector Quantization and U-Net architecture. CoRR (2020)
Chun-Hao Chao, Pin-Lun Hsu, Hung-Yi Lee, Yu-Chiang Frank Wang
Self-Supervised Deep Learning for Fisheye Image Rectification. ICASSP (2020)
Shun-Yao Shih, Fan-Keng Sun, Hung-Yi Lee
Temporal pattern attention for multivariate time series forecasting. Mach. Learn. 108 (8-9) (2019)
Fan-Keng Sun, Cheng-Hao Ho, Hung-Yi Lee
LAMAL: LAnguage Modeling Is All You Need for Lifelong Language Learning. CoRR (2019)
Bo-Wen Chen, Yen-Min Hsu, Hung-Yi Lee
J-Net: Randomly weighted U-Net for audio source separation. CoRR (2019)
Shun-Yao Shih, Fan-Keng Sun, Hung-Yi Lee
Temporal Pattern Attention for Multivariate Time Series Forecasting. CoRR (2018)