Mark Hasegawa-Johnson

ORCID

Publication Activity (10 Years)

Years Active: 2000-2024
Publications (10 Years): 166

Top Venues

CoRR

INTERSPEECH

ICASSP

IEEE ACM Trans. Audio Speech Lang. Process.

Publications

Jialu Li, Mark Hasegawa-Johnson, Nancy L. McElwain
Analysis of Self-Supervised Speech Models on Children's Speech and Infant Vocalizations. CoRR (2024)
Bashima Islam, Nancy L. McElwain, Jialu Li, Maria I. Davila, Yannan Hu, Kexin Hu, Jordan M. Bodway, Ashutosh Dhekne, Romit Roy Choudhury, Mark Hasegawa-Johnson
Preliminary Technical Validation of LittleBeats™: A Multimodal Sensing Platform to Capture Cardiac Physiology, Motion, and Vocalizations. Sensors 24 (3) (2024)
Liming Wang, Mark Hasegawa-Johnson, Chang Dong Yoo
A Theory of Unsupervised Speech Recognition. ACL (1) (2023)
John B. Harvill, Mark Hasegawa-Johnson, Hee Suk Yoon, Chang D. Yoo, Eunseop Yoon
One-Shot Exemplification Modeling via Latent Sense Representations. RepL4NLP@ACL (2023)
Zhongweiyang Xu, Xulin Fan, Mark Hasegawa-Johnson
Dual-Path Cross-Modal Attention for Better Audio-Visual Speech Extraction. ICASSP (2023)
Jialu Li, Mark Hasegawa-Johnson, Nancy L. McElwain
Towards Robust Family-Infant Audio Analysis Based on Unsupervised Pretraining of Wav2vec 2.0 on Large-Scale Unlabeled Family Audio. CoRR (2023)
Kai Chieh Chang, Mark Hasegawa-Johnson, Nancy L. McElwain, Bashima Islam
Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data. CoRR (2023)
Eunseop Yoon, Hee Suk Yoon, John B. Harvill, Mark Hasegawa-Johnson, Chang D. Yoo
INTapt: Information-Theoretic Adversarial Prompt Tuning for Enhanced Non-Native Speech Recognition. CoRR (2023)
Zhonghao Wang, Wei Wei, Yang Zhao, Zhisheng Xiao, Mark Hasegawa-Johnson, Humphrey Shi, Tingbo Hou
HiFi Tuner: High-Fidelity Subject-Driven Fine-Tuning for Diffusion Models. CoRR (2023)
Kai Chieh Chang, Mark Hasegawa-Johnson, Nancy L. McElwain, Bashima Islam
Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data. APSIPA ASC (2023)
Liming Wang, Junrui Ni, Heting Gao, Jialu Li, Kai Chieh Chang, Xulin Fan, Junkai Wu, Mark Hasegawa-Johnson, Chang Dong Yoo
Listen, Decipher and Sign: Toward Unsupervised Speech-to-Sign Language Recognition. ACL (Findings) (2023)
Jialu Li, Mark Hasegawa-Johnson, Karrie Karahalios
Enhancing Child Vocalization Classification in Multi-Channel Child-Adult Conversations Through Wav2vec2 Children ASR Features. CoRR (2023)
Oshane O. Thomas, Hongyu Shen, Ryan L. Raaum, William E. H. Harcourt-Smith, John D. Polk, Mark Hasegawa-Johnson
Automated morphological phenotyping using learned shape descriptors and functional maps: A novel approach to geometric morphometrics. PLoS Comput. Biol. 19 (1) (2023)
Abhayjeet Singh, Amala Nagireddi, Deekshitha G, Jesuraja Bandekar, Roopa R., Sandhya Badiger, Sathvik Udupa, Prasanta Kumar Ghosh, Hema A. Murthy, Heiga Zen, Pranaw Kumar, Kamal Kant, Amol Bole, Bira Chandra Singh, Keiichi Tokuda, Mark Hasegawa-Johnson, Philipp Olbrich
Lightweight, Multi-Speaker, Multi-Lingual Indic Text-to-Speech. ICASSP (2023)
Liming Wang, Mark Hasegawa-Johnson, Chang D. Yoo
Unsupervised Speech Recognition with N-Skipgram and Positional Unigram Matching. CoRR (2023)
Eunseop Yoon, Hee Suk Yoon, John B. Harvill, Mark Hasegawa-Johnson, Chang Dong Yoo
INTapt: Information-Theoretic Adversarial Prompt Tuning for Enhanced Non-Native Speech Recognition. ACL (Findings) (2023)
Eunseop Yoon, Hee Suk Yoon, Dhananjaya Gowda, SooHwan Eom, Daehyeok Kim, John B. Harvill, Heting Gao, Mark Hasegawa-Johnson, Chanwoo Kim, Chang D. Yoo
Mitigating the Exposure Bias in Sentence-Level Grapheme-to-Phoneme (G2P) Transduction. CoRR (2023)
Heting Gao, Junrui Ni, Kaizhi Qian, Yang Zhang, Shiyu Chang, Mark Hasegawa-Johnson
WavPrompt: Towards Few-Shot Spoken Language Understanding with Frozen Language Models. INTERSPEECH (2022)
Zhongweiyang Xu, Xulin Fan, Mark Hasegawa-Johnson
Dual-path Attention is All You Need for Audio-Visual Speech Extraction. CoRR (2022)
John B. Harvill, Mark Hasegawa-Johnson, Chang D. Yoo
Frame-Level Stutter Detection. INTERSPEECH (2022)
Heting Gao, Xiaoxuan Wang, Sunghun Kang, Rusty Mina, Dias Issa, John B. Harvill, Leda Sari, Mark Hasegawa-Johnson, Chang D. Yoo
Seamless equal accuracy ratio for inclusive CTC speech recognition. Speech Commun. 136 (2022)
Haeyong Kang, Rusty John Lloyd Mina, Sultan Rizky Hikmawan Madjid, Jaehong Yoon, Mark Hasegawa-Johnson, Sung Ju Hwang, Chang D. Yoo
Forget-free Continual Learning with Winning Subnetworks. ICML (2022)
Heting Gao, Junrui Ni, Kaizhi Qian, Yang Zhang, Shiyu Chang, Mark Hasegawa-Johnson
WAVPROMPT: Towards Few-Shot Spoken Language Understanding with Frozen Language Models. CoRR (2022)
Hee Suk Yoon, Eunseop Yoon, John B. Harvill, Sunjae Yoon, Mark Hasegawa-Johnson, Chang D. Yoo
SMSMix: Sense-Maintained Sentence Mixup for Word Sense Disambiguation. CoRR (2022)
Raymond A. Yeh, Yuan-Ting Hu, Mark Hasegawa-Johnson, Alexander G. Schwing
Equivariance Discovery by Learned Parameter-Sharing. CoRR (2022)
Jialu Li, Mark Hasegawa-Johnson, Nancy L. McElwain
Visualizations of Complex Sequences of Family-Infant Vocalizations Using Bag-of-Audio-Words Approach Based on Wav2vec 2.0 Features. CoRR (2022)
Kaizhi Qian, Yang Zhang, Heting Gao, Junrui Ni, Cheng-I Lai, David D. Cox, Mark Hasegawa-Johnson, Shiyu Chang
ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakers. ICML (2022)
Piotr Zelasko, Siyuan Feng, Laureano Moro-Velázquez, Ali Abavisani, Saurabhchand Bhati, Odette Scharenborg, Mark Hasegawa-Johnson, Najim Dehak
Discovering phonetic inventories with crosslingual automatic speech recognition. Comput. Speech Lang. 74 (2022)
Kaizhi Qian, Yang Zhang, Heting Gao, Junrui Ni, Cheng-I Lai, David D. Cox, Mark Hasegawa-Johnson, Shiyu Chang
Improving Self-Supervised Speech Representations by Disentangling Speakers. CoRR (2022)
Jialu Li, Mark Hasegawa-Johnson
Autosegmental Neural Nets 2.0: An Extensive Study of Training Synchronous and Asynchronous Phones and Tones for Under-Resourced Tonal Languages. IEEE ACM Trans. Audio Speech Lang. Process. 30 (2022)
Chak Ho Chan, Kaizhi Qian, Yang Zhang, Mark Hasegawa-Johnson
SpeechSplit2.0: Unsupervised Speech Disentanglement for Voice Conversion without Tuning Autoencoder Bottlenecks. ICASSP (2022)
Junrui Ni, Liming Wang, Heting Gao, Kaizhi Qian, Yang Zhang, Shiyu Chang, Mark Hasegawa-Johnson
Unsupervised Text-to-Speech Synthesis by Unsupervised Automatic Speech Recognition. INTERSPEECH (2022)
Heting Gao, Junrui Ni, Yang Zhang, Kaizhi Qian, Shiyu Chang, Mark Hasegawa-Johnson
Domain Generalization for Language-Independent Automatic Speech Recognition. Frontiers Artif. Intell. 5 (2022)
Mahir Morshed, Mark Hasegawa-Johnson
Cross-lingual articulatory feature information transfer for speech recognition using recurrent progressive neural networks. INTERSPEECH (2022)
Piotr Zelasko, Siyuan Feng, Laureano Moro-Velázquez, Ali Abavisani, Saurabhchand Bhati, Odette Scharenborg, Mark Hasegawa-Johnson, Najim Dehak
Discovering Phonetic Inventories with Crosslingual Automatic Speech Recognition. CoRR (2022)
John B. Harvill, Yash R. Wani, Moitreya Chatterjee, Mustafa Alam, David G. Beiser, David Chestek, Mark Hasegawa-Johnson, Narendra Ahuja
Detection of Covid-19 from Joint Time and Frequency Analysis of Speech, Breathing and Cough Audio. ICASSP (2022)
Raymond A. Yeh, Yuan-Ting Hu, Mark Hasegawa-Johnson, Alexander G. Schwing
Equivariance Discovery by Learned Parameter-Sharing. AISTATS (2022)
Hee Suk Yoon, Eunseop Yoon, John B. Harvill, Sunjae Yoon, Mark Hasegawa-Johnson, Chang Dong Yoo
SMSMix: Sense-Maintained Sentence Mixup for Word Sense Disambiguation. EMNLP (Findings) (2022)
John B. Harvill, Roxana Girju, Mark Hasegawa-Johnson
Syn2Vec: Synset Colexification Graphs for Lexical Semantic Similarity. NAACL-HLT (2022)
John B. Harvill, Yash R. Wani, Mustafa Alam, Narendra Ahuja, Mark Hasegawa-Johnson, David Chestek, David G. Beiser
Estimation of Respiratory Rate from Breathing Audio. EMBC (2022)
Liming Wang, Siyuan Feng, Mark Hasegawa-Johnson, Chang Dong Yoo
Self-supervised Semantic-driven Phoneme Discovery for Zero-resource Speech Recognition. ACL (1) (2022)
Chak Ho Chan, Kaizhi Qian, Yang Zhang, Mark Hasegawa-Johnson
SpeechSplit 2.0: Unsupervised speech disentanglement for voice conversion Without tuning autoencoder Bottlenecks. CoRR (2022)
Junrui Ni, Liming Wang, Heting Gao, Kaizhi Qian, Yang Zhang, Shiyu Chang, Mark Hasegawa-Johnson
Unsupervised Text-to-Speech Synthesis by Unsupervised Automatic Speech Recognition. CoRR (2022)
Junghyun Lee, Gwangsu Kim, Mahbod Olfat, Mark Hasegawa-Johnson, Chang D. Yoo
Fast and Efficient MMD-Based Fair PCA via Optimization over Stiefel Manifold. AAAI (2022)
Liming Wang, Mark Hasegawa-Johnson
A Translation Framework for Visually Grounded Spoken Unit Discovery. ACSCC (2021)
Siyuan Feng, Piotr Zelasko, Laureano Moro-Velázquez, Ali Abavisani, Mark Hasegawa-Johnson, Odette Scharenborg, Najim Dehak
How Phonotactics Affect Multilingual and Zero-Shot ASR Performance. ICASSP (2021)
Jialu Li, Mark Hasegawa-Johnson, Nancy L. McElwain
Analysis of acoustic and voice quality features for the classification of infant and mother vocalizations. Speech Commun. 133 (2021)
Junzhe Zhu, Raymond A. Yeh, Mark Hasegawa-Johnson
Multi-Decoder Dprnn: Source Separation for Variable Number of Speakers. ICASSP (2021)
Xinsheng Wang, Justin van der Hout, Jihua Zhu, Mark Hasegawa-Johnson, Odette Scharenborg
Synthesizing Spoken Descriptions of Images. IEEE ACM Trans. Audio Speech Lang. Process. 29 (2021)
Kiran Ramnath, Leda Sari, Mark Hasegawa-Johnson, Chang D. Yoo
Worldly Wise (WoW) - Cross-Lingual Knowledge Fusion for Fact-based Visual Spoken-Question Answering. NAACL-HLT (2021)
Kaizhi Qian, Yang Zhang, Shiyu Chang, Jinjun Xiong, Chuang Gan, David D. Cox, Mark Hasegawa-Johnson
Global Rhythm Style Transfer Without Text Transcriptions. CoRR (2021)
John B. Harvill, Yash R. Wani, Mark Hasegawa-Johnson, Narendra Ahuja, David G. Beiser, David Chestek
Classification of COVID-19 from Cough Using Autoregressive Predictive Coding Pretraining and Spectral Data Augmentation. Interspeech (2021)
Liming Wang, Xinsheng Wang, Mark Hasegawa-Johnson, Odette Scharenborg, Najim Dehak
Align or attend? Toward More Efficient and Accurate Spoken Word Discovery Using Speech-to-Image Retrieval. ICASSP (2021)
John B. Harvill, Dias Issa, Mark Hasegawa-Johnson, Chang Dong Yoo
Synthesis of New Words for Improved Dysarthric Speech Recognition on an Expanded Vocabulary. ICASSP (2021)
Leda Sari, Mark Hasegawa-Johnson, Chang D. Yoo
Counterfactually Fair Automatic Speech Recognition. IEEE ACM Trans. Audio Speech Lang. Process. 29 (2021)
Junzhe Zhu, Mark Hasegawa-Johnson, Nancy L. McElwain
A Comparison Study on Infant-Parent Voice Diarization. ICASSP (2021)
Kaizhi Qian, Yang Zhang, Shiyu Chang, Jinjun Xiong, Chuang Gan, David Cox, Mark Hasegawa-Johnson
Global Prosody Style Transfer Without Text Transcriptions. ICML (2021)
Xinsheng Wang, Siyuan Feng, Jihua Zhu, Mark Hasegawa-Johnson, Odette Scharenborg
Show and Speak: Directly Synthesize Spoken Description of Images. ICASSP (2021)
Heting Gao, Junrui Ni, Yang Zhang, Kaizhi Qian, Shiyu Chang, Mark Hasegawa-Johnson
Zero-Shot Cross-Lingual Phonetic Recognition with External Language Embedding. Interspeech (2021)
Hui Shi, Yang Zhang, Hao Wu, Shiyu Chang, Kaizhi Qian, Mark Hasegawa-Johnson, Jishen Zhao
Continuous Cnn For Nonuniform Time Series. ICASSP (2021)
Leda Sari, Mark Hasegawa-Johnson, Samuel Thomas
Auxiliary Networks for Joint Speaker Adaptation and Speaker Change Detection. IEEE ACM Trans. Audio Speech Lang. Process. 29 (2021)
Zhonghao Wang, Kai Wang, Mo Yu, Jinjun Xiong, Wen-Mei Hwu, Mark Hasegawa-Johnson, Humphrey Shi
Interpretable Visual Reasoning via Induced Symbolic Space. ICCV (2021)
Junghyun Lee, Gwangsu Kim, Matt Olfat, Mark Hasegawa-Johnson, Chang D. Yoo
Fast and Efficient MMD-based Fair PCA via Optimization over Stiefel Manifold. CoRR (2021)
Tarek Sakakini, Jong Yoon Lee, Aditya Duri, Renato Ferreira Leitão Azevedo, Victor Sadauskas, Kuangxiao Gu, Suma Bhat, Daniel G. Morrow, James Graumlich, Saqib Walayat, Mark Hasegawa-Johnson, Thomas S. Huang, Ann Willemsen-Dunlap, Donald Halpin
Context-Aware Automatic Text Simplification of Health Materials in Low-Resource Domains. LOUHI@EMNLP (2020)
Junzhe Zhu, Mark Hasegawa-Johnson, Leda Sari
Identify Speakers in Cocktail Parties with End-to-End Attention. INTERSPEECH (2020)
Leda Sari, Mark Hasegawa-Johnson
Deep F-measure Maximization for End-to-End Speech Understanding. CoRR (2020)
Piotr Zelasko, Laureano Moro-Velázquez, Mark Hasegawa-Johnson, Odette Scharenborg, Najim Dehak
That Sounds Familiar: An Analysis of Phonetic Representations Transfer Across Languages. INTERSPEECH (2020)
Justin van der Hout, Zoltán D'Haese, Mark Hasegawa-Johnson, Odette Scharenborg
Evaluating Automatically Generated Phoneme Captions for Images. CoRR (2020)
Kaizhi Qian, Yang Zhang, Shiyu Chang, David D. Cox, Mark Hasegawa-Johnson
Unsupervised Speech Decomposition via Triple Information Bottleneck. CoRR (2020)
Ali Abavisani, Mark Hasegawa-Johnson
Automatic Estimation of Intelligibility Measure for Consonants in Speech. INTERSPEECH (2020)
Leda Sari, Mark Hasegawa-Johnson
Deep F-Measure Maximization for End-to-End Speech Understanding. INTERSPEECH (2020)
Jialu Li, Mark Hasegawa-Johnson
Autosegmental Neural Nets: Should Phones and Tones be Synchronous or Asynchronous? INTERSPEECH (2020)
Kaizhi Qian, Yang Zhang, Shiyu Chang, Mark Hasegawa-Johnson, David D. Cox
Unsupervised Speech Decomposition via Triple Information Bottleneck. ICML (2020)
Leda Sari, Samuel Thomas, Mark Hasegawa-Johnson
Training Spoken Language Understanding Systems with Non-Parallel Speech and Text. ICASSP (2020)
Junzhe Zhu, Raymond A. Yeh, Mark Hasegawa-Johnson
Multi-Decoder DPRNN: High Accuracy Source Counting and Separation. CoRR (2020)
Zhonghao Wang, Mo Yu, Kai Wang, Jinjun Xiong, Wen-Mei Hwu, Mark Hasegawa-Johnson, Humphrey Shi
Interpretable Visual Reasoning via Induced Symbolic Space. CoRR (2020)
Odette Scharenborg, Lucas Ondel, Shruti Palaskar, Philip Arthur, Francesco Ciannella, Mingxing Du, Elin Larsen, Danny Merkx, Rachid Riad, Liming Wang, Emmanuel Dupoux, Laurent Besacier, Alan W. Black, Mark Hasegawa-Johnson, Florian Metze, Graham Neubig, Sebastian Stüker, Pierre Godard, Markus Müller
Speech Technology for Unwritten Languages. IEEE ACM Trans. Audio Speech Lang. Process. 28 (2020)
Wenda Chen, Jonathan Huang, Mark Hasegawa-Johnson
Utterance-level Intent Recognition from Keywords. CoRR (2020)
Ali Abavisani, Mark Hasegawa-Johnson
Automatic Estimation of Inteligibility Measure for Consonants in Speech. CoRR (2020)
Junzhe Zhu, Mark Hasegawa-Johnson, Nancy McElwain
A Comparison Study on Infant-Parent Voice Diarization. CoRR (2020)
Liming Wang, Mark Hasegawa-Johnson
A DNN-HMM-DNN Hybrid Model for Discovering Word-Like Units from Spoken Captions and Image Regions. INTERSPEECH (2020)
Mark Hasegawa-Johnson, Leanne Rolston, Camille Goudeseune, Gina-Anne Levow, Katrin Kirchhoff
Grapheme-to-Phoneme Transduction for Cross-Language ASR. SLSP (2020)
Piotr Zelasko, Laureano Moro-Velázquez, Mark Hasegawa-Johnson, Odette Scharenborg, Najim Dehak
That Sounds Familiar: an Analysis of Phonetic Representations Transfer Across Languages. CoRR (2020)
Kiran Ramnath, Mark Hasegawa-Johnson
Seeing is Knowing! Fact-based Visual Question Answering using Knowledge Graph Embeddings. CoRR (2020)
Liming Wang, Mark Hasegawa-Johnson
Multimodal Word Discovery and Retrieval With Spoken Descriptions and Visual Concepts. IEEE ACM Trans. Audio Speech Lang. Process. 28 (2020)
Siyuan Feng, Piotr Zelasko, Laureano Moro-Velázquez, Ali Abavisani, Mark Hasegawa-Johnson, Odette Scharenborg, Najim Dehak
How Phonotactics Affect Multilingual and Zero-shot ASR Performance. CoRR (2020)
Kaizhi Qian, Zeyu Jin, Mark Hasegawa-Johnson, Gautham J. Mysore
F0-Consistent Many-To-Many Non-Parallel Voice Conversion Via Conditional Autoencoder. ICASSP (2020)
Xinsheng Wang, Siyuan Feng, Jihua Zhu, Mark Hasegawa-Johnson, Odette Scharenborg
Show and Speak: Directly Synthesize Spoken Description of Images. CoRR (2020)
Justin van der Hout, Zoltán D'Haese, Mark Hasegawa-Johnson, Odette Scharenborg
Evaluating Automatically Generated Phoneme Captions for Images. INTERSPEECH (2020)
Kaizhi Qian, Zeyu Jin, Mark Hasegawa-Johnson, Gautham J. Mysore
F0-consistent many-to-many non-parallel voice conversion via conditional autoencoder. CoRR (2020)
Junzhe Zhu, Mark Hasegawa-Johnson, Leda Sari
Identify Speakers in Cocktail Parties with End-to-End Attention. CoRR (2020)
Jialu Li, Mark Hasegawa-Johnson
Autosegmental Neural Nets: Should Phones and Tones be Synchronous or Asynchronous? CoRR (2020)
Kaizhi Qian, Yang Zhang, Shiyu Chang, Xuesong Yang, Mark Hasegawa-Johnson
AutoVC: Zero-Shot Voice Style Transfer with Only Autoencoder Loss. ICML (2019)
Leda Sari, Samuel Thomas, Mark Hasegawa-Johnson, Michael Picheny
Pre-training of Speaker Embeddings for Low-latency Speaker Change Detection in Broadcast News. ICASSP (2019)
Junrui Ni, Mark Hasegawa-Johnson, Odette Scharenborg
The Time-Course of Phoneme Category Adaptation in Deep Neural Networks. SLSP (2019)
Di He, Xuesong Yang, Boon Pang Lim, Yi Liang, Mark Hasegawa-Johnson, Deming Chen
When CTC Training Meets Acoustic Landmarks. ICASSP (2019)
Mary Pietrowicz, Carla Agurto, Jonah Casebeer, Mark Hasegawa-Johnson, Karrie Karahalios, Guillermo A. Cecchi
Dimensional Analysis of Laughter in Female Conversational Speech. ICASSP (2019)
Feng Li, Kaizhi Qian, Mark Hasegawa-Johnson, Masato Akagi
Monaural Singing Voice Separation Using Fusion-Net with Time-Frequency Masking. APSIPA (2019)
Kaizhi Qian, Yang Zhang, Shiyu Chang, Xuesong Yang, Mark Hasegawa-Johnson
Zero-Shot Voice Style Transfer with Only Autoencoder Loss. CoRR (2019)
Mark Hasegawa-Johnson, Camille Goudeseune, Gina-Anne Levow
Fast transcription of speech in low-resource languages. CoRR (2019)

Mark Hasegawa-Johnson.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Mark Hasegawa-Johnson