James R. Glass

ORCID

Publication Activity (10 Years)

Years Active: 1985-2024
Publications (10 Years): 332

Top Venues

Massachusetts Institute of Technology, Cambridge, MA, USA (PHD)

Education History

Massachusetts Institute of Technology, Cambridge, MA, USA

PHD

Publications

Heng-Jui Chang, James R. Glass
R-Spin: Efficient Speaker and Noise-invariant Representation Learning with Acoustic Pieces. NAACL-HLT (2024)
Alexander H. Liu, Sung-Lin Yeh, James R. Glass
Revisiting Self-supervised Learning of Speech Representation from a Mutual Information Perspective. CoRR (2024)
Wei Fang, Yung-Sung Chuang, James R. Glass
Joint Inference of Retrieval and Generation for Passage Re-ranking. EACL (Findings) (2024)
Yung-Sung Chuang, Linlu Qiu, Cheng-Yu Hsieh, Ranjay Krishna, Yoon Kim, James R. Glass
Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps. CoRR (2024)
Yung-Sung Chuang, Yujia Xie, Hongyin Luo, Yoon Kim, James R. Glass, Pengcheng He
DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models. ICLR (2024)
Liming Wang, Yuan Gong, Nauman Dawalatabad, Marco Vilela, Katerina Placek, Brian Tracey, Yishu Gong, Alan Premasiri, Fernando Vieira, James R. Glass
Automatic Prediction of Amyotrophic Lateral Sclerosis Progression using Longitudinal Speech Transformer. CoRR (2024)
Zhang-Wei Hong, Idan Shenfeld, Tsun-Hsuan Wang, Yung-Sung Chuang, Aldo Pareja, James R. Glass, Akash Srivastava, Pulkit Agrawal
Curiosity-driven Red-teaming for Large Language Models. ICLR (2024)
Zhang-Wei Hong, Idan Shenfeld, Tsun-Hsuan Wang, Yung-Sung Chuang, Aldo Pareja, James R. Glass, Akash Srivastava, Pulkit Agrawal
Curiosity-driven Red-teaming for Large Language Models. CoRR (2024)
Tianhua Zhang, Kun Li, Hongyin Luo, Xixin Wu, James R. Glass, Helen Meng
Adaptive Query Rewriting: Aligning Rewriters through Marginal Probability of Conversational Answers. CoRR (2024)
Cheng-Yu Hsieh, Yung-Sung Chuang, Chun-Liang Li, Zifeng Wang, Long T. Le, Abhishek Kumar, James R. Glass, Alexander Ratner, Chen-Yu Lee, Ranjay Krishna, Tomas Pfister
Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilization. CoRR (2024)
Yuan Gong, Hongyin Luo, Alexander H. Liu, Leonid Karlinsky, James R. Glass
Listen, Think, and Understand. ICLR (2024)
Andrew Rouditchenko, Yuan Gong, Samuel Thomas, Leonid Karlinsky, Hilde Kuehne, Rogério Feris, James R. Glass
Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation. CoRR (2024)
Junmo Kang, Hongyin Luo, Yada Zhu, Jacob A. Hansen, James R. Glass, David D. Cox, Alan Ritter, Rogério Feris, Leonid Karlinsky
Self-Specialization: Uncovering Latent Expertise within Large Language Models. ACL (Findings) (2024)
Philip Schroeder, Nathaniel Morgan, Hongyin Luo, James R. Glass
THREAD: Thinking Deeper with Recursive Spawning. CoRR (2024)
Cheng-Yu Hsieh, Yung-Sung Chuang, Chun-Liang Li, Zifeng Wang, Long T. Le, Abhishek Kumar, James R. Glass, Alexander Ratner, Chen-Yu Lee, Ranjay Krishna, Tomas Pfister
Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization. ACL (Findings) (2024)
Alexander H. Liu, Sung-Lin Yeh, James R. Glass
Revisiting Self-supervised Learning of Speech Representation from a Mutual Information Perspective. ICASSP (2024)
Heng-Jui Chang, Alexander H. Liu, James R. Glass
Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clustering. INTERSPEECH (2023)
Yuan Gong, Andrew Rouditchenko, Alexander H. Liu, David Harwath, Leonid Karlinsky, Hilde Kuehne, James R. Glass
Contrastive Audio-Visual Masked Autoencoder. ICLR (2023)
Hongyin Luo, James R. Glass
Logic Against Bias: Textual Entailment Mitigates Stereotypical Sentence Reasoning. EACL (2023)
Jiaxin Ge, Hongyin Luo, Yoon Kim, James R. Glass
Entailment as Robust Self-Learner. CoRR (2023)
Alexander H. Liu, Heng-Jui Chang, Michael Auli, Wei-Ning Hsu, James R. Glass
DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning. CoRR (2023)
Yung-Sung Chuang, Wei Fang, Shang-Wen Li, Wen-tau Yih, James R. Glass
Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering. ACL (Findings) (2023)
Hongyin Luo, Tianhua Zhang, Yung-Sung Chuang, Yuan Gong, Yoon Kim, Xixin Wu, Helen Meng, James R. Glass
Search Augmented Instruction Learning. EMNLP (Findings) (2023)
Cheng-I Jeff Lai, Freda Shi, Puyuan Peng, Yoon Kim, Kevin Gimpel, Shiyu Chang, Yung-Sung Chuang, Saurabhchand Bhati, David D. Cox, David Harwath, Yang Zhang, Karen Livescu, James R. Glass
Audio-Visual Neural Syntax Acquisition. CoRR (2023)
Jingyu Zhang, James R. Glass, Tianxing He
PCFG-Based Natural Language Interface Improves Generalization for Controlled Text Generation. *SEM@ACL (2023)
Jiaxin Ge, Hongyin Luo, Yoon Kim, James R. Glass
Entailment as Robust Self-Learner. ACL (1) (2023)
Junmo Kang, Hongyin Luo, Yada Zhu, James R. Glass, David D. Cox, Alan Ritter, Rogério Feris, Leonid Karlinsky
Self-Specialization: Uncovering Latent Expertise within Large Language Models. CoRR (2023)
Heng-Jui Chang, James R. Glass
R-Spin: Efficient Speaker and Noise-invariant Representation Learning with Acoustic Pieces. CoRR (2023)
Yung-Sung Chuang, Wei Fang, Shang-Wen Li, Wen-tau Yih, James R. Glass
Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering. CoRR (2023)
Heng-Jui Chang, Alexander H. Liu, James R. Glass
Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clustering. CoRR (2023)
David Cheng-Han Chiang, Yung-Sung Chuang, James R. Glass, Hung-yi Lee
Revealing the Blind Spot of Sentence Encoder Evaluation by HEROS. CoRR (2023)
Yuan Gong, Alexander H. Liu, Hongyin Luo, Leonid Karlinsky, James R. Glass
Joint Audio and Speech Understanding. ASRU (2023)
Tianhua Zhang, Jiaxin Ge, Hongyin Luo, Yung-Sung Chuang, Mingye Gao, Yuan Gong, Xixin Wu, Yoon Kim, Helen Meng, James R. Glass
Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning. CoRR (2023)
Tianhua Zhang, Hongyin Luo, Yung-Sung Chuang, Wei Fang, Luc Gaitskell, Thomas Hartvigsen, Xixin Wu, Danny Fox, Helen Meng, James R. Glass
Interpretable Unified Language Checking. CoRR (2023)
Brian Chen, Nina Shvetsova, Andrew Rouditchenko, Daniel Kondermann, Samuel Thomas, Shih-Fu Chang, Rogério Feris, James R. Glass, Hilde Kuehne
What, when, and where? - Self-Supervised Spatio-Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructions. CoRR (2023)
Hongyin Luo, Yung-Sung Chuang, Yuan Gong, Tianhua Zhang, Yoon Kim, Xixin Wu, Danny Fox, Helen Meng, James R. Glass
SAIL: Search-Augmented Instruction Learning. CoRR (2023)
Tianxing He, Jingyu Zhang, Tianle Wang, Sachin Kumar, Kyunghyun Cho, James R. Glass, Yulia Tsvetkov
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation. ACL (1) (2023)
Sameer Khurana, Nauman Dawalatabad, Antoine Laurent, Luis Vicente, Pablo Gimeno, Victoria Mingote, James R. Glass
Improved Cross-Lingual Transfer Learning For Automatic Speech Translation. CoRR (2023)
Cheng-I Jeff Lai, Freda Shi, Puyuan Peng, Yoon Kim, Kevin Gimpel, Shiyu Chang, Yung-Sung Chuang, Saurabhchand Bhati, David D. Cox, David Harwath, Yang Zhang, Karen Livescu, James R. Glass
Audio-Visual Neural Syntax Acquisition. ASRU (2023)
Hongyin Luo, James R. Glass
Logic Against Bias: Textual Entailment Mitigates Stereotypical Sentence Reasoning. CoRR (2023)
Yuan Gong, Hongyin Luo, Alexander H. Liu, Leonid Karlinsky, James R. Glass
Listen, Think, and Understand. CoRR (2023)
David Cheng-Han Chiang, Hung-yi Lee, Yung-Sung Chuang, James R. Glass
Revealing the Blind Spot of Sentence Encoder Evaluation by HEROS. RepL4NLP@ACL (2023)
Yuan Gong, Alexander H. Liu, Hongyin Luo, Leonid Karlinsky, James R. Glass
Joint Audio and Speech Understanding. CoRR (2023)
Yuan Gong, Sameer Khurana, Leonid Karlinsky, James R. Glass
Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong General Audio Event Taggers. INTERSPEECH (2023)
Andrew Rouditchenko, Yung-Sung Chuang, Nina Shvetsova, Samuel Thomas, Rogério Feris, Brian Kingsbury, Leonid Karlinsky, David Harwath, Hilde Kuehne, James R. Glass
C2KD: Cross-Lingual Cross-Modal Knowledge Distillation for Multilingual Text-Video Retrieval. ICASSP (2023)
Andrew Rouditchenko, Sameer Khurana, Samuel Thomas, Rogério Feris, Leonid Karlinsky, Hilde Kuehne, David Harwath, Brian Kingsbury, James R. Glass
Comparison of Multilingual Self-Supervised and Weakly-Supervised Speech Pre-Training for Adaptation to Unseen Languages. CoRR (2023)
Yuan Gong, Sameer Khurana, Leonid Karlinsky, James R. Glass
Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong General Audio Event Taggers. CoRR (2023)
Yung-Sung Chuang, Yujia Xie, Hongyin Luo, Yoon Kim, James R. Glass, Pengcheng He
DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models. CoRR (2023)
Andrew Rouditchenko, Sameer Khurana, Samuel Thomas, Rogério Feris, Leonid Karlinsky, Hilde Kuehne, David Harwath, Brian Kingsbury, James R. Glass
Comparison of Multilingual Self-Supervised and Weakly-Supervised Speech Pre-Training for Adaptation to Unseen Languages. INTERSPEECH (2023)
Nauman Dawalatabad, Sameer Khurana, Antoine Laurent, James R. Glass
On Unsupervised Uncertainty-Driven Speech Pseudo-Label Filtering and Model Calibration. ICASSP (2023)
Cheng-I Jeff Lai, Erica Cooper, Yang Zhang, Shiyu Chang, Kaizhi Qian, Yi-Lun Liao, Yung-Sung Chuang, Alexander H. Liu, Junichi Yamagishi, David D. Cox, James R. Glass
On the Interplay between Sparsity, Naturalness, Intelligibility, and Prosody in Speech Synthesis. ICASSP (2022)
Gene-Ping Yang, Sung-Lin Yeh, Yu-An Chung, James R. Glass, Hao Tang
Autoregressive Predictive Coding: A Comprehensive Study. IEEE J. Sel. Top. Signal Process. 16 (6) (2022)
Yuan Gong, Jin Yu, James R. Glass
Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition. ICASSP (2022)
Nina Shvetsova, Brian Chen, Andrew Rouditchenko, Samuel Thomas, Brian Kingsbury, Rogério Feris, David Harwath, James R. Glass, Hilde Kuehne
Everything at Once - Multi-modal Fusion Transformer for Video Retrieval. CVPR (2022)
Sameer Khurana, Antoine Laurent, James R. Glass
SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representation. CoRR (2022)
Yuan Gong, Alexander H. Liu, Andrew Rouditchenko, James R. Glass
UAVM: Towards Unifying Audio and Visual Models. IEEE Signal Process. Lett. 29 (2022)
Yuan Gong, Ziyi Chen, Iek-Heng Chu, Peng Chang, James R. Glass
Transformer-Based Multi-Aspect Multi-Granularity Non-Native English Speaker Pronunciation Assessment. CoRR (2022)
Yung-Sung Chuang, Rumen Dangovski, Hongyin Luo, Yang Zhang, Shiyu Chang, Marin Soljacic, Shang-Wen Li, Scott Yih, Yoon Kim, James R. Glass
DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings. NAACL-HLT (2022)
Yuan Gong, Cheng-I Lai, Yu-An Chung, James R. Glass
SSAST: Self-Supervised Audio Spectrogram Transformer. AAAI (2022)
Sameer Khurana, Antoine Laurent, James R. Glass
SAMU-XLSR: Semantically-Aligned Multimodal Utterance-Level Cross-Lingual Speech Representation. IEEE J. Sel. Top. Signal Process. 16 (6) (2022)
Tianxing He, Jingyu Zhang, Tianle Wang, Sachin Kumar, Kyunghyun Cho, James R. Glass, Yulia Tsvetkov
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation. CoRR (2022)
Sameer Khurana, Antoine Laurent, James R. Glass
Magic Dust for Cross-Lingual Adaptation of Monolingual Wav2vec-2.0. ICASSP (2022)
Yuan Gong, Sameer Khurana, Andrew Rouditchenko, James R. Glass
CMKD: CNN/Transformer-Based Cross-Model Knowledge Distillation for Audio Classification. CoRR (2022)
Christopher Song, David Harwath, Tuka Alhanai, James R. Glass
Speak: A Toolkit Using Amazon Mechanical Turk to Collect and Validate Speech Audio Recordings. LREC (2022)
Alexander H. Liu, Cheng-I Lai, Wei-Ning Hsu, Michael Auli, Alexei Baevski, James R. Glass
Simple and Effective Unsupervised Speech Synthesis. INTERSPEECH (2022)
Yuan Gong, Andrew Rouditchenko, Alexander H. Liu, David Harwath, Leonid Karlinsky, Hilde Kuehne, James R. Glass
Contrastive Audio-Visual Masked Autoencoder. CoRR (2022)
Hongyin Luo, Shang-Wen Li, Mingye Gao, Seunghak Yu, James R. Glass
Cooperative Self-training of Machine Reading Comprehension. NAACL-HLT (2022)
Yuan Gong, Ziyi Chen, Iek-Heng Chu, Peng Chang, James R. Glass
Transformer-Based Multi-Aspect Multi-Granularity Non-Native English Speaker Pronunciation Assessment. ICASSP (2022)
Yung-Sung Chuang, Rumen Dangovski, Hongyin Luo, Yang Zhang, Shiyu Chang, Marin Soljacic, Shang-Wen Li, Wen-tau Yih, Yoon Kim, James R. Glass
DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings. CoRR (2022)
Andrew Rouditchenko, Yung-Sung Chuang, Nina Shvetsova, Samuel Thomas, Rogério Feris, Brian Kingsbury, Leonid Karlinsky, David Harwath, Hilde Kuehne, James R. Glass
C2KD: Cross-Lingual Cross-Modal Knowledge Distillation for Multilingual Text-Video Retrieval. CoRR (2022)
Yuan Gong, Alexander H. Liu, Andrew Rouditchenko, James R. Glass
UAVM: A Unified Model for Audio-Visual Learning. CoRR (2022)
Nauman Dawalatabad, Yuan Gong, Sameer Khurana, Rhoda Au, James R. Glass
Detecting Dementia from Long Neuropsychological Interviews. EMNLP (Findings) (2022)
Nauman Dawalatabad, Sameer Khurana, Antoine Laurent, James R. Glass
On Unsupervised Uncertainty-Driven Speech Pseudo-Label Filtering and Model Calibration. CoRR (2022)
Yuan Gong, Jin Yu, James R. Glass
Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition. CoRR (2022)
R'mani Haulcy, Katerina Placek, Brian Tracey, Adam Vogel, James R. Glass
Repetition Assessment for Speech and Language Disorders: A Study of the Logopenic Variant of Primary Progressive Aphasia. ICASSP (2022)
Jiabao Ji, Yoon Kim, James R. Glass, Tianxing He
Controlling the Focus of Pretrained Language Generation Models. ACL (Findings) (2022)
Alexander H. Liu, Cheng-I Jeff Lai, Wei-Ning Hsu, Michael Auli, Alexei Baevski, James R. Glass
Simple and Effective Unsupervised Speech Synthesis. CoRR (2022)
Jiabao Ji, Yoon Kim, James R. Glass, Tianxing He
Controlling the Focus of Pretrained Language Generation Models. CoRR (2022)
Vijay Gadepally, Gregory Angelides, Andrei Barbu, Andrew Bowne, Laura J. Brattain, Tamara Broderick, Armando Cabrera, Glenn Carl, Ronisha Carter, Miriam Cha, Emilie Cowen, Jesse Cummings, Bill Freeman, James R. Glass, Sam Goldberg, Mark Hamilton, Thomas Heldt, Kuan Wei Huang, Phillip Isola, Boris Katz, Jamie Koerner, Yen-Chen Lin, David Mayo, Kyle McAlpin, Taylor Perron, Jean E. Piou, Hrishikesh M. Rao, Hayley Reynolds, Kaira Samuel, Siddharth Samsi, Morgan Schmidt, Leslie Shing, Olga Simek, Brandon Swenson, Vivienne Sze, Jonathan Taylor, Paul Tylkin, Mark Veillette, Matthew L. Weiss, Allan B. Wollaber, Sophia Yuditskaya, Jeremy Kepner
Developing a Series of AI Challenges for the United States Department of the Air Force. CoRR (2022)
Jingyu Zhang, James R. Glass, Tianxing He
PCFG-based Natural Language Interface Improves Generalization for Controlled Text Generation. CoRR (2022)
Alexander H. Liu, SouYoung Jin, Cheng-I Lai, Andrew Rouditchenko, Aude Oliva, James R. Glass
Cross-Modal Discrete Representation Learning. ACL (1) (2022)
Mathew Monfort, SouYoung Jin, Alexander H. Liu, David Harwath, Rogério Feris, James R. Glass, Aude Oliva
Spoken Moments: Learning Joint Audio-Visual Representations From Video Descriptions. CVPR (2021)
Yuan Gong, Cheng-I Jeff Lai, Yu-An Chung, James R. Glass
SSAST: Self-Supervised Audio Spectrogram Transformer. CoRR (2021)
Andrew Rouditchenko, Angie W. Boggust, David Harwath, Brian Chen, Dhiraj Joshi, Samuel Thomas, Kartik Audhkhasi, Hilde Kuehne, Rameswar Panda, Rogério Schmidt Feris, Brian Kingsbury, Michael Picheny, Antonio Torralba, James R. Glass
AVLnet: Learning Audio-Visual Language Representations from Instructional Videos. Interspeech (2021)
Yung-Sung Chuang, Mingye Gao, Hongyin Luo, James R. Glass, Hung-Yi Lee, Yun-Nung Chen, Shang-Wen Li
Mitigating Biases in Toxic Language Detection through Invariant Rationalization. CoRR (2021)
Nina Shvetsova, Brian Chen, Andrew Rouditchenko, Samuel Thomas, Brian Kingsbury, Rogério Feris, David Harwath, James R. Glass, Hilde Kuehne
Everything at Once - Multi-modal Fusion Transformer for Video Retrieval. CoRR (2021)
Mathew Monfort, SouYoung Jin, Alexander H. Liu, David Harwath, Rogério Feris, James R. Glass, Aude Oliva
Spoken Moments: Learning Joint Audio-Visual Representations from Video Descriptions. CoRR (2021)
Seunghak Yu, Giovanni Da San Martino, Mitra Mohtarami, James R. Glass, Preslav Nakov
Interpretable Propaganda Detection in News Articles. RANLP (2021)
Yuan Gong, Yu-An Chung, James R. Glass
AST: Audio Spectrogram Transformer. CoRR (2021)
Brian Chen, Andrew Rouditchenko, Kevin Duarte, Hilde Kuehne, Samuel Thomas, Angie W. Boggust, Rameswar Panda, Brian Kingsbury, Rogério Schmidt Feris, David Harwath, James R. Glass, Michael Picheny, Shih-Fu Chang
Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos. CoRR (2021)
Yuan Gong, Yu-An Chung, James R. Glass
AST: Audio Spectrogram Transformer. Interspeech (2021)
Hongyin Luo, Shang-Wen Li, James R. Glass
Knowledge Grounded Conversational Symptom Detection with Graph Memory Networks. CoRR (2021)
Yuan Gong, Yu-An Chung, James R. Glass
PSLA: Improving Audio Event Classification with Pretraining, Sampling, Labeling, and Aggregation. CoRR (2021)
Kevin Duarte, Brian Chen, Nina Shvetsova, Andrew Rouditchenko, Samuel Thomas, Alexander Liu, David Harwath, James R. Glass, Hilde Kuehne, Mubarak Shah
Routing with Self-Attention for Multimodal Capsule Networks. CoRR (2021)
Cheng-I Jeff Lai, Yang Zhang, Alexander H. Liu, Shiyu Chang, Yi-Lun Liao, Yung-Sung Chuang, Kaizhi Qian, Sameer Khurana, David D. Cox, James R. Glass
PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognition. CoRR (2021)
Hongyin Luo, James R. Glass, Garima Lalwani, Yi Zhang, Shang-Wen Li
Joint Retrieval-Extraction Training for Evidence-Aware Dialog Response Selection. Interspeech (2021)
Hongyin Luo, Shang-Wen Li, Seunghak Yu, James R. Glass
Cooperative Learning of Zero-Shot Machine Reading Comprehension. CoRR (2021)
Brian Chen, Andrew Rouditchenko, Kevin Duarte, Hilde Kuehne, Samuel Thomas, Angie W. Boggust, Rameswar Panda, Brian Kingsbury, Rogério Feris, David Harwath, James R. Glass, Michael Picheny, Shih-Fu Chang
Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos. ICCV (2021)
Sameer Khurana, Antoine Laurent, James R. Glass
Magic dust for cross-lingual adaptation of monolingual wav2vec-2.0. CoRR (2021)
Alexander H. Liu, Yu-An Chung, James R. Glass
Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies. Interspeech (2021)

James R. Glass.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

James R. Glass