Alexei Baevski

Publication Activity (10 Years)

Years Active: 2018-2023
Publications (10 Years): 70

Top Topics

Wall Street Journal Corpus

Visual Representation

Supervised Learning

Speech Recognition

Top Venues

Publications

Derek Xu, Shuyan Dong, Changhan Wang, Suyoun Kim, Zhaojiang Lin, Bing Liu, Akshat Shrivastava, Shang-Wen Li, Liang-Hsuan Tseng, Guan-Ting Lin, Alexei Baevski, Hung-yi Lee, Yizhou Sun, Wei Wang
Introducing Semantics into Speech Encoders. ACL (1) (2023)
Vineel Pratap, Andros Tjandra, Bowen Shi, Paden Tomasello, Arun Babu, Sayani Kundu, Ali Elkahky, Zhaoheng Ni, Apoorv Vyas, Maryam Fazel-Zarandi, Alexei Baevski, Yossi Adi, Xiaohui Zhang, Wei-Ning Hsu, Alexis Conneau, Michael Auli
Scaling Speech Technology to 1, 000+ Languages. CoRR (2023)
Ju-Chieh Chou, Chung-Ming Chien, Wei-Ning Hsu, Karen Livescu, Arun Babu, Alexis Conneau, Alexei Baevski, Michael Auli
Toward Joint Language Modeling for Speech Units and Text. CoRR (2023)
Ju-Chieh Chou, Chung-Ming Chien, Wei-Ning Hsu, Karen Livescu, Arun Babu, Alexis Conneau, Alexei Baevski, Michael Auli
Toward Joint Language Modeling for Speech Units and Text. EMNLP (Findings) (2023)
Jiachen Lian, Alexei Baevski, Wei-Ning Hsu, Michael Auli
AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations. CoRR (2023)
Karmesh Yadav, Arjun Majumdar, Ram Ramrakhya, Naoki Yokoyama, Alexei Baevski, Zsolt Kira, Oleksandr Maksymets, Dhruv Batra
OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNav. CoRR (2023)
Ramon Sanabria, Wei-Ning Hsu, Alexei Baevski, Michael Auli
Measuring the Impact of Domain Factors in Self-Supervised Pre-Training. ICASSP Workshops (2023)
Jiachen Lian, Alexei Baevski, Wei-Ning Hsu, Michael Auli
Av-Data2Vec: Self-Supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations. ASRU (2023)
Alexei Baevski, Arun Babu, Wei-Ning Hsu, Michael Auli
Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language. ICML (2023)
Alexander H. Liu, Wei-Ning Hsu, Michael Auli, Alexei Baevski
Towards End-to-End Unsupervised Speech Recognition. SLT (2022)
Anuroop Sriram, Michael Auli, Alexei Baevski
Wav2Vec-Aug: Improved self-supervised training with limited data. INTERSPEECH (2022)
Alexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu, Jiatao Gu, Michael Auli
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language. CoRR (2022)
Apoorv Vyas, Wei-Ning Hsu, Michael Auli, Alexei Baevski
On-demand compute reduction with stochastic wav2vec 2.0. INTERSPEECH (2022)
Po-Yao Huang, Hu Xu, Juncheng Li, Alexei Baevski, Michael Auli, Wojciech Galuba, Florian Metze, Christoph Feichtenhofer
Masked Autoencoders that Listen. CoRR (2022)
Alexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu, Jiatao Gu, Michael Auli
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language. ICML (2022)
Qiantong Xu, Alexei Baevski, Michael Auli
Simple and Effective Zero-shot Cross-lingual Phoneme Recognition. INTERSPEECH (2022)
Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick von Platen, Yatharth Saraf, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale. INTERSPEECH (2022)
Karmesh Yadav, Ram Ramrakhya, Arjun Majumdar, Vincent-Pierre Berges, Sachit Kuhar, Dhruv Batra, Alexei Baevski, Oleksandr Maksymets
Offline Visual Representation Learning for Embodied Navigation. CoRR (2022)
Derek Xu, Shuyan Dong, Changhan Wang, Suyoun Kim, Zhaojiang Lin, Akshat Shrivastava, Shang-Wen Li, Liang-Hsuan Tseng, Alexei Baevski, Guan-Ting Lin, Hung-yi Lee, Yizhou Sun, Wei Wang
Introducing Semantics into Speech Encoders. CoRR (2022)
Alexander H. Liu, Cheng-I Lai, Wei-Ning Hsu, Michael Auli, Alexei Baevski, James R. Glass
Simple and Effective Unsupervised Speech Synthesis. INTERSPEECH (2022)
Anuroop Sriram, Michael Auli, Alexei Baevski
Wav2Vec-Aug: Improved self-supervised training with limited data. CoRR (2022)
Alexander H. Liu, Wei-Ning Hsu, Michael Auli, Alexei Baevski
Towards End-to-end Unsupervised Speech Recognition. CoRR (2022)
Yun Tang, Hongyu Gong, Ning Dong, Changhan Wang, Wei-Ning Hsu, Jiatao Gu, Alexei Baevski, Xian Li, Abdelrahman Mohamed, Michael Auli, Juan Pino
Unified Speech-Text Pre-training for Speech Translation and Recognition. CoRR (2022)
Alexei Baevski, Arun Babu, Wei-Ning Hsu, Michael Auli
Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language. CoRR (2022)
Apoorv Vyas, Wei-Ning Hsu, Michael Auli, Alexei Baevski
On-demand compute reduction with stochastic wav2vec 2.0. CoRR (2022)
Yun Tang, Hongyu Gong, Ning Dong, Changhan Wang, Wei-Ning Hsu, Jiatao Gu, Alexei Baevski, Xian Li, Abdelrahman Mohamed, Michael Auli, Juan Pino
Unified Speech-Text Pre-training for Speech Translation and Recognition. ACL (1) (2022)
Alexander H. Liu, Cheng-I Jeff Lai, Wei-Ning Hsu, Michael Auli, Alexei Baevski, James R. Glass
Simple and Effective Unsupervised Speech Synthesis. CoRR (2022)
Ramon Sanabria, Wei-Ning Hsu, Alexei Baevski, Michael Auli
Measuring the Impact of Individual Domain Factors in Self-Supervised Pre-Training. CoRR (2022)
Andros Tjandra, Diptanu Gon Choudhury, Frank Zhang, Kritika Singh, Alexis Conneau, Alexei Baevski, Assaf Sela, Yatharth Saraf, Michael Auli
Improved Language Identification Through Cross-Lingual Self-Supervised Learning. ICASSP (2022)
Po-Yao Huang, Hu Xu, Juncheng Li, Alexei Baevski, Michael Auli, Wojciech Galuba, Florian Metze, Christoph Feichtenhofer
Masked Autoencoders that Listen. NeurIPS (2022)
Wei-Ning Hsu, Anuroop Sriram, Alexei Baevski, Tatiana Likhomanenko, Qiantong Xu, Vineel Pratap, Jacob Kahn, Ann Lee, Ronan Collobert, Gabriel Synnaeve, Michael Auli
Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training. CoRR (2021)
Qiantong Xu, Alexei Baevski, Tatiana Likhomanenko, Paden Tomasello, Alexis Conneau, Ronan Collobert, Gabriel Synnaeve, Michael Auli
Self-Training and Pre-Training are Complementary for Speech Recognition. ICASSP (2021)
Andros Tjandra, Diptanu Gon Choudhury, Frank Zhang, Kritika Singh, Alexei Baevski, Assaf Sela, Yatharth Saraf, Michael Auli
Improved Language Identification Through Cross-Lingual Self-Supervised Learning. CoRR (2021)
Changhan Wang, Anne Wu, Juan Miguel Pino, Alexei Baevski, Michael Auli, Alexis Conneau
Large-Scale Self- and Semi-Supervised Learning for Speech Translation. CoRR (2021)
Kushal Lakhotia, Evgeny Kharitonov, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Benjamin Bolte, Tu Anh Nguyen, Jade Copet, Alexei Baevski, Adelrahman Mohamed, Emmanuel Dupoux
Generative Spoken Language Modeling from Raw Audio. CoRR (2021)
Henry Zhou, Alexei Baevski, Michael Auli
A Comparison of Discrete Latent Variable Models for Speech Representation Learning. ICASSP (2021)
Xian Li, Changhan Wang, Yun Tang, Chau Tran, Yuqing Tang, Juan Miguel Pino, Alexei Baevski, Alexis Conneau, Michael Auli
Multilingual Speech Translation from Efficient Finetuning of Pretrained Models. ACL/IJCNLP (1) (2021)
Alexei Baevski, Wei-Ning Hsu, Alexis Conneau, Michael Auli
Unsupervised Speech Recognition. NeurIPS (2021)
Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick von Platen, Yatharth Saraf, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale. CoRR (2021)
Changhan Wang, Anne Wu, Juan Pino, Alexei Baevski, Michael Auli, Alexis Conneau
Large-Scale Self- and Semi-Supervised Learning for Speech Translation. Interspeech (2021)
Qiantong Xu, Alexei Baevski, Michael Auli
Simple and Effective Zero-shot Cross-lingual Phoneme Recognition. CoRR (2021)
Wei-Ning Hsu, Anuroop Sriram, Alexei Baevski, Tatiana Likhomanenko, Qiantong Xu, Vineel Pratap, Jacob Kahn, Ann Lee, Ronan Collobert, Gabriel Synnaeve, Michael Auli
Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training. Interspeech (2021)
Alexei Baevski, Wei-Ning Hsu, Alexis Conneau, Michael Auli
Unsupervised Speech Recognition. CoRR (2021)
Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela
Reservoir Transformers. ACL/IJCNLP (1) (2021)
Alexis Conneau, Alexei Baevski, Ronan Collobert, Abdelrahman Mohamed, Michael Auli
Unsupervised Cross-Lingual Representation Learning for Speech Recognition. Interspeech (2021)
Alexei Baevski, Abdelrahman Mohamed
Effectiveness of Self-Supervised Pre-Training for ASR. ICASSP (2020)
Qiantong Xu, Alexei Baevski, Tatiana Likhomanenko, Paden Tomasello, Alexis Conneau, Ronan Collobert, Gabriel Synnaeve, Michael Auli
Self-training and Pre-training are Complementary for Speech Recognition. CoRR (2020)
Alexei Baevski, Steffen Schneider, Michael Auli
vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations. ICLR (2020)
Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, Michael Auli
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations. CoRR (2020)
Henry Zhou, Alexei Baevski, Michael Auli
A Comparison of Discrete Latent Variable Models for Speech Representation Learning. CoRR (2020)
Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela
Reservoir Transformer. CoRR (2020)
Tu Anh Nguyen, Maureen de Seyssel, Patricia Rozé, Morgane Rivière, Evgeny Kharitonov, Alexei Baevski, Ewan Dunbar, Emmanuel Dupoux
The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling. CoRR (2020)
Alexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, Michael Auli
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations. NeurIPS (2020)
Alexis Conneau, Alexei Baevski, Ronan Collobert, Abdelrahman Mohamed, Michael Auli
Unsupervised Cross-lingual Representation Learning for Speech Recognition. CoRR (2020)
Steffen Schneider, Alexei Baevski, Ronan Collobert, Michael Auli
wav2vec: Unsupervised Pre-Training for Speech Recognition. INTERSPEECH (2019)
Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli
Cloze-driven Pretraining of Self-attention Networks. CoRR (2019)
Nathan Ng, Kyra Yee, Alexei Baevski, Myle Ott, Michael Auli, Sergey Edunov
Facebook FAIR's WMT19 News Translation Task Submission. CoRR (2019)
Nathan Ng, Kyra Yee, Alexei Baevski, Myle Ott, Michael Auli, Sergey Edunov
Facebook FAIR's WMT19 News Translation Task Submission. WMT (2) (2019)
Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli
Cloze-driven Pretraining of Self-attention Networks. EMNLP/IJCNLP (1) (2019)
Alexei Baevski, Michael Auli, Abdelrahman Mohamed
Effectiveness of self-supervised pre-training for speech recognition. CoRR (2019)
Felix Wu, Angela Fan, Alexei Baevski, Yann N. Dauphin, Michael Auli
Pay Less Attention with Lightweight and Dynamic Convolutions. ICLR (2019)
Sergey Edunov, Alexei Baevski, Michael Auli
Pre-trained language model representations for language generation. NAACL-HLT (1) (2019)
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli
fairseq: A Fast, Extensible Toolkit for Sequence Modeling. NAACL-HLT (Demonstrations) (2019)
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli
fairseq: A Fast, Extensible Toolkit for Sequence Modeling. CoRR (2019)
Steffen Schneider, Alexei Baevski, Ronan Collobert, Michael Auli
wav2vec: Unsupervised Pre-training for Speech Recognition. CoRR (2019)
Alexei Baevski, Steffen Schneider, Michael Auli
vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations. CoRR (2019)
Alexei Baevski, Michael Auli
Adaptive Input Representations for Neural Language Modeling. ICLR (Poster) (2019)
Sergey Edunov, Alexei Baevski, Michael Auli
Pre-trained Language Model Representations for Language Generation. CoRR (2019)
Felix Wu, Angela Fan, Alexei Baevski, Yann N. Dauphin, Michael Auli
Pay Less Attention with Lightweight and Dynamic Convolutions. CoRR (2019)
Alexei Baevski, Michael Auli
Adaptive Input Representations for Neural Language Modeling. CoRR (2018)