Siddharth Dalmia

Publication Activity (10 Years)

Years Active: 2015-2024
Publications (10 Years): 68

Top Topics

Speech Recognition

Annotation Tool

Spoken Language

Top Venues

Publications

Rachit Bansal, Bidisha Samanta, Siddharth Dalmia, Nitish Gupta, Sriram Ganapathy, Abhishek Bapna, Prateek Jain, Partha Talukdar
LLM Augmented LLMs: Expanding Capabilities through Composition. ICLR (2024)
Jinhyuk Lee, Anthony Chen, Zhuyun Dai, Dheeru Dua, Devendra Singh Sachan, Michael Boratko, Yi Luan, Sébastien M. R. Arnold, Vincent Perot, Siddharth Dalmia, Hexiang Hu, Xudong Lin, Panupong Pasupat, Aida Amini, Jeremy R. Cole, Sebastian Riedel, Iftekhar Naim, Ming-Wei Chang, Kelvin Guu
Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More? CoRR (2024)
Rachit Bansal, Bidisha Samanta, Siddharth Dalmia, Nitish Gupta, Shikhar Vashishth, Sriram Ganapathy, Abhishek Bapna, Prateek Jain, Partha Talukdar
LLM Augmented LLMs: Expanding Capabilities through Composition. CoRR (2024)
Shikhar Bharadwaj, Min Ma, Shikhar Vashishth, Ankur Bapna, Sriram Ganapathy, Vera Axelrod, Siddharth Dalmia, Wei Han, Yu Zhang, Daan van Esch, Sandy Ritchie, Partha Talukdar, Jason Riesa
Multimodal Modeling for Spoken Language Identification. ICASSP (2024)
Frank Palma Gomez, Ramon Sanabria, Yun-Hsuan Sung, Daniel Cer, Siddharth Dalmia, Gustavo Hernández Ábrego
Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systems. CoRR (2024)
Brian Yan, Siddharth Dalmia, Yosuke Higuchi, Graham Neubig, Florian Metze, Alan W. Black, Shinji Watanabe
CTC Alignments Improve Autoregressive Translation. EACL (2023)
Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed
LegoNN: Building Modular Encoder-Decoder Models. IEEE ACM Trans. Audio Speech Lang. Process. 31 (2023)
Brian Yan, Jiatong Shi, Yun Tang, Hirofumi Inaguma, Yifan Peng, Siddharth Dalmia, Peter Polak, Patrick Fernandes, Dan Berrebbi, Tomoki Hayashi, Xiaohui Zhang, Zhaoheng Ni, Moto Hira, Soumi Maiti, Juan Pino, Shinji Watanabe
ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit. ACL (demo) (2023)
Motoi Omachi, Brian Yan, Siddharth Dalmia, Yuya Fujita, Shinji Watanabe
Align, Write, Re-Order: Explainable End-to-End Speech Translation via Operation Sequence Generation. ICASSP (2023)
Shikhar Bharadwaj, Min Ma, Shikhar Vashishth, Ankur Bapna, Sriram Ganapathy, Vera Axelrod, Siddharth Dalmia, Wei Han, Yu Zhang, Daan van Esch, Sandy Ritchie, Partha Talukdar, Jason Riesa
Multimodal Modeling For Spoken Language Identification. CoRR (2023)
Brian Yan, Jiatong Shi, Yun Tang, Hirofumi Inaguma, Yifan Peng, Siddharth Dalmia, Peter Polák, Patrick Fernandes, Dan Berrebbi, Tomoki Hayashi, Xiaohui Zhang, Zhaoheng Ni, Moto Hira, Soumi Maiti, Juan Pino, Shinji Watanabe
ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit. CoRR (2023)
Siddhant Arora, Siddharth Dalmia, Xuankai Chang, Brian Yan, Alan W. Black, Shinji Watanabe
Two-Pass Low Latency End-to-End Spoken Language Understanding. INTERSPEECH (2022)
Yifan Peng, Siddharth Dalmia, Ian R. Lane, Shinji Watanabe
Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understanding. CoRR (2022)
Brian Yan, Patrick Fernandes, Siddharth Dalmia, Jiatong Shi, Yifan Peng, Dan Berrebbi, Xinyi Wang, Graham Neubig, Shinji Watanabe
CMU's IWSLT 2022 Dialect Speech Translation System. IWSLT@ACL (2022)
Yifan Peng, Siddharth Dalmia, Ian R. Lane, Shinji Watanabe
Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understanding. ICML (2022)
Yifan Peng, Siddhant Arora, Yosuke Higuchi, Yushi Ueda, Sujay Kumar, Karthik Ganesan, Siddharth Dalmia, Xuankai Chang, Shinji Watanabe
A Study on the Integration of Pre-trained SSL, ASR, LM and SLU Models for Spoken Language Understanding. CoRR (2022)
Motoi Omachi, Brian Yan, Siddharth Dalmia, Yuya Fujita, Shinji Watanabe
Align, Write, Re-order: Explainable End-to-End Speech Translation via Operation Sequence Generation. CoRR (2022)
Yifan Peng, Siddhant Arora, Yosuke Higuchi, Yushi Ueda, Sujay Kumar, Karthik Ganesan, Siddharth Dalmia, Xuankai Chang, Shinji Watanabe
A Study on the Integration of Pre-Trained SSL, ASR, LM and SLU Models for Spoken Language Understanding. SLT (2022)
Alexis Conneau, Min Ma, Simran Khanuja, Yu Zhang, Vera Axelrod, Siddharth Dalmia, Jason Riesa, Clara Rivera, Ankur Bapna
FLEURS: Few-shot Learning Evaluation of Universal Representations of Speech. CoRR (2022)
Siddhant Arora, Siddharth Dalmia, Pavel Denisov, Xuankai Chang, Yushi Ueda, Yifan Peng, Yuekai Zhang, Sujay Kumar, Karthik Ganesan, Brian Yan, Ngoc Thang Vu, Alan W. Black, Shinji Watanabe
ESPnet-SLU: Advancing Spoken Language Understanding Through ESPnet. ICASSP (2022)
Siddhant Arora, Siddharth Dalmia, Xuankai Chang, Brian Yan, Alan W. Black, Shinji Watanabe
Two-Pass Low Latency End-to-End Spoken Language Understanding. CoRR (2022)
Brian Yan, Siddharth Dalmia, Yosuke Higuchi, Graham Neubig, Florian Metze, Alan W. Black, Shinji Watanabe
CTC Alignments Improve Autoregressive Translation. CoRR (2022)
Brian Yan, Chunlei Zhang, Meng Yu, Shi-Xiong Zhang, Siddharth Dalmia, Dan Berrebbi, Chao Weng, Shinji Watanabe, Dong Yu
Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorization. ICASSP (2022)
Siddhant Arora, Siddharth Dalmia, Brian Yan, Florian Metze, Alan W. Black, Shinji Watanabe
Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models. EMNLP (Findings) (2022)
Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed
LegoNN: Building Modular Encoder-Decoder Models. CoRR (2022)
Siddhant Arora, Siddharth Dalmia, Brian Yan, Florian Metze, Alan W. Black, Shinji Watanabe
Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models. CoRR (2022)
Alexis Conneau, Min Ma, Simran Khanuja, Yu Zhang, Vera Axelrod, Siddharth Dalmia, Jason Riesa, Clara Rivera, Ankur Bapna
FLEURS: FEW-Shot Learning Evaluation of Universal Representations of Speech. SLT (2022)
Brian Yan, Siddharth Dalmia, David R. Mortensen, Florian Metze, Shinji Watanabe
Differentiable Allophone Graphs for Language-Universal Speech Recognition. Interspeech (2021)
Siddhant Arora, Alissa Ostapenko, Vijay Viswanathan, Siddharth Dalmia, Florian Metze, Shinji Watanabe, Alan W. Black
Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding. Interspeech (2021)
Hirofumi Inaguma, Siddharth Dalmia, Brian Yan, Shinji Watanabe
Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediates. ASRU (2021)
Brian Yan, Chunlei Zhang, Meng Yu, Shi-Xiong Zhang, Siddharth Dalmia, Dan Berrebbi, Chao Weng, Shinji Watanabe, Dong Yu
Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorization. CoRR (2021)
Hirofumi Inaguma, Brian Yan, Siddharth Dalmia, Pengcheng Guo, Jiatong Shi, Kevin Duh, Shinji Watanabe
ESPnet-ST IWSLT 2021 Offline Speech Translation System. CoRR (2021)
Siddharth Dalmia, Yuzong Liu, Srikanth Ronanki, Katrin Kirchhoff
Transformer-Transducers for Code-Switched Speech Recognition. ICASSP (2021)
Siddharth Dalmia, Brian Yan, Vikas Raunak, Florian Metze, Shinji Watanabe
Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks. NAACL-HLT (2021)
Abhilasha Ravichander, Siddharth Dalmia, Maria Ryskina, Florian Metze, Eduard H. Hovy, Alan W. Black
NoiseQA: Challenge Set Evaluation for User-Centric Question Answering. CoRR (2021)
Siddhant Arora, Alissa Ostapenko, Vijay Viswanathan, Siddharth Dalmia, Florian Metze, Shinji Watanabe, Alan W. Black
Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding. CoRR (2021)
Hirofumi Inaguma, Siddharth Dalmia, Brian Yan, Shinji Watanabe
Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediates. CoRR (2021)
Siddharth Dalmia, Brian Yan, Vikas Raunak, Florian Metze, Shinji Watanabe
Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks. CoRR (2021)
Abhilasha Ravichander, Siddharth Dalmia, Maria Ryskina, Florian Metze, Eduard H. Hovy, Alan W. Black
NoiseQA: Challenge Set Evaluation for User-Centric Question Answering. EACL (2021)
Hirofumi Inaguma, Brian Yan, Siddharth Dalmia, Pengcheng Guo, Jiatong Shi, Kevin Duh, Shinji Watanabe
ESPnet-ST IWSLT 2021 Offline Speech Translation System. IWSLT (2021)
Siddhant Arora, Siddharth Dalmia, Pavel Denisov, Xuankai Chang, Yushi Ueda, Yifan Peng, Yuekai Zhang, Sujay Kumar, Karthik Ganesan, Brian Yan, Ngoc Thang Vu, Alan W. Black, Shinji Watanabe
ESPnet-SLU: Advancing Spoken Language Understanding through ESPnet. CoRR (2021)
Brian Yan, Siddharth Dalmia, David R. Mortensen, Florian Metze, Shinji Watanabe
Differentiable Allophone Graphs for Language-Universal Speech Recognition. CoRR (2021)
Vikas Raunak, Siddharth Dalmia, Vivek Gupta, Florian Metze
On Long-Tailed Phenomena in Neural Machine Translation. EMNLP (Findings) (2020)
Xinjian Li, Siddharth Dalmia, Juncheng Li, Matthew Lee, Patrick Littell, Jiali Yao, Antonios Anastasopoulos, David R. Mortensen, Graham Neubig, Alan W. Black, Florian Metze
Universal Phone Recognition with a Multilingual Allophone System. CoRR (2020)
Xinjian Li, Siddharth Dalmia, Juncheng Li, Matthew Lee, Patrick Littell, Jiali Yao, Antonios Anastasopoulos, David R. Mortensen, Graham Neubig, Alan W. Black, Florian Metze
Universal Phone Recognition with a Multilingual Allophone System. ICASSP (2020)
Xinjian Li, Siddharth Dalmia, David R. Mortensen, Juncheng Li, Alan W. Black, Florian Metze
Towards Zero-Shot Learning for Automatic Phonemic Transcription. AAAI (2020)
Siddharth Dalmia, Yuzong Liu, Srikanth Ronanki, Katrin Kirchhoff
Transformer-Transducers for Code-Switched Speech Recognition. CoRR (2020)
Vikas Raunak, Siddharth Dalmia, Vivek Gupta, Florian Metze
On Long-Tailed Phenomena in Neural Machine Translation. CoRR (2020)
Xinjian Li, Siddharth Dalmia, David R. Mortensen, Juncheng Li, Alan W. Black, Florian Metze
Towards Zero-shot Learning for Automatic Phonemic Transcription. CoRR (2020)
Xinjian Li, Zhong Zhou, Siddharth Dalmia, Alan W. Black, Florian Metze
SANTLR: Speech Annotation Toolkit for Low Resource Languages. INTERSPEECH (2019)
Suyoun Kim, Siddharth Dalmia, Florian Metze
Cross-Attention End-to-End ASR for Two-Party Conversations. INTERSPEECH (2019)
Suyoun Kim, Siddharth Dalmia, Florian Metze
Gated Embeddings in End-to-End Speech Recognition for Conversational-Context Fusion. CoRR (2019)
Xinjian Li, Siddharth Dalmia, Alan W. Black, Florian Metze
Multilingual Speech Recognition with Corpus Relatedness Sampling. INTERSPEECH (2019)
Siddharth Dalmia, Xinjian Li, Alan W. Black, Florian Metze
Phoneme Level Language Models for Sequence Based Low Resource ASR. CoRR (2019)
Xinjian Li, Zhong Zhou, Siddharth Dalmia, Alan W. Black, Florian Metze
SANTLR: Speech Annotation Toolkit for Low Resource Languages. CoRR (2019)
Siddharth Dalmia, Abdelrahman Mohamed, Mike Lewis, Florian Metze, Luke Zettlemoyer
Enforcing Encoder-Decoder Modularity in Sequence-to-Sequence Models. CoRR (2019)
Xinjian Li, Siddharth Dalmia, Alan W. Black, Florian Metze
Multilingual Speech Recognition with Corpus Relatedness Sampling. CoRR (2019)
Suyoun Kim, Siddharth Dalmia, Florian Metze
Cross-Attention End-to-End ASR for Two-Party Conversations. CoRR (2019)
Siddharth Dalmia, Xinjian Li, Alan W. Black, Florian Metze
Phoneme Level Language Models for Sequence Based Low Resource ASR. ICASSP (2019)
Suyoun Kim, Siddharth Dalmia, Florian Metze
Gated Embeddings in End-to-End Speech Recognition for Conversational-Context Fusion. ACL (1) (2019)
Aditi Chaudhary, Siddharth Dalmia, Junjie Hu, Xinjian Li, Austin Matthews, Aldrian Obaja Muis, Naoki Otani, Shruti Rijhwani, Zaid Sheikh, Nidhi Vyas, Xinyi Wang, Jiateng Xie, Ruochen Xu, Chunting Zhou, Peter J. Jansen, Yiming Yang, Lori S. Levin, Florian Metze, Teruko Mitamura, David R. Mortensen, Graham Neubig, Eduard H. Hovy, Alan W. Black, Jaime G. Carbonell, Graham Horwood, Shabnam Tafreshi, Mona T. Diab, Efsun Sarioglu, Noura Farra, Kathleen R. McKeown
The ARIEL-CMU Systems for LoReHLT18. CoRR (2019)
Siddharth Dalmia, Ramon Sanabria, Florian Metze, Alan W. Black
Sequence-Based Multi-Lingual Low Resource Speech Recognition. ICASSP (2018)
Siddharth Dalmia, Xinjian Li, Florian Metze, Alan W. Black
Domain Robust Feature Extraction for Rapid Low Resource ASR Development. CoRR (2018)
Siddharth Dalmia, Ramon Sanabria, Florian Metze, Alan W. Black
Sequence-based Multi-lingual Low Resource Speech Recognition. CoRR (2018)
Siddharth Dalmia, Xinjian Li, Florian Metze, Alan W. Black
Domain Robust Feature Extraction for Rapid Low Resource ASR Development. SLT (2018)
David R. Mortensen, Siddharth Dalmia, Patrick Littell
Epitran: Precision G2P for Many Languages. LREC (2018)
Prafulla Kalapatapu, N. N. Tejas, Siddharth Dalmia, Prakhar Gupta, Bhaswant Inguva, Aruna Malapati
A novel similarity measure: Voronoi audio similarity for genre classification. Int. J. Intell. Syst. Technol. Appl. 16 (4) (2017)
Benjamin Elizalde, Ankit Shah, Siddharth Dalmia, Min Hun Lee, Rohan Badlani, Anurag Kumar, Bhiksha Raj, Ian R. Lane
An approach for self-training audio event detectors using web data. EUSIPCO (2017)
Sunit Sivasankaran, Aditya Arie Nugraha, Emmanuel Vincent, Juan Andres Morales-Cordovilla, Siddharth Dalmia, Irina Illina, Antoine Liutkus
Robust ASR using neural network based speech enhancement and feature simulation. ASRU (2015)