Florian Metze

ORCID

Publication Activity (10 Years)

Years Active: 1996-2024
Publications (10 Years): 186

Top Venues

Karlsruhe Institute of Technology, Germany (PHD)

Education History

Karlsruhe Institute of Technology, Germany

PHD

Publications

Jackson Michaels, Juncheng B. Li, Laura Yao, Lijun Yu, Zach Wood-Doughty, Florian Metze
Audio-Journey: Open Domain Latent Diffusion Based Text-To-Audio Generation. ICASSP (2024)
Brian Yan, Siddharth Dalmia, Yosuke Higuchi, Graham Neubig, Florian Metze, Alan W. Black, Shinji Watanabe
CTC Alignments Improve Autoregressive Translation. EACL (2023)
Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed
LegoNN: Building Modular Encoder-Decoder Models. IEEE ACM Trans. Audio Speech Lang. Process. 31 (2023)
Yookoon Park, Mahmoud Azab, Seungwhan Moon, Bo Xiong, Florian Metze, Gourab Kundu, Kirmani Ahmed
Normalized Contrastive Learning for Text-Video Retrieval. EMNLP (2022)
Roshan Sharma, Shruti Palaskar, Alan W. Black, Florian Metze
End-to-End Speech Summarization Using Restricted Self-Attention. ICASSP (2022)
Xinjian Li, Florian Metze, David R. Mortensen, Alan W. Black, Shinji Watanabe
ASR2K: Speech Recognition for Around 2000 Languages without Audio. INTERSPEECH (2022)
Juncheng Li, Shuhui Qu, Po-Yao Huang, Florian Metze
AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification. INTERSPEECH (2022)
Yookoon Park, Mahmoud Azab, Bo Xiong, Seungwhan Moon, Florian Metze, Gourab Kundu, Kirmani Ahmed
Normalized Contrastive Learning for Text-Video Retrieval. CoRR (2022)
Po-Yao Huang, Hu Xu, Juncheng Li, Alexei Baevski, Michael Auli, Wojciech Galuba, Florian Metze, Christoph Feichtenhofer
Masked Autoencoders that Listen. CoRR (2022)
Juncheng B. Li, Shuhui Qu, Xinjian Li, Po-Yao Huang, Florian Metze
On Adversarial Robustness of Large-scale Audio Visual Learning. CoRR (2022)
Shruti Palaskar, Akshita Bhagia, Yonatan Bisk, Florian Metze, Alan W. Black, Ana Marasovic
On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization. EMNLP (Findings) (2022)
Juncheng B. Li, Shuhui Qu, Xinjian Li, Bernie Po-Yao Huang, Florian Metze
On Adversarial Robustness Of Large-Scale Audio Visual Learning. ICASSP (2022)
Xinjian Li, Florian Metze, David R. Mortensen, Alan W. Black, Shinji Watanabe
Phone Inventories and Recognition for Every Language. LREC (2022)
Juncheng B. Li, Shuhui Qu, Po-Yao Huang, Florian Metze
AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification. CoRR (2022)
Shruti Palaskar, Akshita Bhagia, Yonatan Bisk, Florian Metze, Alan W. Black, Ana Marasovic
On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization. CoRR (2022)
Brian Yan, Siddharth Dalmia, Yosuke Higuchi, Graham Neubig, Florian Metze, Alan W. Black, Shinji Watanabe
CTC Alignments Improve Autoregressive Translation. CoRR (2022)
Xinjian Li, Florian Metze, David Mortensen, Shinji Watanabe, Alan W. Black
Zero-shot Learning for Grapheme to Phoneme Conversion with Language Ensemble. ACL (Findings) (2022)
Siddhant Arora, Siddharth Dalmia, Brian Yan, Florian Metze, Alan W. Black, Shinji Watanabe
Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models. EMNLP (Findings) (2022)
Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed
LegoNN: Building Modular Encoder-Decoder Models. CoRR (2022)
Zheng Wang, Juncheng B. Li, Shuhui Qu, Florian Metze, Emma Strubell
Error-aware Quantization through Noise Tempering. CoRR (2022)
Triantafyllos Afouras, Yuki M. Asano, Francois Fagan, Andrea Vedaldi, Florian Metze
Self-supervised object detection from audio-visual correspondence. CVPR (2022)
Siddhant Arora, Siddharth Dalmia, Brian Yan, Florian Metze, Alan W. Black, Shinji Watanabe
Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models. CoRR (2022)
Zheng Wang, Juncheng B. Li, Shuhui Qu, Florian Metze, Emma Strubell
SQuAT: Sharpness- and Quantization-Aware Training for BERT. CoRR (2022)
Juncheng B. Li, Shuhui Qu, Florian Metze
Robustness of Neural Architectures for Audio Event Detection. CoRR (2022)
Po-Yao Huang, Hu Xu, Juncheng Li, Alexei Baevski, Michael Auli, Wojciech Galuba, Florian Metze, Christoph Feichtenhofer
Masked Autoencoders that Listen. NeurIPS (2022)
Xinjian Li, Florian Metze, David R. Mortensen, Alan W. Black, Shinji Watanabe
ASR2K: Speech Recognition for Around 2000 Languages without Audio. CoRR (2022)
Mandela Patrick, Dylan Campbell, Yuki M. Asano, Ishan Misra, Florian Metze, Christoph Feichtenhofer, Andrea Vedaldi, João F. Henriques
Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers. NeurIPS (2021)
Amanda Cardoso Duarte, Shruti Palaskar, Lucas Ventura, Deepti Ghadiyaram, Kenneth DeHaan, Florian Metze, Jordi Torres, Xavier Giró-i-Nieto
How2Sign: A Large-Scale Multimodal Dataset for Continuous American Sign Language. CVPR (2021)
Hu Xu, Gargi Ghosh, Po-Yao Huang, Prahal Arora, Masoumeh Aminzadeh, Christoph Feichtenhofer, Florian Metze, Luke Zettlemoyer
VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding. CoRR (2021)
Brian Yan, Siddharth Dalmia, David R. Mortensen, Florian Metze, Shinji Watanabe
Differentiable Allophone Graphs for Language-Universal Speech Recognition. Interspeech (2021)
Siddhant Arora, Alissa Ostapenko, Vijay Viswanathan, Siddharth Dalmia, Florian Metze, Shinji Watanabe, Alan W. Black
Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding. Interspeech (2021)
Roshan Sharma, Shruti Palaskar, Alan W. Black, Florian Metze
Speech Summarization using Restricted Self-Attention. CoRR (2021)
Mandela Patrick, Po-Yao Huang, Yuki Markus Asano, Florian Metze, Alexander G. Hauptmann, João F. Henriques, Andrea Vedaldi
Support-set bottlenecks for video-text representation learning. ICLR (2021)
Xinjian Li, Juncheng Li, Jiali Yao, Alan W. Black, Florian Metze
Phone Distribution Estimation for Low Resource Languages. ICASSP (2021)
Juncheng B. Li, Kaixin Ma, Shuhui Qu, Po-Yao Huang, Florian Metze
Audio-Visual Event Recognition Through the Lens of Adversary. ICASSP (2021)
Siddharth Dalmia, Brian Yan, Vikas Raunak, Florian Metze, Shinji Watanabe
Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks. NAACL-HLT (2021)
Abhilasha Ravichander, Siddharth Dalmia, Maria Ryskina, Florian Metze, Eduard H. Hovy, Alan W. Black
NoiseQA: Challenge Set Evaluation for User-Centric Question Answering. CoRR (2021)
Siddhant Arora, Alissa Ostapenko, Vijay Viswanathan, Siddharth Dalmia, Florian Metze, Shinji Watanabe, Alan W. Black
Rethinking End-to-End Evaluation of Decomposable Tasks: A Case Study on Spoken Language Understanding. CoRR (2021)
Hu Xu, Gargi Ghosh, Po-Yao Huang, Dmytro Okhonko, Armen Aghajanyan, Florian Metze, Luke Zettlemoyer, Christoph Feichtenhofer
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding. EMNLP (1) (2021)
Triantafyllos Afouras, Yuki Markus Asano, Francois Fagan, Andrea Vedaldi, Florian Metze
Self-supervised object detection from audio-visual correspondence. CoRR (2021)
Hu Xu, Gargi Ghosh, Po-Yao Huang, Dmytro Okhonko, Armen Aghajanyan, Florian Metze, Luke Zettlemoyer, Christoph Feichtenhofer
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding. CoRR (2021)
Mandela Patrick, Po-Yao Huang, Ishan Misra, Florian Metze, Andrea Vedaldi, Yuki M. Asano, João F. Henriques
Space-Time Crop & Attend: Improving Cross-modal Video Representation Learning. ICCV (2021)
Mandela Patrick, Yuki Markus Asano, Bernie Huang, Ishan Misra, Florian Metze, João F. Henriques, Andrea Vedaldi
Space-Time Crop & Attend: Improving Cross-modal Video Representation Learning. CoRR (2021)
Siddharth Dalmia, Brian Yan, Vikas Raunak, Florian Metze, Shinji Watanabe
Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks. CoRR (2021)
Shruti Palaskar, Ruslan Salakhutdinov, Alan W. Black, Florian Metze
Multimodal Speech Summarization Through Semantic Concept Learning. Interspeech (2021)
Abhilasha Ravichander, Siddharth Dalmia, Maria Ryskina, Florian Metze, Eduard H. Hovy, Alan W. Black
NoiseQA: Challenge Set Evaluation for User-Centric Question Answering. EACL (2021)
Xinjian Li, Juncheng Li, Florian Metze, Alan W. Black
Hierarchical Phone Recognition with Compositional Phonetics. Interspeech (2021)
Xinjian Li, David R. Mortensen, Florian Metze, Alan W. Black
Multilingual Phonetic Dataset for Low Resource Speech Recognition. ICASSP (2021)
Brian Yan, Siddharth Dalmia, David R. Mortensen, Florian Metze, Shinji Watanabe
Differentiable Allophone Graphs for Language-Universal Speech Recognition. CoRR (2021)
Hu Xu, Gargi Ghosh, Po-Yao Huang, Prahal Arora, Masoumeh Aminzadeh, Christoph Feichtenhofer, Florian Metze, Luke Zettlemoyer
VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding. ACL/IJCNLP (Findings) (2021)
Po-Yao Huang, Mandela Patrick, Junjie Hu, Graham Neubig, Florian Metze, Alexander G. Hauptmann
Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models. CoRR (2021)
Poyao Huang, Mandela Patrick, Junjie Hu, Graham Neubig, Florian Metze, Alex Hauptmann
Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models. NAACL-HLT (2021)
Mandela Patrick, Dylan Campbell, Yuki Markus Asano, Ishan Misra, Florian Metze, Christoph Feichtenhofer, Andrea Vedaldi, João F. Henriques
Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers. CoRR (2021)
Anirudh Mani, Shruti Palaskar, Nimshi Venkat Meripo, Sandeep Konam, Florian Metze
ASR Error Correction and Domain Adaptation Using Machine Translation. ICASSP (2020)
Lucia Specia, Loïc Barrault, Ozan Caglayan, Amanda Cardoso Duarte, Desmond Elliott, Spandana Gella, Nils Holzenberger, Chiraag Lala, Sun Jae Lee, Jindrich Libovický, Pranava Madhyastha, Florian Metze, Karl Mulligan, Alissa Ostapenko, Shruti Palaskar, Ramon Sanabria, Josiah Wang, Raman Arora
Grounded Sequence to Sequence Transduction. IEEE J. Sel. Top. Signal Process. 14 (3) (2020)
Tejas Srinivasan, Ramon Sanabria, Florian Metze, Desmond Elliott
Multimodal Speech Recognition with Unstructured Audio Masking. CoRR (2020)
Vikas Raunak, Siddharth Dalmia, Vivek Gupta, Florian Metze
On Long-Tailed Phenomena in Neural Machine Translation. EMNLP (Findings) (2020)
Juncheng B. Li, Kaixin Ma, Shuhui Qu, Po-Yao Huang, Florian Metze
Audio-Visual Event Recognition through the lens of Adversary. CoRR (2020)
Zimeng Qiu, Yiyuan Li, Xinjian Li, Florian Metze, William M. Campbell
Towards Context-Aware End-to-End Code-Switching Speech Recognition. INTERSPEECH (2020)
Fengquan Dong, Kun Qian, Zhao Ren, Alice Baird, Xinjian Li, Zhenyu Dai, Bo Dong, Florian Metze, Yoshiharu Yamamoto, Björn W. Schuller
Machine Listening for Heart Status Monitoring: Introducing and Benchmarking HSS - The Heart Sounds Shenzhen Corpus. IEEE J. Biomed. Health Informatics 24 (7) (2020)
Xinjian Li, Siddharth Dalmia, Juncheng Li, Matthew Lee, Patrick Littell, Jiali Yao, Antonios Anastasopoulos, David R. Mortensen, Graham Neubig, Alan W. Black, Florian Metze
Universal Phone Recognition with a Multilingual Allophone System. CoRR (2020)
Tejas Srinivasan, Ramon Sanabria, Florian Metze, Desmond Elliott
Fine-Grained Grounding for Multimodal Speech Recognition. EMNLP (Findings) (2020)
Xinjian Li, Siddharth Dalmia, Juncheng Li, Matthew Lee, Patrick Littell, Jiali Yao, Antonios Anastasopoulos, David R. Mortensen, Graham Neubig, Alan W. Black, Florian Metze
Universal Phone Recognition with a Multilingual Allophone System. ICASSP (2020)
Zhong Zhou, Isak Czeresnia Etinger, Florian Metze, Alexander G. Hauptmann, Alexander H. Waibel
Gun Source and Muzzle Head Detection. CoRR (2020)
David R. Mortensen, Xinjian Li, Patrick Littell, Alexis Michaud, Shruti Rijhwani, Antonios Anastasopoulos, Alan W. Black, Florian Metze, Graham Neubig
AlloVera: A Multilingual Allophone Database. CoRR (2020)
Tejas Srinivasan, Ramon Sanabria, Florian Metze
Looking Enhances Listening: Recovering Missing Speech Using Images. ICASSP (2020)
Amanda Cardoso Duarte, Shruti Palaskar, Deepti Ghadiyaram, Kenneth DeHaan, Florian Metze, Jordi Torres, Xavier Giró-i-Nieto
How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language. CoRR (2020)
Mahaveer Jain, Gil Keren, Jay Mahadeokar, Geoffrey Zweig, Florian Metze, Yatharth Saraf
Contextual RNN-T for Open Domain ASR. INTERSPEECH (2020)
Shruti Palaskar, Ramon Sanabria, Florian Metze
Transfer learning for multimodal dialog. Comput. Speech Lang. 64 (2020)
Anirudh Mani, Shruti Palaskar, Nimshi Venkat Meripo, Sandeep Konam, Florian Metze
ASR Error Correction and Domain Adaptation Using Machine Translation. CoRR (2020)
Xinjian Li, Siddharth Dalmia, David R. Mortensen, Juncheng Li, Alan W. Black, Florian Metze
Towards Zero-Shot Learning for Automatic Phonemic Transcription. AAAI (2020)
Odette Scharenborg, Lucas Ondel, Shruti Palaskar, Philip Arthur, Francesco Ciannella, Mingxing Du, Elin Larsen, Danny Merkx, Rachid Riad, Liming Wang, Emmanuel Dupoux, Laurent Besacier, Alan W. Black, Mark Hasegawa-Johnson, Florian Metze, Graham Neubig, Sebastian Stüker, Pierre Godard, Markus Müller
Speech Technology for Unwritten Languages. IEEE ACM Trans. Audio Speech Lang. Process. 28 (2020)
Mandela Patrick, Po-Yao Huang, Yuki Markus Asano, Florian Metze, Alexander G. Hauptmann, João F. Henriques, Andrea Vedaldi
Support-set bottlenecks for video-text representation learning. CoRR (2020)
Ze Cheng, Juncheng Li, Chenxu Wang, Jixuan Gu, Hao Xu, Xinjian Li, Florian Metze
Revisiting Factorizing Aggregated Posterior in Learning Disentangled Representations. CoRR (2020)
Vikas Raunak, Siddharth Dalmia, Vivek Gupta, Florian Metze
On Long-Tailed Phenomena in Neural Machine Translation. CoRR (2020)
Zhong Zhou, Isak Czeresnia Etinger, Florian Metze, Alexander Hauptmann, Alexander Waibel
Gun Source and Muzzle Head Detection. IMAWM (2020)
Tejas Srinivasan, Ramon Sanabria, Florian Metze
Looking Enhances Listening: Recovering Missing Speech Using Images. CoRR (2020)
Tejas Srinivasan, Ramon Sanabria, Florian Metze, Desmond Elliott
Fine-Grained Grounding for Multimodal Speech Recognition. CoRR (2020)
David R. Mortensen, Xinjian Li, Patrick Littell, Alexis Michaud, Shruti Rijhwani, Antonios Anastasopoulos, Alan W. Black, Florian Metze, Graham Neubig
AlloVera: A Multilingual Allophone Database. LREC (2020)
Xinjian Li, Siddharth Dalmia, David R. Mortensen, Juncheng Li, Alan W. Black, Florian Metze
Towards Zero-shot Learning for Automatic Phonemic Transcription. CoRR (2020)
Vikas Raunak, Vaibhav Kumar, Vivek Gupta, Florian Metze
On Dimensional Linguistic Properties of the Word Embedding Space. RepL4NLP@ACL (2020)
Xinjian Li, Zhong Zhou, Siddharth Dalmia, Alan W. Black, Florian Metze
SANTLR: Speech Annotation Toolkit for Low Resource Languages. INTERSPEECH (2019)
Florian Metze
Survey Talk: Multimodal Processing of Speech and Language. INTERSPEECH (2019)
Suyoun Kim, Siddharth Dalmia, Florian Metze
Cross-Attention End-to-End ASR for Two-Party Conversations. INTERSPEECH (2019)
Tejas Srinivasan, Ramon Sanabria, Florian Metze
Multitask Learning For Different Subword Segmentations In Neural Machine Translation. CoRR (2019)
Vikas Raunak, Vaibhav Kumar, Florian Metze
On Compositionality in Neural Machine Translation. CoRR (2019)
Vikas Raunak, Vivek Gupta, Florian Metze
Effective Dimensionality Reduction for Word Embeddings. RepL4NLP@ACL (2019)
Vikas Raunak, Vaibhav Kumar, Vivek Gupta, Florian Metze
On Dimensional Linguistic Properties of the Word Embedding Space. CoRR (2019)
Ozan Caglayan, Ramon Sanabria, Shruti Palaskar, Loïc Barrault, Florian Metze
Multimodal Grounding for Sequence-to-sequence Speech Recognition. ICASSP (2019)
Suyoun Kim, Siddharth Dalmia, Florian Metze
Gated Embeddings in End-to-End Speech Recognition for Conversational-Context Fusion. CoRR (2019)
Juncheng B. Li, Shuhui Qu, Xinjian Li, J. Zico Kolter, Florian Metze
Adversarial Music: Real World Audio Adversary Against Wake-word Detection System. CoRR (2019)
Shruti Palaskar, Vikas Raunak, Florian Metze
Learned In Speech Recognition: Contextual Acoustic Word Embeddings. CoRR (2019)
Tejas Srinivasan, Ramon Sanabria, Florian Metze
Multitask Learning For Different Subword Segmentations In Neural Machine Translation. IWSLT (2019)
Yasufumi Moriya, Ramon Sanabria, Florian Metze, Gareth J. F. Jones
Grounding Object Detections With Transcriptions. CoRR (2019)
Xinjian Li, Siddharth Dalmia, Alan W. Black, Florian Metze
Multilingual Speech Recognition with Corpus Relatedness Sampling. INTERSPEECH (2019)
Eduard H. Hovy, Jaime G. Carbonell, Hans Chalupsky, Anatole Gershman, Alex Hauptmann, Florian Metze, Teruko Mitamura, Zaid Sheikh, Ankit Dangi, Aditi Chaudhary, Xianyang Chen, Xiang Kong, Bernie Huang, Salvador Medina, Hector Liu, Xuezhe Ma, Maria Ryskina, Ramon Sanabria, Varun Gangal
OPERA: Operations-oriented Probabilistic Extraction, Reasoning, and Analysis. TAC (2019)
Tejas Srinivasan, Ramon Sanabria, Florian Metze
Analyzing Utility of Visual Context in Multimodal Speech Recognition Under Noisy Conditions. CoRR (2019)
Siddharth Dalmia, Xinjian Li, Alan W. Black, Florian Metze
Phoneme Level Language Models for Sequence Based Low Resource ASR. CoRR (2019)
Tejas Srinivasan, Ramon Sanabria, Florian Metze
CMU's Machine Translation System for IWSLT 2019. IWSLT (2019)
Xinjian Li, Zhong Zhou, Siddharth Dalmia, Alan W. Black, Florian Metze
SANTLR: Speech Annotation Toolkit for Low Resource Languages. CoRR (2019)

Florian Metze.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Florian Metze