Po-Yao Huang

Publication Activity (10 Years)

Years Active: 2014-2024
Publications (10 Years): 59

Top Topics

Visual Learning

Machine Translation

Diffusion Models

Top Venues

Publications

Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy V. Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, Mido Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael Rabbat, Vasu Sharma, Gabriel Synnaeve, Hu Xu, Hervé Jégou, Julien Mairal, Patrick Labatut, Armand Joulin, Piotr Bojanowski
DINOv2: Learning Robust Visual Features without Supervision. Trans. Mach. Learn. Res. 2024 (2024)
Jiawei Ma, Po-Yao Huang, Saining Xie, Shang-Wen Li, Luke Zettlemoyer, Shih-Fu Chang, Wen-Tau Yih, Hu Xu
MoDE: CLIP Data Experts via Clustering. CoRR (2024)
Xiaoyu Zhu, Junwei Liang, Po-Yao Huang, Alex Hauptmann
Adversarially Masked Video Consistency for Unsupervised Domain Adaptation. CoRR (2024)
Puyuan Peng, Po-Yao Huang, Shang-Wen Li, Abdelrahman Mohamed, David Harwath
VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wild. ACL (1) (2024)
Hu Xu, Saining Xie, Xiaoqing Ellen Tan, Po-Yao Huang, Russell Howes, Vasu Sharma, Shang-Wen Li, Gargi Ghosh, Luke Zettlemoyer, Christoph Feichtenhofer
Demystifying CLIP Data. ICLR (2024)
Puyuan Peng, Po-Yao Huang, Daniel Li, Abdelrahman Mohamed, David Harwath
VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wild. CoRR (2024)
Vasu Sharma, Karthik Padthe, Newsha Ardalani, Kushal Tirumala, Russell Howes, Hu Xu, Po-Yao Huang, Shang-Wen Li, Armen Aghajanyan, Gargi Ghosh, Luke Zettlemoyer
Text Quality-Based Pruning for Efficient Training of Language Models. CoRR (2024)
Hu Xu, Saining Xie, Xiaoqing Ellen Tan, Po-Yao Huang, Russell Howes, Vasu Sharma, Shang-Wen Li, Gargi Ghosh, Luke Zettlemoyer, Christoph Feichtenhofer
Demystifying CLIP Data. CoRR (2023)
Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, Mahmoud Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Michael G. Rabbat, Vasu Sharma, Gabriel Synnaeve, Hu Xu, Hervé Jégou, Julien Mairal, Patrick Labatut, Armand Joulin, Piotr Bojanowski
DINOv2: Learning Robust Visual Features without Supervision. CoRR (2023)
Mingjie Li, Po-Yao Huang, Xiaojun Chang, Junjie Hu, Yi Yang, Alex Hauptmann
Video Pivoting Unsupervised Multi-Modal Machine Translation. IEEE Trans. Pattern Anal. Mach. Intell. 45 (3) (2023)
Xiaoyu Zhu, Po-Yao Huang, Junwei Liang, Celso M. de Melo, Alexander G. Hauptmann
STMT: A Spatial-Temporal Mesh Transformer for MoCap-Based Action Recognition. CVPR (2023)
Chaitanya Ryali, Yuan-Ting Hu, Daniel Bolya, Chen Wei, Haoqi Fan, Po-Yao Huang, Vaibhav Aggarwal, Arkabandhu Chowdhury, Omid Poursaeed, Judy Hoffman, Jitendra Malik, Yanghao Li, Christoph Feichtenhofer
Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles. CoRR (2023)
Tiezheng Yu, Hanchao Yu, Davis Liang, Yuning Mao, Shaoliang Nie, Po-Yao Huang, Madian Khabsa, Pascale Fung, Yi-Chia Wang
Generating Hashtags for Short-form Videos with Guided Signals. ACL (1) (2023)
Ching-Feng Yeh, Po-Yao Huang, Vasu Sharma, Shang-Wen Li, Gargi Ghosh
FLAP: Fast Language-Audio Pre-training. CoRR (2023)
Xiaoyu Zhu, Po-Yao Huang, Junwei Liang, Celso M. de Melo, Alexander G. Hauptmann
STMT: A Spatial-Temporal Mesh Transformer for MoCap-Based Action Recognition. CoRR (2023)
Chaitanya Ryali, Yuan-Ting Hu, Daniel Bolya, Chen Wei, Haoqi Fan, Po-Yao Huang, Vaibhav Aggarwal, Arkabandhu Chowdhury, Omid Poursaeed, Judy Hoffman, Jitendra Malik, Yanghao Li, Christoph Feichtenhofer
Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles. ICML (2023)
Hu Xu, Saining Xie, Po-Yao Huang, Licheng Yu, Russell Howes, Gargi Ghosh, Luke Zettlemoyer, Christoph Feichtenhofer
CiT: Curation in Training for Effective Vision-Language Data. ICCV (2023)
Po-Yao Huang, Vasu Sharma, Hu Xu, Chaitanya Ryali, Haoqi Fan, Yanghao Li, Shang-Wen Li, Gargi Ghosh, Jitendra Malik, Christoph Feichtenhofer
MAViL: Masked Audio-Video Learners. NeurIPS (2023)
Chen Wei, Karttikeya Mangalam, Po-Yao Huang, Yanghao Li, Haoqi Fan, Hu Xu, Huiyu Wang, Cihang Xie, Alan L. Yuille, Christoph Feichtenhofer
Diffusion Models as Masked Autoencoders. CoRR (2023)
Yuan Tseng, Layne Berry, Yi-Ting Chen, I-Hsiang Chiu, Hsuan-Hao Lin, Max Liu, Puyuan Peng, Yi-Jen Shih, Hung-Yu Wang, Haibin Wu, Po-Yao Huang, Chun-Mao Lai, Shang-Wen Li, David Harwath, Yu Tsao, Shinji Watanabe, Abdelrahman Mohamed, Chi-Luen Feng, Hung-yi Lee
AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models. CoRR (2023)
Ching-Feng Yeh, Po-Yao Huang, Vasu Sharma, Shang-Wen Li, Gargi Gosh
Flap: Fast Language-Audio Pre-Training. ASRU (2023)
Chen Wei, Karttikeya Mangalam, Po-Yao Huang, Yanghao Li, Haoqi Fan, Hu Xu, Huiyu Wang, Cihang Xie, Alan L. Yuille, Christoph Feichtenhofer
Diffusion Models as Masked Autoencoders. ICCV (2023)
Hu Xu, Saining Xie, Po-Yao Huang, Licheng Yu, Russell Howes, Gargi Ghosh, Luke Zettlemoyer, Christoph Feichtenhofer
CiT: Curation in Training for Effective Vision-Language Data. CoRR (2023)
Juncheng Li, Shuhui Qu, Po-Yao Huang, Florian Metze
AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification. INTERSPEECH (2022)
Po-Yao Huang, Hu Xu, Juncheng Li, Alexei Baevski, Michael Auli, Wojciech Galuba, Florian Metze, Christoph Feichtenhofer
Masked Autoencoders that Listen. CoRR (2022)
Juncheng B. Li, Shuhui Qu, Xinjian Li, Po-Yao Huang, Florian Metze
On Adversarial Robustness of Large-scale Audio Visual Learning. CoRR (2022)
Po-Yao Huang, Vasu Sharma, Hu Xu, Chaitanya Ryali, Haoqi Fan, Yanghao Li, Shang-Wen Li, Gargi Ghosh, Jitendra Malik, Christoph Feichtenhofer
MAViL: Masked Audio-Video Learners. CoRR (2022)
Juncheng B. Li, Shuhui Qu, Po-Yao Huang, Florian Metze
AudioTagging Done Right: 2nd comparison of deep learning methods for environmental sound classification. CoRR (2022)
Pengzhen Ren, Yun Xiao, Xiaojun Chang, Po-Yao Huang, Zhihui Li, Brij B. Gupta, Xiaojiang Chen, Xin Wang
A Survey of Deep Active Learning. ACM Comput. Surv. 54 (9) (2022)
Po-Yao Huang, Hu Xu, Juncheng Li, Alexei Baevski, Michael Auli, Wojciech Galuba, Florian Metze, Christoph Feichtenhofer
Masked Autoencoders that Listen. NeurIPS (2022)
Hu Xu, Gargi Ghosh, Po-Yao Huang, Prahal Arora, Masoumeh Aminzadeh, Christoph Feichtenhofer, Florian Metze, Luke Zettlemoyer
VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding. CoRR (2021)
Mandela Patrick, Po-Yao Huang, Yuki Markus Asano, Florian Metze, Alexander G. Hauptmann, João F. Henriques, Andrea Vedaldi
Support-set bottlenecks for video-text representation learning. ICLR (2021)
Juncheng B. Li, Kaixin Ma, Shuhui Qu, Po-Yao Huang, Florian Metze
Audio-Visual Event Recognition Through the Lens of Adversary. ICASSP (2021)
Hu Xu, Gargi Ghosh, Po-Yao Huang, Dmytro Okhonko, Armen Aghajanyan, Florian Metze, Luke Zettlemoyer, Christoph Feichtenhofer
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding. EMNLP (1) (2021)
Hu Xu, Gargi Ghosh, Po-Yao Huang, Dmytro Okhonko, Armen Aghajanyan, Florian Metze, Luke Zettlemoyer, Christoph Feichtenhofer
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding. CoRR (2021)
Mandela Patrick, Po-Yao Huang, Ishan Misra, Florian Metze, Andrea Vedaldi, Yuki M. Asano, João F. Henriques
Space-Time Crop & Attend: Improving Cross-modal Video Representation Learning. ICCV (2021)
Di Yuan, Xiaojun Chang, Po-Yao Huang, Qiao Liu, Zhenyu He
Self-Supervised Deep Correlation Tracking. IEEE Trans. Image Process. 30 (2021)
Hu Xu, Gargi Ghosh, Po-Yao Huang, Prahal Arora, Masoumeh Aminzadeh, Christoph Feichtenhofer, Florian Metze, Luke Zettlemoyer
VLM: Task-agnostic Video-Language Model Pre-training for Video Understanding. ACL/IJCNLP (Findings) (2021)
Po-Yao Huang, Mandela Patrick, Junjie Hu, Graham Neubig, Florian Metze, Alexander G. Hauptmann
Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models. CoRR (2021)
Po-Yao Huang, Junjie Hu, Xiaojun Chang, Alexander G. Hauptmann
Unsupervised Multimodal Neural Machine Translation with Pseudo Visual Pivoting. CoRR (2020)
Pengzhen Ren, Yun Xiao, Xiaojun Chang, Po-Yao Huang, Zhihui Li, Xiaojiang Chen, Xin Wang
A Survey of Deep Active Learning. CoRR (2020)
Po-Yao Huang, Junjie Hu, Xiaojun Chang, Alexander G. Hauptmann
Unsupervised Multimodal Neural Machine Translation with Pseudo Visual Pivoting. ACL (2020)
Juncheng B. Li, Kaixin Ma, Shuhui Qu, Po-Yao Huang, Florian Metze
Audio-Visual Event Recognition through the lens of Adversary. CoRR (2020)
Wenhe Liu, Guoliang Kang, Po-Yao Huang, Xiaojun Chang, Lijun Yu, Yijun Qian, Junwei Liang, Liangke Gui, Jing Wen, Peng Chen, Alexander G. Hauptmann
Argus: Efficient Activity Detection System for Extended Video Analysis. WACV Workshops (2020)
Pengzhen Ren, Yun Xiao, Xiaojun Chang, Po-Yao Huang, Zhihui Li, Xiaojiang Chen, Xin Wang
A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions. CoRR (2020)
Mandela Patrick, Po-Yao Huang, Yuki Markus Asano, Florian Metze, Alexander G. Hauptmann, João F. Henriques, Andrea Vedaldi
Support-set bottlenecks for video-text representation learning. CoRR (2020)
Po-Yao Huang, Xiaojun Chang, Alexander G. Hauptmann, Eduard H. Hovy
Forward and Backward Multimodal NMT for Improved Monolingual and Multilingual Cross-Modal Retrieval. ICMR (2020)
Junpei Zhou, Xinyu Wang, Po-Yao Huang, Alexander G. Hauptmann
CMU-Informedia at TREC 2019 Incident Streams Track. TREC (2019)
Po-Yao Huang, Xiaojun Chang, Alexander G. Hauptmann
Multi-Head Attention with Diversity for Learning Grounded Multilingual Multimodal Representations. EMNLP/IJCNLP (1) (2019)
Po-Yao Huang, Vaibhav, Xiaojun Chang, Alexander G. Hauptmann
Improving What Cross-Modal Retrieval Models Learn through Object-Oriented Inter- and Intra-Modal Attention Networks. ICMR (2019)
Po-Yao Huang, Guoliang Kang, Wenhe Liu, Xiaojun Chang, Alexander G. Hauptmann
Annotation Efficient Cross-Modal Retrieval with Adversarial Attentive Alignment. ACM Multimedia (2019)
Xiaojun Chang, Wenhe Liu, Po-Yao Huang, Changlin Li, Fengda Zhu, Mingfei Han, Mingjie Li, Mengyuan Ma, Siyi Hu, Guoliang Kang, Junwei Liang, Liangke Gui, Lijun Yu, Yijun Qian, Jing Wen, Alexander G. Hauptmann
MMVG-INF-Etrol@TRECVID 2019: Activities in Extended Video. TRECVID (2019)
Po-Yao Huang, Xiaojun Chang, Alexander G. Hauptmann
Multi-Head Attention with Diversity for Learning Grounded Multilingual Multimodal Representations. CoRR (2019)
Vaibhav, Po-Yao Huang, Robert E. Frederking
RWR-GAE: Random Walk Regularization for Graph Auto Encoders. CoRR (2019)
Xiaojun Chang, Po-Yao Huang, Yi-Dong Shen, Xiaodan Liang, Yi Yang, Alexander G. Hauptmann
RCAA: Relational Context-Aware Agents for Person Search. ECCV (9) (2018)
Po-Yao Huang, Junwei Liang, Jean-Baptiste Lamare, Alexander G. Hauptmann
Multimodal Filtering of Social Media for Temporal Monitoring and Event Analysis. ICMR (2018)
Po-Yao Huang, Hong Shiang Lin, Sun-Yu Gordon Chi, Liang-Han Lin, Ming Ouhyoung
Panoramic depth reconstruction within a single shot by optimizing global sphere radii. SIGGRAPH ASIA Posters (2018)
Jia Chen, Shizhe Chen, Qin Jin, Alexander G. Hauptmann, Po-Yao Huang, Junwei Liang, Vaibhav, Xiaojun Chang, Jiang Liu, Ting-Yao Hu, Wenhe Liu, Wei Ke, Wayner Barrios, Haroon Idrees, Donghyun Yoo, Yaser Sheikh, Ruslan Salakhutdinov, Kris Kitani, Dong Huang
Informedia @ TRECVID 2018: Ad-hoc Video Search, Video to Text Description, Activities in Extended video. TRECVID (2018)
Po-Yao Huang, Frederick Liu, Sz-Rung Shiang, Jean Oh, Chris Dyer
Attention-based Multimodal Neural Machine Translation. WMT (2016)
Yu-Jui Liu, Shin-Ming Cheng, Po-Yao Huang
Cognitive vertical handover in heterogeneous networks. QSHINE (2015)
Han-Feng Lin, Shin-Ming Cheng, Po-Yao Huang
Cognitive access in multichannel wireless networks using two-dimension Markov chain. IWCMC (2014)