Hexiang Hu

Publication Activity (10 Years)

Years Active: 2015-2024
Publications (10 Years): 74

Top Topics

Image Generation

Multimodal Information

Top Venues

Publications

Kai Zhang, Yi Luan, Hexiang Hu, Kenton Lee, Siyuan Qiao, Wenhu Chen, Yu Su, Ming-Wei Chang
MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions. CoRR (2024)
Hexiang Hu, Kelvin C. K. Chan, Yu-Chuan Su, Wenhu Chen, Yandong Li, Kihyuk Sohn, Yang Zhao, Xue Ben, Boqing Gong, William W. Cohen, Ming-Wei Chang, Xuhui Jia
Instruct-Imagen: Image Generation with Multi-modal Instruction. CoRR (2024)
Jinhyuk Lee, Anthony Chen, Zhuyun Dai, Dheeru Dua, Devendra Singh Sachan, Michael Boratko, Yi Luan, Sébastien M. R. Arnold, Vincent Perot, Siddharth Dalmia, Hexiang Hu, Xudong Lin, Panupong Pasupat, Aida Amini, Jeremy R. Cole, Sebastian Riedel, Iftekhar Naim, Ming-Wei Chang, Kelvin Guu
Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More? CoRR (2024)
Yang Chen, Hexiang Hu, Yi Luan, Haitian Sun, Soravit Changpinyo, Alan Ritter, Ming-Wei Chang
Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions? EMNLP (2023)
Hexiang Hu, Ozan Sener, Fei Sha, Vladlen Koltun
Drinking From a Firehose: Continual Learning With Web-Scale Natural Language. IEEE Trans. Pattern Anal. Mach. Intell. 45 (5) (2023)
Hexiang Hu, Yi Luan, Yang Chen, Urvashi Khandelwal, Mandar Joshi, Kenton Lee, Kristina Toutanova, Ming-Wei Chang
Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entities. ICCV (2023)
Peter Shaw, Mandar Joshi, James Cohan, Jonathan Berant, Panupong Pasupat, Hexiang Hu, Urvashi Khandelwal, Kenton Lee, Kristina Toutanova
From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces. NeurIPS (2023)
Jihyung Kil, Soravit Changpinyo, Xi Chen, Hexiang Hu, Sebastian Goodman, Wei-Lun Chao, Radu Soricut
PreSTU: Pre-Training for Scene-Text Understanding. ICCV (2023)
Kenton Lee, Mandar Joshi, Iulia Raluca Turc, Hexiang Hu, Fangyu Liu, Julian Martin Eisenschlos, Urvashi Khandelwal, Peter Shaw, Ming-Wei Chang, Kristina Toutanova
Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding. ICML (2023)
Cong Wei, Yang Chen, Haonan Chen, Hexiang Hu, Ge Zhang, Jie Fu, Alan Ritter, Wenhu Chen
UniIR: Training and Benchmarking Universal Multimodal Information Retrievers. CoRR (2023)
Hexiang Hu, Yi Luan, Yang Chen, Urvashi Khandelwal, Mandar Joshi, Kenton Lee, Kristina Toutanova, Ming-Wei Chang
Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entities. CoRR (2023)
Yang Chen, Hexiang Hu, Yi Luan, Haitian Sun, Soravit Changpinyo, Alan Ritter, Ming-Wei Chang
Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions? CoRR (2023)
Wenhu Chen, Hexiang Hu, Yandong Li, Nataniel Ruiz, Xuhui Jia, Ming-Wei Chang, William W. Cohen
Subject-driven Text-to-Image Generation via Apprenticeship Learning. NeurIPS (2023)
Wenhu Chen, Hexiang Hu, Chitwan Saharia, William W. Cohen
Re-Imagen: Retrieval-Augmented Text-to-Image Generator. ICLR (2023)
Wenhu Chen, Hexiang Hu, Yandong Li, Nataniel Ruiz, Xuhui Jia, Ming-Wei Chang, William W. Cohen
Subject-driven Text-to-Image Generation via Apprenticeship Learning. CoRR (2023)
Peter Shaw, Mandar Joshi, James Cohan, Jonathan Berant, Panupong Pasupat, Hexiang Hu, Urvashi Khandelwal, Kenton Lee, Kristina Toutanova
From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces. CoRR (2023)
Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, Siamak Shakeri, Mostafa Dehghani, Daniel Salz, Mario Lucic, Michael Tschannen, Arsha Nagrani, Hexiang Hu, Mandar Joshi, Bo Pang, Ceslee Montgomery, Paulina Pietrzyk, Marvin Ritter, A. J. Piergiovanni, Matthias Minderer, Filip Pavetic, Austin Waters, Gang Li, Ibrahim Alabdulmohsin, Lucas Beyer, Julien Amelot, Kenton Lee, Andreas Peter Steiner, Yang Li, Daniel Keysers, Anurag Arnab, Yuanzhong Xu, Keran Rong, Alexander Kolesnikov, Mojtaba Seyedhosseini, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut
PaLI-X: On Scaling up a Multilingual Vision and Language Model. CoRR (2023)
Jihyung Kil, Soravit Changpinyo, Xi Chen, Hexiang Hu, Sebastian Goodman, Wei-Lun Chao, Radu Soricut
PreSTU: Pre-Training for Scene-Text Understanding. CoRR (2022)
Wenhu Chen, Hexiang Hu, Xi Chen, Pat Verga, William W. Cohen
MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text. CoRR (2022)
Kenton Lee, Mandar Joshi, Iulia Turc, Hexiang Hu, Fangyu Liu, Julian Eisenschlos, Urvashi Khandelwal, Peter Shaw, Ming-Wei Chang, Kristina Toutanova
Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding. CoRR (2022)
Wenhu Chen, Hexiang Hu, Xi Chen, Pat Verga, William W. Cohen
MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text. EMNLP (2022)
Wenhu Chen, Hexiang Hu, Chitwan Saharia, William W. Cohen
Re-Imagen: Retrieval-Augmented Text-to-Image Generator. CoRR (2022)
Jiacheng Chen, Hexiang Hu, Hao Wu, Yuning Jiang, Changhu Wang
Learning the Best Pooling Strategy for Visual Semantic Embedding. CVPR (2021)
Linlu Qiu, Hexiang Hu, Bowen Zhang, Peter Shaw, Fei Sha
Systematic Generalization on gSCAN: What is Nearly Solved and What is Next? EMNLP (1) (2021)
Linlu Qiu, Hexiang Hu, Bowen Zhang, Peter Shaw, Fei Sha
Systematic Generalization on gSCAN: What is Nearly Solved and What is Next? CoRR (2021)
Cheng Zhang, Tai-Yu Pan, Yandong Li, Hexiang Hu, Dong Xuan, Soravit Changpinyo, Boqing Gong, Wei-Lun Chao
MosaicOS: A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection. ICCV (2021)
Bowen Zhang, Hexiang Hu, Linlu Qiu, Peter Shaw, Fei Sha
Visually Grounded Concept Composition. EMNLP (Findings) (2021)
Han-Jia Ye, Hexiang Hu, De-Chuan Zhan
Learning Adaptive Classifiers Synthesis for Generalized Few-Shot Learning. Int. J. Comput. Vis. 129 (6) (2021)
Tai-Yu Pan, Cheng Zhang, Yandong Li, Hexiang Hu, Dong Xuan, Soravit Changpinyo, Boqing Gong, Wei-Lun Chao
On Model Calibration for Long-Tailed Object Detection and Instance Segmentation. CoRR (2021)
Cheng Zhang, Tai-Yu Pan, Yandong Li, Hexiang Hu, Dong Xuan, Soravit Changpinyo, Boqing Gong, Wei-Lun Chao
A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection. CoRR (2021)
Tai-Yu Pan, Cheng Zhang, Yandong Li, Hexiang Hu, Dong Xuan, Soravit Changpinyo, Boqing Gong, Wei-Lun Chao
On Model Calibration for Long-Tailed Object Detection and Instance Segmentation. NeurIPS (2021)
Bowen Zhang, Hexiang Hu, Linlu Qiu, Peter Shaw, Fei Sha
Visually Grounded Concept Composition. CoRR (2021)
Jiacheng Chen, Hexiang Hu, Hao Wu, Yuning Jiang, Changhu Wang
Learning the Best Pooling Strategy for Visual Semantic Embedding. CoRR (2020)
Wang Zhu, Hexiang Hu, Jiacheng Chen, Zhiwei Deng, Vihan Jain, Eugene Ie, Fei Sha
BabyWalk: Going Farther in Vision-and-Language Navigation by Taking Baby Steps. CoRR (2020)
Hexiang Hu, Ozan Sener, Fei Sha, Vladlen Koltun
Drinking from a Firehose: Continual Learning with Web-scale Natural Language. CoRR (2020)
Bowen Zhang, Hexiang Hu, Fei Sha
Visual Storytelling via Predicting Anchor Word Embeddings in the Stories. CoRR (2020)
Bowen Zhang, Hexiang Hu, Vihan Jain, Eugene Ie, Fei Sha
Learning to Represent Image and Text with Denotation Graph. EMNLP (1) (2020)
Bowen Zhang, Hexiang Hu, Vihan Jain, Eugene Ie, Fei Sha
Learning to Represent Image and Text with Denotation Graph. CoRR (2020)
Wang Zhu, Hexiang Hu, Jiacheng Chen, Zhiwei Deng, Vihan Jain, Eugene Ie, Fei Sha
BabyWalk: Going Farther in Vision-and-Language Navigation by Taking Baby Steps. ACL (2020)
Han-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei Sha
Few-Shot Learning via Embedding Adaptation With Set-to-Set Functions. CVPR (2020)
Nelson Nauata, Hexiang Hu, Guang-Tong Zhou, Zhiwei Deng, Zicheng Liao, Greg Mori
Structured Label Inference for Visual Understanding. IEEE Trans. Pattern Anal. Mach. Intell. 42 (5) (2020)
Bowen Zhang, Hexiang Hu, Joonseok Lee, Ming Zhao, Sheide Chammas, Vihan Jain, Eugene Ie, Fei Sha
A Hierarchical Multi-Modal Encoder for Moment Localization in Video Corpus. CoRR (2020)
Han-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei Sha
Learning Classifier Synthesis for Generalized Few-Shot Learning. CoRR (2019)
Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim
Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation. NeurIPS (2019)
Kurt Shuster, Samuel Humeau, Hexiang Hu, Antoine Bordes, Jason Weston
Engaging Image Captioning via Personality. CVPR (2019)
Hexiang Hu, Ishan Misra, Laurens van der Maaten
Evaluating Text-to-Image Matching using Binary Image Selection (BISON). ICCV Workshops (2019)
Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim
Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation. CoRR (2019)
Hexiang Hu, Ishan Misra, Laurens van der Maaten
Binary Image Selection (BISON): Interpretable Evaluation of Visual Grounding. CoRR (2019)
Hexiang Hu, Liyu Chen, Boqing Gong, Fei Sha
Synthesized Policies for Transfer and Adaptation across Tasks and Environments. CoRR (2019)
Wei-Lun Chao, Hexiang Hu, Fei Sha
Cross-Dataset Adaptation for Visual Question Answering. CoRR (2018)
Hexiang Hu, Wei-Lun Chao, Fei Sha
Learning Answer Embeddings for Visual Question Answering. CVPR (2018)
Wei-Lun Chao, Hexiang Hu, Fei Sha
Being Negative but Constructively: Lessons Learnt from Creating Better Visual Question Answering Datasets. NAACL-HLT (2018)
Hexiang Hu, Wei-Lun Chao, Fei Sha
Learning Answer Embeddings for Visual Question Answering. CoRR (2018)
Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim
Toward Multimodal Model-Agnostic Meta-Learning. CoRR (2018)
Han-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei Sha
Learning Embedding Adaptation for Few-Shot Learning. CoRR (2018)
Nelson Nauata, Hexiang Hu, Guang-Tong Zhou, Zhiwei Deng, Zicheng Liao, Greg Mori
Structured Label Inference for Visual Understanding. CoRR (2018)
Kurt Shuster, Samuel Humeau, Hexiang Hu, Antoine Bordes, Jason Weston
Engaging Image Captioning Via Personality. CoRR (2018)
Soravit Changpinyo, Hexiang Hu, Fei Sha
Multi-Task Learning for Sequence Tagging: An Empirical Study. CoRR (2018)
Bowen Zhang, Hexiang Hu, Fei Sha
Cross-Modal and Hierarchical Modeling of Video and Text. ECCV (13) (2018)
Wei-Lun Chao, Hexiang Hu, Fei Sha
Cross-Dataset Adaptation for Visual Question Answering. CVPR (2018)
Soravit Changpinyo, Hexiang Hu, Fei Sha
Multi-Task Learning for Sequence Tagging: An Empirical Study. COLING (2018)
Hexiang Hu, Liyu Chen, Boqing Gong, Fei Sha
Synthesize Policies for Transfer and Adaptation across Tasks and Environments. NeurIPS (2018)
Chao-Yuan Wu, Manzil Zaheer, Hexiang Hu, R. Manmatha, Alexander J. Smola, Philipp Krähenbühl
Compressed Video Action Recognition. CVPR (2018)
Bowen Zhang, Hexiang Hu, Fei Sha
Cross-Modal and Hierarchical Modeling of Video and Text. CoRR (2018)
Chao-Yuan Wu, Manzil Zaheer, Hexiang Hu, R. Manmatha, Alexander J. Smola, Philipp Krähenbühl
Compressed Video Action Recognition. CoRR (2017)
Hexiang Hu, Shiyi Lan, Yuning Jiang, Zhimin Cao, Fei Sha
FastMask: Segment Multi-scale Object Candidates in One Shot. CVPR (2017)
Hexiang Hu, Zhiwei Deng, Guang-Tong Zhou, Fei Sha, Greg Mori
LabelBank: Revisiting Global Perspectives for Semantic Segmentation. CoRR (2017)
Wei-Lun Chao, Hexiang Hu, Fei Sha
Being Negative but Constructively: Lessons Learnt from Creating Better Visual Question Answering Datasets. CoRR (2017)
Hexiang Hu, Guang-Tong Zhou, Zhiwei Deng, Zicheng Liao, Greg Mori
Learning Structured Inference Neural Networks with Label Relations. CVPR (2016)
Zhiwei Deng, Arash Vahdat, Hexiang Hu, Greg Mori
Structure Inference Machines: Recurrent Neural Networks for Analyzing Relations in Group Activity Recognition. CVPR (2016)
Hexiang Hu, Zhiwei Deng, Guang-Tong Zhou, Fei Sha, Greg Mori
Recalling Holistic Information for Semantic Segmentation. CoRR (2016)
Hexiang Hu, Shiyi Lan, Yuning Jiang, Zhimin Cao, Fei Sha
FastMask: Segment Object Multi-scale Candidates in One Shot. CoRR (2016)
Zhiwei Deng, Arash Vahdat, Hexiang Hu, Greg Mori
Structure Inference Machines: Recurrent Neural Networks for Analyzing Relations in Group Activity Recognition. CoRR (2015)
Hexiang Hu, Guang-Tong Zhou, Zhiwei Deng, Zicheng Liao, Greg Mori
Learning Structured Inference Neural Networks with Label Relations. CoRR (2015)