Xuehai He

Publication Activity (10 Years)

Years Active: 2019-2024
Publications (10 Years): 29

Top Topics

Diffusion Models

Robust Principal Component Analysis

Question Answering

Top Venues

Publications

Xuehai He, Jian Zheng, Jacob Zhiyuan Fang, Robinson Piramuthu, Mohit Bansal, Vicente Ordonez, Gunnar A. Sigurdsson, Nanyun Peng, Xin Eric Wang
FlexEControl: Flexible and Efficient Multimodal Control for Text-to-Image Generation. CoRR (2024)
Qianqi Yan, Xuehai He, Xiang Yue, Xin Eric Wang
Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA. CoRR (2024)
Xuehai He, Weixi Feng, Kaizhi Zheng, Yujie Lu, Wanrong Zhu, Jiachen Li, Yue Fan, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Kevin Lin, William Yang Wang, Lijuan Wang, Xin Eric Wang
MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos. CoRR (2024)
Kenan Jiang, Xuehai He, Ruize Xu, Xin Wang
ComCLIP: Training-Free Compositional Image and Text Matching. NAACL-HLT (2024)
Pengtao Xie, Xingchen Zhao, Xuehai He
Simultaneous Selection and Adaptation of Source Data via Four-Level Optimization. Trans. Assoc. Comput. Linguistics 12 (2024)
Kaizhi Zheng, Xuehai He, Xin Eric Wang
MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens. CoRR (2023)
Xuehai He, Xin Eric Wang
Multimodal Graph Transformer for Multimodal Question Answering. CoRR (2023)
Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang
Parameter-Efficient Model Adaptation for Vision Transformers. AAAI (2023)
Xuehai He, Weixi Feng, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Eric Wang
Discriminative Diffusion Models as Few-shot Vision and Language Learners. CoRR (2023)
Weixi Feng, Wanrong Zhu, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Xuehai He, Sugato Basu, Xin Eric Wang, William Yang Wang
LayoutGPT: Compositional Visual Planning and Generation with Large Language Models. NeurIPS (2023)
Weixi Feng, Wanrong Zhu, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Xuehai He, Sugato Basu, Xin Eric Wang, William Yang Wang
LayoutGPT: Compositional Visual Planning and Generation with Large Language Models. CoRR (2023)
Jiachen Li, Qiaozi Gao, Michael Johnston, Xiaofeng Gao, Xuehai He, Suhaila Shakiah, Hangjie Shi, Reza Ghanadan, William Yang Wang
Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning. CoRR (2023)
Weixi Feng, Xuehai He, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, Xin Eric Wang, William Yang Wang
Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis. ICLR (2023)
Xuehai He, Xin Wang
Multimodal Graph Transformer for Multimodal Question Answering. EACL (2023)
Xuehai He, Diji Yang, Weixi Feng, Tsu-Jui Fu, Arjun R. Akula, Varun Jampani, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Eric Wang
CPL: Counterfactual Prompt Learning for Vision and Language Models. CoRR (2022)
Kaizhi Zheng, Kaiwen Zhou, Jing Gu, Yue Fan, Jialu Wang, Zonglin Di, Xuehai He, Xin Eric Wang
JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents. CoRR (2022)
Kenan Jiang, Xuehai He, Ruize Xu, Xin Eric Wang
ComCLIP: Training-Free Compositional Image and Text Matching. CoRR (2022)
Weixi Feng, Xuehai He, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, Xin Eric Wang, William Yang Wang
Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis. CoRR (2022)
Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang
Parameter-efficient Fine-tuning for Vision Transformers. CoRR (2022)
Xuehai He, Diji Yang, Weixi Feng, Tsu-Jui Fu, Arjun R. Akula, Varun Jampani, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Wang
CPL: Counterfactual Prompt Learning for Vision and Language Models. EMNLP (2022)
Xuehai He, Zhuo Cai, Wenlan Wei, Yichen Zhang, Luntian Mou, Eric P. Xing, Pengtao Xie
Towards Visual Question Answering on Pathology Images. ACL/IJCNLP (2) (2021)
Meng Zhou, Zechen Li, Bowen Tan, Guangtao Zeng, Wenmian Yang, Xuehai He, Zeqian Ju, Subrato Chakravorty, Shu Chen, Xingyi Yang, Yichen Zhang, Qingyang Wu, Zhou Yu, Kun Xu, Eric P. Xing, Pengtao Xie
On the Generation of Medical Dialogs for COVID-19. ACL/IJCNLP (2) (2021)
Jinyu Zhao, Yichen Zhang, Xuehai He, Pengtao Xie
COVID-CT-Dataset: A CT Scan Dataset about COVID-19. CoRR (2020)
Wenmian Yang, Guangtao Zeng, Bowen Tan, Zeqian Ju, Subrato Chakravorty, Xuehai He, Shu Chen, Xingyi Yang, Qingyang Wu, Zhou Yu, Eric P. Xing, Pengtao Xie
On the Generation of Medical Dialogues for COVID-19. CoRR (2020)
Xuehai He, Yichen Zhang, Luntian Mou, Eric P. Xing, Pengtao Xie
PathVQA: 30000+ Questions for Medical Visual Question Answering. CoRR (2020)
Xuehai He, Zhuo Cai, Wenlan Wei, Yichen Zhang, Luntian Mou, Eric P. Xing, Pengtao Xie
Pathological Visual Question Answering. CoRR (2020)
Xingyi Yang, Xuehai He, Yuxiao Liang, Yue Yang, Shanghang Zhang, Pengtao Xie
Transfer Learning or Self-supervised Learning? A Tale of Two Pretraining Paradigms. CoRR (2020)
Xuehai He, Zhipeng Xue, Xiaojun Yuan
Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis. IEEE Access 7 (2019)
Xuehai He, Xiaojun Yuan, Zhipeng Xue
Learned Turbo-type Affine Rank Minimization. WCSP (2019)