Xin Eric Wang

Publication Activity (10 Years)

Years Active: 2020-2024
Publications (10 Years): 71

Top Topics

Diffusion Models

Natural Language

Top Venues

Publications

Yue Fan, Lei Ding, Ching-Chen Kuo, Shan Jiang, Yang Zhao, Xinze Guan, Jie Yang, Yi Zhang, Xin Eric Wang
Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding. CoRR (2024)
Xuehai He, Jian Zheng, Jacob Zhiyuan Fang, Robinson Piramuthu, Mohit Bansal, Vicente Ordonez, Gunnar A. Sigurdsson, Nanyun Peng, Xin Eric Wang
FlexEControl: Flexible and Efficient Multimodal Control for Text-to-Image Generation. CoRR (2024)
Qianqi Yan, Xuehai He, Xiang Yue, Xin Eric Wang
Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA. CoRR (2024)
Xuehai He, Weixi Feng, Kaizhi Zheng, Yujie Lu, Wanrong Zhu, Jiachen Li, Yue Fan, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Kevin Lin, William Yang Wang, Lijuan Wang, Xin Eric Wang
MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos. CoRR (2024)
Jing Gu, Yilin Wang, Nanxuan Zhao, Wei Xiong, Qing Liu, Zhifei Zhang, He Zhang, Jianming Zhang, Hyunjoon Jung, Xin Eric Wang
SwapAnything: Enabling Arbitrary Object Swapping in Personalized Visual Editing. CoRR (2024)
Yufan Zhou, Ruiyi Zhang, Kaizhi Zheng, Nanxuan Zhao, Jiuxiang Gu, Zichao Wang, Xin Eric Wang, Tong Sun
Toffee: Efficient Million-Scale Dataset Construction for Subject-Driven Text-to-Image Generation. CoRR (2024)
Gengze Zhou, Yicong Hong, Zun Wang, Xin Eric Wang, Qi Wu
NavGPT-2: Unleashing Navigational Reasoning Capability for Large Vision-Language Models. CoRR (2024)
Yue Fan, Jing Gu, Kaiwen Zhou, Qianqi Yan, Shan Jiang, Ching-Chen Kuo, Xinze Guan, Xin Eric Wang
Muffin or Chihuahua? Challenging Large Vision-Language Models with Multipanel VQA. CoRR (2024)
Jing Gu, Yuwei Fang, Ivan Skorokhodov, Peter Wonka, Xinya Du, Sergey Tulyakov, Xin Eric Wang
VIA: A Spatiotemporal Video Adaptation Framework for Global and Local Video Editing. CoRR (2024)
Kaizhi Zheng, Xuehai He, Xin Eric Wang
MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens. CoRR (2023)
Xuehai He, Xin Eric Wang
Multimodal Graph Transformer for Multimodal Question Answering. CoRR (2023)
Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang
Parameter-Efficient Model Adaptation for Vision Transformers. AAAI (2023)
Xuehai He, Weixi Feng, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Eric Wang
Discriminative Diffusion Models as Few-shot Vision and Language Learners. CoRR (2023)
Kaiwen Zhou, Kaizhi Zheng, Connor Pryor, Yilin Shen, Hongxia Jin, Lise Getoor, Xin Eric Wang
ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigation. CoRR (2023)
Yue Fan, Kaizhi Zheng, Jing Gu, Xin Eric Wang
R2H: Building Multimodal Navigation Helpers that Respond to Help. CoRR (2023)
Yujie Lu, Xianjun Yang, Xiujun Li, Xin Eric Wang, William Yang Wang
LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation. NeurIPS (2023)
Kaiwen Zhou, Kwonjoon Lee, Teruhisa Misu, Xin Eric Wang
ViCor: Bridging Visual Understanding and Commonsense Reasoning with Large Language Models. CoRR (2023)
Swati Jindal, Xin Eric Wang
CUDA-GHR: Controllable Unsupervised Domain Adaptation for Gaze and Head Redirection. WACV (2023)
Yujie Lu, Pan Lu, Zhiyu Chen, Wanrong Zhu, Xin Eric Wang, William Yang Wang
Multimodal Procedural Planning via Dual Text-Image Prompting. CoRR (2023)
Kaiwen Zhou, Kaizhi Zheng, Connor Pryor, Yilin Shen, Hongxia Jin, Lise Getoor, Xin Eric Wang
ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigation. ICML (2023)
Saaket Agashe, Yue Fan, Xin Eric Wang
Evaluating Multi-Agent Coordination Abilities in Large Language Models. CoRR (2023)
Yujie Lu, Xianjun Yang, Xiujun Li, Xin Eric Wang, William Yang Wang
LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation. CoRR (2023)
Zhen Zhang, Jialu Wang, Xin Eric Wang
Parameter-Efficient Cross-lingual Transfer of Vision and Language Models via Translation-based Alignment. EMNLP (Findings) (2023)
Jing Gu, Yilin Wang, Nanxuan Zhao, Tsu-Jui Fu, Wei Xiong, Qing Liu, Zhifei Zhang, He Zhang, Jianming Zhang, Hyunjoon Jung, Xin Eric Wang
Photoswap: Personalized Subject Swapping in Images. CoRR (2023)
Wanrong Zhu, Xinyi Wang, Yujie Lu, Tsu-Jui Fu, Xin Eric Wang, Miguel P. Eckstein, William Yang Wang
Collaborative Generative AI: Integrating GPT-k for Efficient Editing in Text-to-Image Generation. CoRR (2023)
Weixi Feng, Wanrong Zhu, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Xuehai He, Sugato Basu, Xin Eric Wang, William Yang Wang
LayoutGPT: Compositional Visual Planning and Generation with Large Language Models. NeurIPS (2023)
Weixi Feng, Wanrong Zhu, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Xuehai He, Sugato Basu, Xin Eric Wang, William Yang Wang
LayoutGPT: Compositional Visual Planning and Generation with Large Language Models. CoRR (2023)
Yujie Lu, Weixi Feng, Wanrong Zhu, Wenda Xu, Xin Eric Wang, Miguel P. Eckstein, William Yang Wang
Neuro-Symbolic Procedural Planning with Commonsense Prompting. ICLR (2023)
Zhen Zhang, Jialu Wang, Xin Eric Wang
Parameter-Efficient Cross-lingual Transfer of Vision and Language Models via Translation-based Alignment. CoRR (2023)
Weixi Feng, Xuehai He, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, Xin Eric Wang, William Yang Wang
Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis. ICLR (2023)
Jialu Wang, Xinyue Gabby Liu, Zonglin Di, Yang Liu, Xin Eric Wang
T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generation. CoRR (2023)
Jing Gu, Yilin Wang, Nanxuan Zhao, Tsu-Jui Fu, Wei Xiong, Qing Liu, Zhifei Zhang, He Zhang, Jianming Zhang, Hyunjoon Jung, Xin Eric Wang
PHOTOSWAP: Personalized Subject Swapping in Images. NeurIPS (2023)
Jialu Wang, Xin Eric Wang, Yang Liu
Understanding Instance-Level Impact of Fairness Constraints. CoRR (2022)
Yujie Lu, Weixi Feng, Wanrong Zhu, Wenda Xu, Xin Eric Wang, Miguel P. Eckstein, William Yang Wang
Neuro-Symbolic Causal Language Planning with Commonsense Prompting. CoRR (2022)
Kaiwen Zhou, Xin Eric Wang
FedVLN: Privacy-preserving Federated Vision-and-Language Navigation. CoRR (2022)
Jialu Wang, Xin Eric Wang, Yang Liu
Understanding Instance-Level Impact of Fairness Constraints. ICML (2022)
Kaiwen Zhou, Xin Eric Wang
FedVLN: Privacy-Preserving Federated Vision-and-Language Navigation. ECCV (36) (2022)
Juncheng Li, Junlin Xie, Long Qian, Linchao Zhu, Siliang Tang, Fei Wu, Yi Yang, Yueting Zhuang, Xin Eric Wang
Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learning. CVPR (2022)
Wanrong Zhu, An Yan, Yujie Lu, Wenda Xu, Xin Eric Wang, Miguel Eckstein, William Yang Wang
Visualize Before You Write: Imagination-Guided Open-Ended Text Generation. CoRR (2022)
Yujie Lu, Huiliang Zhang, Ping Nie, Weixi Feng, Wenda Xu, Xin Eric Wang, William Yang Wang
Anticipating the Unseen Discrepancy for Vision and Language Navigation. CoRR (2022)
Tianyi Luo, Rui Meng, Xin Eric Wang, Yang Liu
Interpretable Research Replication Prediction via Variational Contextual Consistency Sentence Masking. CoRR (2022)
Yue Fan, Winson Chen, Tongzhou Jiang, Chun Zhou, Yi Zhang, Xin Eric Wang
Aerial Vision-and-Dialog Navigation. CoRR (2022)
Tsu-Jui Fu, Xin Eric Wang, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang
L: Language-based Video Editing via Multi-Modal Multi-Level Transformers. CVPR (2022)
Jing Gu, Eliana Stefani, Qi Wu, Jesse Thomason, Xin Eric Wang
Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions. CoRR (2022)
Kaizhi Zheng, Xiaotong Chen, Odest Chadwicke Jenkins, Xin Eric Wang
VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation. CoRR (2022)
Xuehai He, Diji Yang, Weixi Feng, Tsu-Jui Fu, Arjun R. Akula, Varun Jampani, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Eric Wang
CPL: Counterfactual Prompt Learning for Vision and Language Models. CoRR (2022)
Kaizhi Zheng, Kaiwen Zhou, Jing Gu, Yue Fan, Jialu Wang, Zonglin Di, Xuehai He, Xin Eric Wang
JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents. CoRR (2022)
Kenan Jiang, Xuehai He, Ruize Xu, Xin Eric Wang
ComCLIP: Training-Free Compositional Image and Text Matching. CoRR (2022)
Tsu-Jui Fu, Xin Eric Wang, William Yang Wang
Language-Driven Artistic Style Transfer. ECCV (36) (2022)
Weixi Feng, Xuehai He, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, Xin Eric Wang, William Yang Wang
Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis. CoRR (2022)
Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang
Parameter-efficient Fine-tuning for Vision Transformers. CoRR (2022)
Juncheng Li, Junlin Xie, Long Qian, Linchao Zhu, Siliang Tang, Fei Wu, Yi Yang, Yueting Zhuang, Xin Eric Wang
Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learning. CoRR (2022)
Yujie Lu, Wanrong Zhu, Xin Eric Wang, Miguel P. Eckstein, William Yang Wang
Imagination-Augmented Natural Language Understanding. CoRR (2022)
An Yan, Xin Eric Wang, Tsu-Jui Fu, William Yang Wang
L2C: Describing Visual Differences Needs Semantic Understanding of Individuals. CoRR (2021)
Jialu Wang, Yang Liu, Xin Eric Wang
Assessing Multilingual Fairness in Pre-trained Multimodal Representations. CoRR (2021)
Jialu Wang, Yang Liu, Xin Eric Wang
Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search. CoRR (2021)
Linjie Li, Jie Lei, Zhe Gan, Licheng Yu, Yen-Chun Chen, Rohit Pillai, Yu Cheng, Luowei Zhou, Xin Eric Wang, William Yang Wang, Tamara Lee Berg, Mohit Bansal, Jingjing Liu, Lijuan Wang, Zicheng Liu
VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation. CoRR (2021)
Tsu-Jui Fu, Xin Eric Wang, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang
Language-based Video Editing via Multi-Modal Multi-Level Transformer. CoRR (2021)
Tsu-Jui Fu, Xin Eric Wang, William Yang Wang
Language-Driven Image Style Transfer. CoRR (2021)
Wanrong Zhu, Xin Eric Wang, An Yan, Miguel P. Eckstein, William Yang Wang
ImaginE: An Imagination-Based Automatic Evaluation Metric for Natural Language Generation. CoRR (2021)
Swati Jindal, Xin Eric Wang
CUDA-GR: Controllable Unsupervised Domain Adaptation for Gaze Redirection. CoRR (2021)
Wenqiao Zhang, Xin Eric Wang, Siliang Tang, Haizhou Shi, Haochen Shi, Jun Xiao, Yueting Zhuang, William Yang Wang
Relational Graph Learning for Grounded Video Description Generation. CoRR (2021)
Wanrong Zhu, Yuankai Qi, Pradyumna Narayana, Kazoo Sone, Sugato Basu, Xin Eric Wang, Qi Wu, Miguel P. Eckstein, William Yang Wang
Diagnosing Vision-and-Language Navigation: What Really Matters. CoRR (2021)
Jiayi Wei, Xilian Li, Yi Zhang, Xin Eric Wang
Visual Question Rewriting for Increasing Response Rate. SIGIR (2021)
Jialu Wang, Yang Liu, Xin Eric Wang
Are Gender-Neutral Queries Really Gender-Neutral? Mitigating Gender Bias in Image Search. EMNLP (1) (2021)
Wenqiao Zhang, Xin Eric Wang, Siliang Tang, Haizhou Shi, Haochen Shi, Jun Xiao, Yueting Zhuang, William Yang Wang
Relational Graph Learning for Grounded Video Description Generation. ACM Multimedia (2020)
Tsu-Jui Fu, Xin Eric Wang, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang
SSCR: Iterative Language-Based Image Editing via Self-Supervised Counterfactual Reasoning. CoRR (2020)
Wanrong Zhu, Xin Eric Wang, Pradyumna Narayana, Kazoo Sone, Sugato Basu, William Yang Wang
Towards Understanding Sample Variance in Visually Grounded Language Generation: Evaluations and Observations. CoRR (2020)
Jiannan Xiang, Xin Eric Wang, William Yang Wang
Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation. CoRR (2020)
Xin Eric Wang, Vihan Jain, Eugene Ie, William Yang Wang, Zornitsa Kozareva, Sujith Ravi
Environment-Agnostic Multitask Learning for Natural Language Grounded Navigation. ECCV (24) (2020)
Tsu-Jui Fu, Xin Eric Wang, Matthew F. Peterson, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang
Counterfactual Vision-and-Language Navigation via Adversarial Path Sampler. ECCV (6) (2020)