Zhengyuan Yang

Publication Activity (10 Years)

Years Active: 2015-2024
Publications (10 Years): 90

Top Topics

Visual Perception

Language Modeling

Weakly Supervised

Image Generation

Top Venues

Publications

An Yan, Zhengyuan Yang, Junda Wu, Wanrong Zhu, Jianwei Yang, Linjie Li, Kevin Lin, Jianfeng Wang, Julian J. McAuley, Jianfeng Gao, Lijuan Wang
List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs. CoRR (2024)
Kevin Qinghong Lin, Linjie Li, Difei Gao, Qinchen Wu, Mingyi Yan, Zhengyuan Yang, Lijuan Wang, Mike Zheng Shou
VideoGUI: A Benchmark for GUI Automation from Instructional Videos. CoRR (2024)
Chunyuan Li, Zhe Gan, Zhengyuan Yang, Jianwei Yang, Linjie Li, Lijuan Wang, Jianfeng Gao
Multimodal Foundation Models: From Specialists to General-Purpose Assistants. Found. Trends Comput. Graph. Vis. 16 (1-2) (2024)
Yuanhao Zhai, Kevin Lin, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Chung-Ching Lin, David S. Doermann, Junsong Yuan, Lijuan Wang
Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillation. CoRR (2024)
Alex Jinpeng Wang, Linjie Li, Kevin Qinghong Lin, Jianfeng Wang, Kevin Lin, Zhengyuan Yang, Lijuan Wang, Mike Zheng Shou
COSMO: COntrastive Streamlined MultimOdal Model with Interleaved Pre-Training. CoRR (2024)
Yuanhao Zhai, Kevin Lin, Linjie Li, Chung-Ching Lin, Jianfeng Wang, Zhengyuan Yang, David S. Doermann, Junsong Yuan, Zicheng Liu, Lijuan Wang
IDOL: Unified Dual-Modal Latent Diffusion for Human-Centric Joint Video-Depth Generation. CoRR (2024)
Jie An, Zhengyuan Yang, Jianfeng Wang, Linjie Li, Zicheng Liu, Lijuan Wang, Jiebo Luo
Bring Metric Functions into Diffusion Models. CoRR (2024)
Xuehai He, Weixi Feng, Kaizhi Zheng, Yujie Lu, Wanrong Zhu, Jiachen Li, Yue Fan, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Kevin Lin, William Yang Wang, Lijuan Wang, Xin Eric Wang
MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos. CoRR (2024)
Zecheng Tang, Chenfei Wu, Zekai Zhang, Mingheng Ni, Shengming Yin, Yu Liu, Zhengyuan Yang, Lijuan Wang, Zicheng Liu, Juntao Li, Nan Duan
StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesis. CoRR (2024)
Shengxi Li, Xuelong Li, Leonardo Chiariglione, Jiebo Luo, Wenwu Wang, Zhengyuan Yang, Danilo P. Mandic, Hamido Fujita
Introduction to the Special Issue on AI-Generated Content for Multimedia. IEEE Trans. Circuits Syst. Video Technol. 34 (8) (2024)
Jielin Qiu, William Han, Winfred Wang, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Christos Faloutsos, Lei Li, Lijuan Wang
Entity6K: A Large Open-Domain Evaluation Dataset for Real-World Entity Recognition. CoRR (2024)
Chenglei Si, Yanzhe Zhang, Zhengyuan Yang, Ruibo Liu, Diyi Yang
Design2Code: How Far Are We From Automating Front-End Engineering? CoRR (2024)
Changsheng Lv, Mengshi Qi, Xia Li, Zhengyuan Yang, Huadong Ma
SGFormer: Semantic Graph Transformer for Point Cloud-Based 3D Scene Graph Generation. AAAI (2024)
Changsheng Lv, Mengshi Qi, Xia Li, Zhengyuan Yang, Huadong Ma
Revisiting Transformer for Point Cloud-based 3D Scene Graph Generation. CoRR (2023)
Tan Wang, Linjie Li, Kevin Lin, Chung-Ching Lin, Zhengyuan Yang, Hanwang Zhang, Zicheng Liu, Lijuan Wang
DisCo: Disentangled Control for Referring Human Dance Generation in Real World. CoRR (2023)
Jaemin Cho, Linjie Li, Zhengyuan Yang, Zhe Gan, Lijuan Wang, Mohit Bansal
Diagnostic Benchmark and Iterative Inpainting for Layout-Guided Image Generation. CoRR (2023)
Chaoyi Zhang, Kevin Lin, Zhengyuan Yang, Jianfeng Wang, Linjie Li, Chung-Ching Lin, Zicheng Liu, Lijuan Wang
MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning. CoRR (2023)
Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong, Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan
NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation. ACL (1) (2023)
Zhengyuan Yang, Jianfeng Wang, Zhe Gan, Linjie Li, Kevin Lin, Chenfei Wu, Nan Duan, Zicheng Liu, Ce Liu, Michael Zeng, Lijuan Wang
ReCo: Region-Controlled Text-to-Image Generation. CVPR (2023)
Kevin Lin, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Lijuan Wang
DEsignBench: Exploring and Benchmarking DALL-E 3 for Imagining Visual Design. CoRR (2023)
Tan Wang, Kevin Lin, Linjie Li, Chung-Ching Lin, Zhengyuan Yang, Hanwang Zhang, Zicheng Liu, Lijuan Wang
Equivariant Similarity for Vision-Language Foundation Models. ICCV (2023)
Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Ehsan Azarnasab, Faisal Ahmed, Zicheng Liu, Ce Liu, Michael Zeng, Lijuan Wang
MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action. CoRR (2023)
Yushi Hu, Hang Hua, Zhengyuan Yang, Weijia Shi, Noah A. Smith, Jiebo Luo
PromptCap: Prompt-Guided Image Captioning for VQA with GPT-3. ICCV (2023)
Chenglei Si, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan L. Boyd-Graber, Lijuan Wang
Prompting GPT-3 To Be Reliable. ICLR (2023)
Jielin Qiu, Jiacheng Zhu, William Han, Aditesh Kumar, Karthik Mittal, Claire Jin, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Bo Li, Ding Zhao, Lijuan Wang
MultiSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos. CoRR (2023)
Hanjia Lyu, Jinfa Huang, Daoan Zhang, Yongsheng Yu, Xinyi Mou, Jinsheng Pan, Zhengyuan Yang, Zhongyu Wei, Jiebo Luo
GPT-4V(ision) as A Social Media Analysis Engine. CoRR (2023)
An Yan, Zhengyuan Yang, Wanrong Zhu, Kevin Lin, Linjie Li, Jianfeng Wang, Jianwei Yang, Yiwu Zhong, Julian J. McAuley, Jianfeng Gao, Zicheng Liu, Lijuan Wang
GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigation. CoRR (2023)
Zhengyuan Yang, Linjie Li, Kevin Lin, Jianfeng Wang, Chung-Ching Lin, Zicheng Liu, Lijuan Wang
The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision). CoRR (2023)
Jie An, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Zicheng Liu, Lijuan Wang, Jiebo Luo
OpenLEAF: Open-Domain Interleaved Image-Text Generation and Evaluation. CoRR (2023)
Jiajun Deng, Zhengyuan Yang, Daqing Liu, Tianlang Chen, Wengang Zhou, Yanyong Zhang, Houqiang Li, Wanli Ouyang
TransVG++: End-to-End Visual Grounding With Language Conditioned Vision Transformer. IEEE Trans. Pattern Anal. Mach. Intell. 45 (11) (2023)
Tan Wang, Kevin Lin, Linjie Li, Chung-Ching Lin, Zhengyuan Yang, Hanwang Zhang, Zicheng Liu, Lijuan Wang
Equivariant Similarity for Vision-Language Foundation Models. CoRR (2023)
Chunyuan Li, Zhe Gan, Zhengyuan Yang, Jianwei Yang, Linjie Li, Lijuan Wang, Jianfeng Gao
Multimodal Foundation Models: From Specialists to General-Purpose Assistants. CoRR (2023)
Xin Yuan, Linjie Li, Jianfeng Wang, Zhengyuan Yang, Kevin Lin, Zicheng Liu, Lijuan Wang
Spatial-Frequency U-Net for Denoising Diffusion Probabilistic Models. CoRR (2023)
Weihao Yu, Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Zicheng Liu, Xinchao Wang, Lijuan Wang
MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities. CoRR (2023)
Xiaodong Wang, Chenfei Wu, Shengming Yin, Minheng Ni, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Fan Yang, Lijuan Wang, Zicheng Liu, Yuejian Fang, Nan Duan
Learning 3D Photography Videos via Self-supervised Diffusion on Single Images. CoRR (2023)
Bingbing Wen, Zhengyuan Yang, Jianfeng Wang, Zhe Gan, Bill Howe, Lijuan Wang
InfoVisDial: An Informative Visual Dialogue Dataset by Bridging Large Multimodal and Language Models. CoRR (2023)
Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Gong Ming, Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan
NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation. CoRR (2023)
Zhengyuan Yang, Jianfeng Wang, Linjie Li, Kevin Lin, Chung-Ching Lin, Zicheng Liu, Lijuan Wang
Idea2Img: Iterative Self-Refinement with GPT-4V(ision) for Automatic Image Design and Generation. CoRR (2023)
Kevin Lin, Faisal Ahmed, Linjie Li, Chung-Ching Lin, Ehsan Azarnasab, Zhengyuan Yang, Jianfeng Wang, Lin Liang, Zicheng Liu, Yumao Lu, Ce Liu, Lijuan Wang
MM-VID: Advancing Video Understanding with GPT-4V(ision). CoRR (2023)
Xiaodong Wang, Chenfei Wu, Shengming Yin, Minheng Ni, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Fan Yang, Lijuan Wang, Zicheng Liu, Yuejian Fang, Nan Duan
Learning 3D Photography Videos via Self-supervised Diffusion on Single Images. IJCAI (2023)
Xueyan Zou, Linjie Li, Jianfeng Wang, Jianwei Yang, Mingyu Ding, Zhengyuan Yang, Feng Li, Hao Zhang, Shilong Liu, Arul Aravinthan, Yong Jae Lee, Lijuan Wang
Interfacing Foundation Models' Embeddings. CoRR (2023)
Yushi Hu, Hang Hua, Zhengyuan Yang, Weijia Shi, Noah A. Smith, Jiebo Luo
PromptCap: Prompt-Guided Task-Aware Image Captioning. CoRR (2022)
Zhengyuan Yang, Jingen Liu, Jing Huang, Xiaodong He, Tao Mei, Chenliang Xu, Jiebo Luo
Cross-modal Contrastive Distillation for Instructional Activity Anticipation. CoRR (2022)
Mengyang Song, Guoquan Jiang, Zhanqiang Huo, Zhengyuan Yang, Hongxu Zhang
Apple Counting Network Before Fruit Thinning Period Based On Dilated Convolution. ICNCC (2022)
Zhengyuan Yang, Jingen Liu, Jing Huang, Xiaodong He, Tao Mei, Chenliang Xu, Jiebo Luo
Cross-modal Contrastive Distillation for Instructional Activity Anticipation. ICPR (2022)
Zhengyuan Yang, Jianfeng Wang, Zhe Gan, Linjie Li, Kevin Lin, Chenfei Wu, Nan Duan, Zicheng Liu, Ce Liu, Michael Zeng, Lijuan Wang
ReCo: Region-Controlled Text-to-Image Generation. CoRR (2022)
Jialian Wu, Jianfeng Wang, Zhengyuan Yang, Zhe Gan, Zicheng Liu, Junsong Yuan, Lijuan Wang
GRiT: A Generative Region-to-text Transformer for Object Understanding. CoRR (2022)
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
UniTAB: Unifying Text and Box Outputs for Grounded Vision-Language Modeling. ECCV (36) (2022)
Chenglei Si, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan L. Boyd-Graber, Lijuan Wang
Prompting GPT-3 To Be Reliable. CoRR (2022)
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA. AAAI (2022)
Jianfeng Wang, Zhengyuan Yang, Xiaowei Hu, Linjie Li, Kevin Lin, Zhe Gan, Zicheng Liu, Ce Liu, Lijuan Wang
GIT: A Generative Image-to-text Transformer for Vision and Language. Trans. Mach. Learn. Res. 2022 (2022)
Jianfeng Wang, Zhengyuan Yang, Xiaowei Hu, Linjie Li, Kevin Lin, Zhe Gan, Zicheng Liu, Ce Liu, Lijuan Wang
GIT: A Generative Image-to-text Transformer for Vision and Language. CoRR (2022)
Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
Scaling Up Vision-Language Pretraining for Image Captioning. CVPR (2022)
Jiajun Deng, Zhengyuan Yang, Daqing Liu, Tianlang Chen, Wengang Zhou, Yanyong Zhang, Houqiang Li, Wanli Ouyang
TransVG++: End-to-End Visual Grounding with Language Conditioned Vision Transformer. CoRR (2022)
Zhengyuan Yang, Songyang Zhang, Liwei Wang, Jiebo Luo
SAT: 2D Semantics Assisted Training for 3D Visual Grounding. CoRR (2021)
Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang
Scaling Up Vision-Language Pre-training for Image Captioning. CoRR (2021)
Jiajun Deng, Zhengyuan Yang, Tianlang Chen, Wengang Zhou, Houqiang Li
TransVG: End-to-End Visual Grounding with Transformers. ICCV (2021)
Zhengyuan Yang, Tushar Kumar, Tianlang Chen, Jingsong Su, Jiebo Luo
Grounding-Tracking-Integration. IEEE Trans. Circuits Syst. Video Technol. 31 (9) (2021)
Zhengyuan Yang, Songyang Zhang, Liwei Wang, Jiebo Luo
SAT: 2D Semantics Assisted Training for 3D Visual Grounding. ICCV (2021)
Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning. CoRR (2021)
Zhengyuan Yang, Yijuan Lu, Jianfeng Wang, Xi Yin, Dinei Florêncio, Lijuan Wang, Cha Zhang, Lei Zhang, Jiebo Luo
TAP: Text-Aware Pre-Training for Text-VQA and Text-Caption. CVPR (2021)
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang
An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA. CoRR (2021)
Liwei Wang, Jing Huang, Yin Li, Kun Xu, Zhengyuan Yang, Dong Yu
Improving Weakly Supervised Visual Grounding by Contrastive Knowledge Distillation. CVPR (2021)
Jiajun Deng, Zhengyuan Yang, Tianlang Chen, Wengang Zhou, Houqiang Li
TransVG: End-to-End Visual Grounding with Transformers. CoRR (2021)
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang
Crossing the Format Boundary of Text and Boxes: Towards Unified Vision-Language Modeling. CoRR (2021)
Zhengyuan Yang, Yuncheng Li, Linjie Yang, Ning Zhang, Jiebo Luo
Weakly Supervised Body Part Segmentation with Pose based Part Priors. ICPR (2020)
Yongjing Yin, Fandong Meng, Jinsong Su, Chulun Zhou, Zhengyuan Yang, Jie Zhou, Jiebo Luo
A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation. CoRR (2020)
Zhengyuan Yang, Tianlang Chen, Liwei Wang, Jiebo Luo
Improving One-stage Visual Grounding by Recursive Sub-query Construction. CoRR (2020)
Huan Lin, Fandong Meng, Jinsong Su, Yongjing Yin, Zhengyuan Yang, Yubin Ge, Jie Zhou, Jiebo Luo
Dynamic Context-guided Capsule Network for Multimodal Machine Translation. ACM Multimedia (2020)
Huan Lin, Fandong Meng, Jinsong Su, Yongjing Yin, Zhengyuan Yang, Yubin Ge, Jie Zhou, Jiebo Luo
Dynamic Context-guided Capsule Network for Multimodal Machine Translation. CoRR (2020)
Zhengyuan Yang, Tianlang Chen, Liwei Wang, Jiebo Luo
Improving One-Stage Visual Grounding by Recursive Sub-query Construction. ECCV (14) (2020)
Yongjing Yin, Fandong Meng, Jinsong Su, Chulun Zhou, Zhengyuan Yang, Jie Zhou, Jiebo Luo
A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation. ACL (2020)
Zhengyuan Yang, Yijuan Lu, Jianfeng Wang, Xi Yin, Dinei A. F. Florêncio, Lijuan Wang, Cha Zhang, Lei Zhang, Jiebo Luo
TAP: Text-Aware Pre-training for Text-VQA and Text-Caption. CoRR (2020)
Liwei Wang, Jing Huang, Yin Li, Kun Xu, Zhengyuan Yang, Dong Yu
Improving Weakly Supervised Visual Grounding by Contrastive Knowledge Distillation. CoRR (2020)
Zhengyuan Yang, Amanda Kay, Yuncheng Li, Wendi Cross, Jiebo Luo
Pose-based Body Language Recognition for Emotion and Psychiatric Symptom Interpretation. ICPR (2020)
Zhengyuan Yang, Amanda Kay, Yuncheng Li, Wendi Cross, Jiebo Luo
Pose-based Body Language Recognition for Emotion and Psychiatric Symptom Interpretation. CoRR (2020)
Zhengyuan Yang, Tushar Kumar, Tianlang Chen, Jiebo Luo
Grounding-Tracking-Integration. CoRR (2019)
Mengshi Qi, Weijian Li, Zhengyuan Yang, Yunhong Wang, Jiebo Luo
Attentive Relational Networks for Mapping Images to Scene Graphs. CVPR (2019)
Zhengyuan Yang, Boqing Gong, Liwei Wang, Wenbing Huang, Dong Yu, Jiebo Luo
A Fast and Accurate One-Stage Approach to Visual Grounding. CoRR (2019)
Zhengyuan Yang, Yuncheng Li, Jianchao Yang, Jiebo Luo
Action Recognition With Spatio-Temporal Visual Attention on Skeleton Image Sequences. IEEE Trans. Circuits Syst. Video Technol. 29 (8) (2019)
Zhengyuan Yang, Yuncheng Li, Linjie Yang, Ning Zhang, Jiebo Luo
Weakly Supervised Body Part Parsing with Pose based Part Priors. CoRR (2019)
Zhengyuan Yang, Boqing Gong, Liwei Wang, Wenbing Huang, Dong Yu, Jiebo Luo
A Fast and Accurate One-Stage Approach to Visual Grounding. ICCV (2019)
Zhengyuan Yang, Yixuan Zhang, Jiebo Luo
Human-Centered Emotion Recognition in Animated GIFs. ICME (2019)
Zhengyuan Yang, Yixuan Zhang, Jiebo Luo
Human-Centered Emotion Recognition in Animated GIFs. CoRR (2019)
Zhengyuan Yang, Yuncheng Li, Jianchao Yang, Jiebo Luo
Action Recognition with Visual Attention on Skeleton Images. ICPR (2018)
Zhengyuan Yang, Yixuan Zhang, Jerry Yu, Junjie Cai, Jiebo Luo
End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars with Visual Perception. CoRR (2018)
Zhengyuan Yang, Yuncheng Li, Jianchao Yang, Jiebo Luo
Action Recognition with Visual Attention on Skeleton Images. CoRR (2018)
Zhengyuan Yang, Yixuan Zhang, Jerry Yu, Junjie Cai, Jiebo Luo
End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars with Visual Perceptions. ICPR (2018)
Mengshi Qi, Weijian Li, Zhengyuan Yang, Yunhong Wang, Jiebo Luo
Attentive Relational Networks for Mapping Images to Scene Graphs. CoRR (2018)
Zhengyuan Yang, Jiebo Luo
Personalized pose estimation for body language understanding. ICIP (2017)
Zhengyuan Yang, Liyong Shen, Chun-Ming Yuan, Xiao-Shan Gao
Curve fitting and optimal interpolation for CNC machining under confined error using quadratic B-splines. Comput. Aided Des. 66 (2015)