Pengchuan Zhang

Publication Activity (10 Years)

Years Active: 2017-2024
Publications (10 Years): 89

Top Topics

Image Generation

Positive Semidefinite

Stochastic Gradient

Top Venues

Publications

Baiqi Li, Zhiqiu Lin, Deepak Pathak, Jiayao Li, Yixin Fei, Kewen Wu, Tiffany Ling, Xide Xia, Pengchuan Zhang, Graham Neubig, Deva Ramanan
GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generation. CoRR (2024)
Kevin Qinghong Lin, Pengchuan Zhang, Difei Gao, Xide Xia, Joya Chen, Ziteng Gao, Jinheng Xie, Xuhong Xiao, Mike Zheng Shou
Learning Video Context as Interleaved Multimodal Sequences. CoRR (2024)
Yunhao Ge, Yihe Tang, Jiashu Xu, Cem Gokmen, Chengshu Li, Wensi Ai, Benjamin Jose Martinez, Arman Aydin, Mona Anvari, Ayush K. Chakravarthy, Hong-Xing Yu, Josiah Wong, Sanjana Srivastava, Sharon Lee, Shengxin Zha, Laurent Itti, Yunzhu Li, Roberto Martín-Martín, Miao Liu, Pengchuan Zhang, Ruohan Zhang, Li Fei-Fei, Jiajun Wu
BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation. CoRR (2024)
Zhiqiu Lin, Deepak Pathak, Baiqi Li, Jiayao Li, Xide Xia, Graham Neubig, Pengchuan Zhang, Deva Ramanan
Evaluating Text-to-Visual Generation with Image-to-Text Generation. CoRR (2024)
Kevin Qinghong Lin, Pengchuan Zhang, Joya Chen, Shraman Pramanick, Difei Gao, Alex Jinpeng Wang, Rui Yan, Mike Zheng Shou
UniVTG: Towards Unified Video-Language Temporal Grounding. CoRR (2023)
Ximeng Sun, Pengchuan Zhang, Peizhao Zhang, Hardik Shah, Kate Saenko, Xide Xia
DIME-FM : DIstilling Multimodal and Efficient Foundation Models. ICCV (2023)
Mohamed Afham, Satya Narayan Shukla, Omid Poursaeed, Pengchuan Zhang, Ashish Shah, Sernam Lim
Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understanding. ICCV (Workshops) (2023)
Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang
Parameter-Efficient Model Adaptation for Vision Transformers. AAAI (2023)
Ximeng Sun, Pengchuan Zhang, Peizhao Zhang, Hardik Shah, Kate Saenko, Xide Xia
DIME-FM: DIstilling Multimodal and Efficient Foundation Models. CoRR (2023)
Harman Singh, Pengchuan Zhang, Qifan Wang, Mengjiao Wang, Wenhan Xiong, Jingfei Du, Yu Chen
Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality. CoRR (2023)
Zhiqiu Lin, Xinyue Chen, Deepak Pathak, Pengchuan Zhang, Deva Ramanan
VisualGPTScore: Visio-Linguistic Reasoning with Multimodal Generative Pre-Training Scores. CoRR (2023)
Yifan Wu, Pengchuan Zhang, Wenhan Xiong, Barlas Oguz, James C. Gee, Yixin Nie
The Role of Chain-of-Thought in Complex Vision-Language Reasoning Task. CoRR (2023)
Mohamed Afham, Satya Narayan Shukla, Omid Poursaeed, Pengchuan Zhang, Ashish Shah, Sernam Lim
Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understanding. CoRR (2023)
Shraman Pramanick, Yale Song, Sayan Nag, Kevin Qinghong Lin, Hardik Shah, Mike Zheng Shou, Rama Chellappa, Pengchuan Zhang
EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone. ICCV (2023)
Shraman Pramanick, Yale Song, Sayan Nag, Kevin Qinghong Lin, Hardik Shah, Mike Zheng Shou, Rama Chellappa, Pengchuan Zhang
EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone. CoRR (2023)
Kevin Qinghong Lin, Pengchuan Zhang, Joya Chen, Shraman Pramanick, Difei Gao, Alex Jinpeng Wang, Rui Yan, Mike Zheng Shou
UniVTG: Towards Unified Video-Language Temporal Grounding. ICCV (2023)
Harman Singh, Pengchuan Zhang, Qifan Wang, Mengjiao Wang, Wenhan Xiong, Jingfei Du, Yu Chen
Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality. EMNLP (2023)
Lingchen Meng, Xiyang Dai, Yinpeng Chen, Pengchuan Zhang, Dongdong Chen, Mengchen Liu, Jianfeng Wang, Zuxuan Wu, Lu Yuan, Yu-Gang Jiang
Detection Hub: Unifying Object Detection Datasets via Query Adaptation on Language Embedding. CVPR (2023)
Jun Chen, Deyao Zhu, Xiaoqian Shen, Xiang Li, Zechun Liu, Pengchuan Zhang, Raghuraman Krishnamoorthi, Vikas Chandra, Yunyang Xiong, Mohamed Elhoseiny
MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning. CoRR (2023)
Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang, Lijuan Wang, Chenguang Zhu, Pengchuan Zhang, Lu Yuan, Nanyun Peng, Zicheng Liu, Michael Zeng
An Empirical Study of Training End-to-End Vision-and-Language Transformers. CVPR (2022)
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models. CoRR (2022)
Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
RegionCLIP: Region-based Language-Image Pretraining. CVPR (2022)
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Anna Rohrbach, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Jianfeng Gao
K-LITE: Learning Transferable Visual Models with External Knowledge. CoRR (2022)
Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry
Missingness Bias in Model Debugging. ICLR (2022)
Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
GLIPv2: Unifying Localization and Vision-Language Understanding. CoRR (2022)
Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone. CoRR (2022)
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
Grounded Language-Image Pre-training. CVPR (2022)
Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone. NeurIPS (2022)
Lingchen Meng, Xiyang Dai, Yinpeng Chen, Pengchuan Zhang, Dongdong Chen, Mengchen Liu, Jianfeng Wang, Zuxuan Wu, Lu Yuan, Yu-Gang Jiang
Detection Hub: Unifying Object Detection Datasets via Query Adaptation on Language Embedding. CoRR (2022)
Guillaume Leclerc, Hadi Salman, Andrew Ilyas, Sai Vemprala, Logan Engstrom, Vibhav Vineet, Kai Yuanqing Xiao, Pengchuan Zhang, Shibani Santurkar, Greg Yang, Ashish Kapoor, Aleksander Madry
3DB: A Framework for Debugging Computer Vision Models. NeurIPS (2022)
Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry
Missingness Bias in Model Debugging. CoRR (2022)
Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
Efficient Self-supervised Vision Transformers for Representation Learning. ICLR (2022)
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
Unified Contrastive Learning in Image-Text-Label Space. CoRR (2022)
Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
GLIPv2: Unifying Localization and Vision-Language Understanding. NeurIPS (2022)
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Houdong Hu, Zicheng Liu, Yong Jae Lee, Jianfeng Gao
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models. NeurIPS (2022)
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
Unified Contrastive Learning in Image-Text-Label Space. CVPR (2022)
Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang
Parameter-efficient Fine-tuning for Vision Transformers. CoRR (2022)
Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
K-LITE: Learning Transferable Visual Models with External Knowledge. NeurIPS (2022)
Peirong Liu, Rui Wang, Pengchuan Zhang, Omid Poursaeed, Yipin Zhou, Xuefei Cao, Sreya Dutta Roy, Ashish Shah, Ser-Nam Lim
A Unified Model for Tracking and Image-Video Detection Has More Power. CoRR (2022)
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao
Focal Attention for Long-Range Interactions in Vision Transformers. NeurIPS (2021)
Shumao Zhang, Pengchuan Zhang, Thomas Y. Hou
Multiscale Invertible Generative Networks for High-Dimensional Bayesian Inference. ICML (2021)
Xiaotian Han, Jianwei Yang, Houdong Hu, Lei Zhang, Jianfeng Gao, Pengchuan Zhang
Image Scene Graph Generation (SGG) Benchmark. CoRR (2021)
Shumao Zhang, Pengchuan Zhang, Thomas Y. Hou
Multiscale Invertible Generative Networks for High-Dimensional Bayesian Inference. CoRR (2021)
Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang, Lijuan Wang, Chenguang Zhu, Pengchuan Zhang, Lu Yuan, Nanyun Peng, Zicheng Liu, Michael Zeng
An Empirical Study of Training End-to-End Vision-and-Language Transformers. CoRR (2021)
Xiyang Dai, Yinpeng Chen, Jianwei Yang, Pengchuan Zhang, Lu Yuan, Lei Zhang
Dynamic DETR: End-to-End Object Detection with Dynamic Attention. ICCV (2021)
Guillaume Leclerc, Hadi Salman, Andrew Ilyas, Sai Vemprala, Logan Engstrom, Vibhav Vineet, Kai Yuanqing Xiao, Pengchuan Zhang, Shibani Santurkar, Greg Yang, Ashish Kapoor, Aleksander Madry
3DB: A Framework for Debugging Computer Vision Models. CoRR (2021)
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
VinVL: Making Visual Representations Matter in Vision-Language Models. CoRR (2021)
Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding. CoRR (2021)
Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao
Focal Self-attention for Local-Global Interactions in Vision Transformers. CoRR (2021)
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
Grounded Language-Image Pre-training. CoRR (2021)
Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
RegionCLIP: Region-based Language-Image Pretraining. CoRR (2021)
Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
Florence: A New Foundation Model for Computer Vision. CoRR (2021)
Tristan Sylvain, Pengchuan Zhang, Yoshua Bengio, R. Devon Hjelm, Shikhar Sharma
Object-Centric Image Generation from Layouts. AAAI (2021)
Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
Efficient Self-supervised Vision Transformers for Representation Learning. CoRR (2021)
Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding. ICCV (2021)
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
VinVL: Revisiting Visual Representations in Vision-Language Models. CVPR (2021)
Ruocheng Guo, Pengchuan Zhang, Hao Liu, Emre Kiciman
Out-of-distribution Prediction with Invariant Risk Minimization: The Limitation and An Effective Fix. CoRR (2021)
Yi Wei, Zhe Gan, Wenbo Li, Siwei Lyu, Ming-Ching Chang, Lei Zhang, Jianfeng Gao, Pengchuan Zhang
MagGAN: High-Resolution Face Attribute Editing with Mask-Guided Generative Adversarial Network. ACCV (4) (2020)
Tristan Sylvain, Pengchuan Zhang, Yoshua Bengio, R. Devon Hjelm, Shikhar Sharma
Object-Centric Image Generation from Layouts. CoRR (2020)
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks. ECCV (30) (2020)
Yi Wei, Zhe Gan, Wenbo Li, Siwei Lyu, Ming-Ching Chang, Lei Zhang, Jianfeng Gao, Pengchuan Zhang
MagGAN: High-Resolution Face Attribute Editing with Mask-Guided Generative Adversarial Network. CoRR (2020)
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
MiniVLM: A Smaller and Faster Vision-Language Model. CoRR (2020)
Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang
Novel Human-Object Interaction Detection via Adversarial Domain Generalization. CoRR (2020)
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks. CoRR (2020)
Pengchuan Zhang, Hunter Lang, Qiang Liu, Lin Xiao
Statistical Adaptive Stochastic Gradient Methods. CoRR (2020)
Huan Zhang, Pengchuan Zhang, Cho-Jui Hsieh
RecurJac: An Efficient Recursive Algorithm for Bounding Jacobian Matrix of Neural Networks and Its Applications. AAAI (2019)
Hadi Salman, Greg Yang, Huan Zhang, Cho-Jui Hsieh, Pengchuan Zhang
A Convex Relaxation Barrier to Tight Robustness Verification of Neural Networks. CoRR (2019)
Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao
Object-Driven Text-To-Image Synthesis via Adversarial Training. CVPR (2019)
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
TIGEr: Text-to-Image Grounding for Image Caption Evaluation. CoRR (2019)
Hunter Lang, Pengchuan Zhang, Lin Xiao
Using Statistics to Automate Stochastic Optimization. CoRR (2019)
Hadi Salman, Jerry Li, Ilya P. Razenshteyn, Pengchuan Zhang, Huan Zhang, Sébastien Bubeck, Greg Yang
Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers. NeurIPS (2019)
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
TIGEr: Text-to-Image Grounding for Image Caption Evaluation. EMNLP/IJCNLP (1) (2019)
Igor Gitman, Hunter Lang, Pengchuan Zhang, Lin Xiao
Understanding the Role of Momentum in Stochastic Gradient Methods. CoRR (2019)
Hunter Lang, Lin Xiao, Pengchuan Zhang
Using Statistics to Automate Stochastic Optimization. NeurIPS (2019)
Hadi Salman, Greg Yang, Jerry Li, Pengchuan Zhang, Huan Zhang, Ilya P. Razenshteyn, Sébastien Bubeck
Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers. CoRR (2019)
Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao
Object-driven Text-to-Image Synthesis via Adversarial Training. CoRR (2019)
Igor Gitman, Hunter Lang, Pengchuan Zhang, Lin Xiao
Understanding the Role of Momentum in Stochastic Gradient Methods. NeurIPS (2019)
Hadi Salman, Greg Yang, Huan Zhang, Cho-Jui Hsieh, Pengchuan Zhang
A Convex Relaxation Barrier to Tight Robustness Verification of Neural Networks. NeurIPS (2019)
Huan Zhang, Pengchuan Zhang, Cho-Jui Hsieh
RecurJac: An Efficient Recursive Algorithm for Bounding Jacobian Matrix of Neural Networks and Its Applications. CoRR (2018)
Qiuyuan Huang, Pengchuan Zhang, Dapeng Oliver Wu, Lei Zhang
Turbo Learning for CaptionBot and DrawingBot. NeurIPS (2018)
Woon Sang Cho, Pengchuan Zhang, Yizhe Zhang, Xiujun Li, Michel Galley, Mengdi Wang, Jianfeng Gao
A bird's-eye view on coherence, and a worm's-eye view on cohesion. CoRR (2018)
Qiuyuan Huang, Pengchuan Zhang, Dapeng Oliver Wu, Lei Zhang
Turbo Learning for Captionbot and Drawingbot. CoRR (2018)
Thomas Y. Hou, De Huang, Ka Chun Lam, Pengchuan Zhang
An Adaptive Fast Solver for a General Class of Positive Definite Matrices Via Energy Decomposition. Multiscale Model. Simul. 16 (2) (2018)
Tao Xu, Pengchuan Zhang, Qiuyuan Huang, Han Zhang, Zhe Gan, Xiaolei Huang, Xiaodong He
AttnGAN: Fine-Grained Text to Image Generation With Attentional Generative Adversarial Networks. CVPR (2018)
Pengchuan Zhang, Qiang Liu, Dengyong Zhou, Tao Xu, Xiaodong He
On the Discrimination-Generalization Tradeoff in GANs. ICLR (Poster) (2018)
Thomas Y. Hou, Qin Li, Pengchuan Zhang
Exploring the Locally Low Dimensional Structure in Solving Random Elliptic PDEs. Multiscale Model. Simul. 15 (2) (2017)
Pengchuan Zhang, Qiang Liu, Dengyong Zhou, Tao Xu, Xiaodong He
On the Discrimination-Generalization Tradeoff in GANs. CoRR (2017)
Tao Xu, Pengchuan Zhang, Qiuyuan Huang, Han Zhang, Zhe Gan, Xiaolei Huang, Xiaodong He
AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks. CoRR (2017)
Thomas Y. Hou, Qin Li, Pengchuan Zhang
A Sparse Decomposition of Low Rank Symmetric Positive Semidefinite Matrices. Multiscale Model. Simul. 15 (1) (2017)