Xudong Lin

Publication Activity (10 Years)

Years Active: 2018-2024
Publications (10 Years): 58

Top Topics

Event Extraction

Image Retrieval

Top Venues

Publications

Hammad A. Ayyubi, Christopher Thomas, Lovish Chum, Rahul Lokesh, Long Chen, Yulei Niu, Xudong Lin, Xuande Feng, Jaywon Koo, Sounak Ray, Shih-Fu Chang
Beyond Grounding: Extracting Fine-Grained Event Hierarchies across Modalities. AAAI (2024)
Hung-Ting Su, Chun-Tong Chao, Ya-Ching Hsu, Xudong Lin, Yulei Niu, Hung-Yi Lee, Winston H. Hsu
Investigating Video Reasoning Capability of Large Language Models with Tropes in Movies. CoRR (2024)
Xingyu Fu, Yushi Hu, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A. Smith, Wei-Chiu Ma, Ranjay Krishna
BLINK: Multimodal Large Language Models Can See but Not Perceive. CoRR (2024)
Yulei Niu, Wenliang Guo, Long Chen, Xudong Lin, Shih-Fu Chang
SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videos. CoRR (2024)
Yulei Niu, Wenliang Guo, Long Chen, Xudong Lin, Shih-Fu Chang
SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videos. ICLR (2024)
Han Lin, Guangxing Han, Jiawei Ma, Shiyuan Huang, Xudong Lin, Shih-Fu Chang
Supervised Masked Knowledge Distillation for Few-Shot Transformers. CoRR (2023)
Hung-Ting Su, Yulei Niu, Xudong Lin, Winston H. Hsu, Shih-Fu Chang
Language Models are Causal Knowledge Extractors for Zero-shot Video Question Answering. CoRR (2023)
Jinpeng Wang, Yixiao Ge, Rui Yan, Yuying Ge, Kevin Qinghong Lin, Satoshi Tsutsui, Xudong Lin, Guanyu Cai, Jianping Wu, Ying Shan, Xiaohu Qie, Mike Zheng Shou
All in One: Exploring Unified Video-Language Pre-Training. CVPR (2023)
Andrew Lu, Xudong Lin, Yulei Niu, Shih-Fu Chang
In Defense of Structural Symbolic Representation for Video Event-Relation Prediction. CVPR Workshops (2023)
Xudong Lin, Simran Tiwari, Shiyuan Huang, Manling Li, Mike Zheng Shou, Heng Ji, Shih-Fu Chang
Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval. CVPR (2023)
Yu Zhou, Sha Li, Manling Li, Xudong Lin, Shih-Fu Chang, Mohit Bansal, Heng Ji
Non-Sequential Graph Script Induction via Multimedia Grounding. ACL (1) (2023)
Hammad A. Ayyubi, Tianqi Liu, Arsha Nagrani, Xudong Lin, Mingda Zhang, Anurag Arnab, Feng Han, Yukun Zhu, Jialu Liu, Shih-Fu Chang
Video Summarization: Towards Entity-Aware Captions. CoRR (2023)
Han Lin, Guangxing Han, Jiawei Ma, Shiyuan Huang, Xudong Lin, Shih-Fu Chang
Supervised Masked Knowledge Distillation for Few-Shot Transformers. CVPR (2023)
Rui Yan, Mike Zheng Shou, Yixiao Ge, Jinpeng Wang, Xudong Lin, Guanyu Cai, Jinhui Tang
Video-Text Pre-training with Learned Regions for Retrieval. AAAI (2023)
Guang Yang, Manling Li, Jiajie Zhang, Xudong Lin, Heng Ji, Shih-Fu Chang
Video Event Extraction via Tracking Visual States of Arguments. AAAI (2023)
Hung-Ting Su, Yulei Niu, Xudong Lin, Winston H. Hsu, Shih-Fu Chang
Language Models are Causal Knowledge Extractors for Zero-shot Video Question Answering. CVPR Workshops (2023)
Yu Zhou, Sha Li, Manling Li, Xudong Lin, Shih-Fu Chang, Mohit Bansal, Heng Ji
Non-Sequential Graph Script Induction via Multimedia Grounding. CoRR (2023)
Andrew Lu, Xudong Lin, Yulei Niu, Shih-Fu Chang
In Defense of Structural Symbolic Representation for Video Event-Relation Prediction. CoRR (2023)
Yuncong Yang, Jiawei Ma, Shiyuan Huang, Long Chen, Xudong Lin, Guangxing Han, Shih-Fu Chang
TempCLR: Temporal Alignment Representation with Contrastive Learning. ICLR (2023)
Feng Wang, Manling Li, Xudong Lin, Hairong Lv, Alexander G. Schwing, Heng Ji
Learning to Decompose Visual Features with Latent Textual Prompts. ICLR (2023)
Xudong Lin, Simran Tiwari, Shiyuan Huang, Manling Li, Mike Zheng Shou, Heng Ji, Shih-Fu Chang
Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval. CoRR (2022)
Long Chen, Yulei Niu, Brian Chen, Xudong Lin, Guangxing Han, Christopher Thomas, Hammad A. Ayyubi, Heng Ji, Shih-Fu Chang
Weakly-Supervised Temporal Article Grounding. EMNLP (2022)
Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji
Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners. CoRR (2022)
Alex Jinpeng Wang, Yixiao Ge, Rui Yan, Yuying Ge, Xudong Lin, Guanyu Cai, Jianping Wu, Ying Shan, Xiaohu Qie, Mike Zheng Shou
All in One: Exploring Unified Video-Language Pre-training. CoRR (2022)
Alex Jinpeng Wang, Yixiao Ge, Guanyu Cai, Rui Yan, Xudong Lin, Ying Shan, Xiaohu Qie, Mike Zheng Shou
Object-aware Video-language Pre-training for Retrieval. CVPR (2022)
Yuncong Yang, Jiawei Ma, Shiyuan Huang, Long Chen, Xudong Lin, Guangxing Han, Shih-Fu Chang
TempCLR: Temporal Alignment Representation with Contrastive Learning. CoRR (2022)
Xudong Lin, Fabio Petroni, Gedas Bertasius, Marcus Rohrbach, Shih-Fu Chang, Lorenzo Torresani
Learning To Recognize Procedural Activities with Distant Supervision. CoRR (2022)
Long Chen, Yulei Niu, Brian Chen, Xudong Lin, Guangxing Han, Christopher Thomas, Hammad A. Ayyubi, Heng Ji, Shih-Fu Chang
Weakly-Supervised Temporal Article Grounding. CoRR (2022)
Revanth Gangi Reddy, Xilin Rui, Manling Li, Xudong Lin, Haoyang Wen, Jaemin Cho, Lifu Huang, Mohit Bansal, Avirup Sil, Shih-Fu Chang, Alexander G. Schwing, Heng Ji
MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding. AAAI (2022)
Feng Wang, Manling Li, Xudong Lin, Hairong Lv, Alexander G. Schwing, Heng Ji
Learning to Decompose Visual Features with Latent Textual Prompts. CoRR (2022)
Guanyu Cai, Yixiao Ge, Alex Jinpeng Wang, Rui Yan, Xudong Lin, Ying Shan, Lianghua He, Xiaohu Qie, Jianping Wu, Mike Zheng Shou
Revitalize Region Feature for Democratizing Video-Language Pre-training. CoRR (2022)
Xudong Lin, Fabio Petroni, Gedas Bertasius, Marcus Rohrbach, Shih-Fu Chang, Lorenzo Torresani
Learning To Recognize Procedural Activities with Distant Supervision. CVPR (2022)
Hammad A. Ayyubi, Christopher Thomas, Lovish Chum, Rahul Lokesh, Yulei Niu, Xudong Lin, Long Chen, Jaywon Koo, Sounak Ray, Shih-Fu Chang
Multimodal Event Graphs: Towards Event Centric Understanding of Multimodal World. CoRR (2022)
Guang Yang, Manling Li, Jiajie Zhang, Xudong Lin, Shih-Fu Chang, Heng Ji
Video Event Extraction via Tracking Visual States of Arguments. CoRR (2022)
Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
CLIP-Event: Connecting Text and Images with Event Structures. CoRR (2022)
Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji
Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners. NeurIPS (2022)
Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
CLIP-Event: Connecting Text and Images with Event Structures. CVPR (2022)
Brian Chen, Xudong Lin, Christopher Thomas, Manling Li, Shoya Yoshida, Lovish Chum, Heng Ji, Shih-Fu Chang
Joint Multimedia Event Extraction from Video and Article. CoRR (2021)
Rui Yan, Mike Zheng Shou, Yixiao Ge, Alex Jinpeng Wang, Xudong Lin, Guanyu Cai, Jinhui Tang
Video-Text Pre-training with Learned Regions. CoRR (2021)
Sijie Song, Xudong Lin, Jiaying Liu, Zongming Guo, Shih-Fu Chang
Co-Grounding Networks with Semantic Attention for Referring Expression Comprehension in Videos. CoRR (2021)
Brian Chen, Xudong Lin, Christopher Thomas, Manling Li, Shoya Yoshida, Lovish Chum, Heng Ji, Shih-Fu Chang
Joint Multimedia Event Extraction from Video and Article. EMNLP (Findings) (2021)
Alex Jinpeng Wang, Yixiao Ge, Guanyu Cai, Rui Yan, Xudong Lin, Ying Shan, Xiaohu Qie, Mike Zheng Shou
Object-aware Video-language Pre-training for Retrieval. CoRR (2021)
Xudong Lin, Gedas Bertasius, Jue Wang, Shih-Fu Chang, Devi Parikh, Lorenzo Torresani
VX2TEXT: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs. CoRR (2021)
Sijie Song, Xudong Lin, Jiaying Liu, Zongming Guo, Shih-Fu Chang
Co-Grounding Networks With Semantic Attention for Referring Expression Comprehension in Videos. CVPR (2021)
Haoyang Wen, Ying Lin, Tuan Lai, Xiaoman Pan, Sha Li, Xudong Lin, Ben Zhou, Manling Li, Haoyu Wang, Hongming Zhang, Xiaodong Yu, Alexander Dong, Zhenhailong Wang, Yi Fung, Piyush Mishra, Qing Lyu, Dídac Surís, Brian Chen, Susan Windisch Brown, Martha Palmer, Chris Callison-Burch, Carl Vondrick, Jiawei Han, Dan Roth, Shih-Fu Chang, Heng Ji
RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System. NAACL-HLT (Demonstrations) (2021)
Xudong Lin, Gedas Bertasius, Jue Wang, Shih-Fu Chang, Devi Parikh, Lorenzo Torresani
Vx2Text: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs. CVPR (2021)
Revanth Gangi Reddy, Xilin Rui, Manling Li, Xudong Lin, Haoyang Wen, Jaemin Cho, Lifu Huang, Mohit Bansal, Avirup Sil, Shih-Fu Chang, Alexander G. Schwing, Heng Ji
MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding. CoRR (2021)
Xudong Lin, Lin Ma, Wei Liu, Shih-Fu Chang
Context-Gated Convolution. ECCV (18) (2020)
Zheng Shou, Zhicheng Yan, Yannis Kalantidis, Laura Sevilla-Lara, Marcus Rohrbach, Xudong Lin, Shih-Fu Chang
DMC-Net: Generating Discriminative Motion Cues for Fast Compressed Video Action Recognition. CoRR (2019)
Zheng Shou, Xudong Lin, Yannis Kalantidis, Laura Sevilla-Lara, Marcus Rohrbach, Shih-Fu Chang, Zhicheng Yan
DMC-Net: Generating Discriminative Motion Cues for Fast Compressed Video Action Recognition. CVPR (2019)
Svebor Karaman, Xudong Lin, Xuefeng Hu, Shih-Fu Chang
Unsupervised Rank-Preserving Hashing for Large-Scale Image Retrieval. ICMR (2019)
Shiyuan Huang, Xudong Lin, Svebor Karaman, Shih-Fu Chang
Flow-Distilled IP Two-Stream Networks for Compressed Video Action Recognition. CoRR (2019)
Xudong Lin, Lin Ma, Wei Liu, Shih-Fu Chang
Context-Gated Convolution. CoRR (2019)
Svebor Karaman, Xudong Lin, Xuefeng Hu, Shih-Fu Chang
Unsupervised Rank-Preserving Hashing for Large-Scale Image Retrieval. CoRR (2019)
Xudong Lin, Zheng Shou, Shih-Fu Chang
LPAT: Learning to Predict Adaptive Threshold for Weakly-supervised Temporal Action Localization. CoRR (2019)
Xudong Lin, Yueqi Duan, Qiyuan Dong, Jiwen Lu, Jie Zhou
Deep Variational Metric Learning. ECCV (15) (2018)
Yueqi Duan, Ziwei Wang, Jiwen Lu, Xudong Lin, Jie Zhou
GraphBit: Bitwise Interaction Mining via Deep Reinforcement Learning. CVPR (2018)
Yueqi Duan, Wenzhao Zheng, Xudong Lin, Jiwen Lu, Jie Zhou
Deep Adversarial Metric Learning. CVPR (2018)