Qin Jin

ORCID

Publication Activity (10 Years)

Years Active: 1998-2024
Publications (10 Years): 210

Top Venues

Publications

Anwen Hu, Haiyang Xu, Jiabo Ye, Ming Yan, Liang Zhang, Bo Zhang, Chen Li, Ji Zhang, Qin Jin, Fei Huang, Jingren Zhou
mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understanding. CoRR (2024)
Zihao Yue, Liang Zhang, Qin Jin
Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective. ACL (1) (2024)
Yuning Wu, Chunlei Zhang, Jiatong Shi, Yuxun Tang, Shan Yang, Qin Jin
TokSing: Singing Voice Synthesis based on Discrete Tokens. CoRR (2024)
Yuxun Tang, Yuning Wu, Jiatong Shi, Qin Jin
SingOMD: Singing Oriented Multi-resolution Discrete Representation Construction from Speech Models. CoRR (2024)
Yuting Mei, Linli Yao, Qin Jin
UBiSS: A Unified Framework for Bimodal Semantic Summarization of Videos. ICMR (2024)
Tenggan Zhang, Xinjie Zhang, Jinming Zhao, Li Zhou, Qin Jin
ESCoT: Towards Interpretable Emotional Support Dialogue Systems. CoRR (2024)
Liang Zhang, Qin Jin, Haoyang Huang, Dongdong Zhang, Furu Wei
Respond in my Language: Mitigating Language Inconsistency in Response Generation based on Large Language Models. ACL (1) (2024)
Dingyi Yang, Chunru Zhan, Ziheng Wang, Biao Wang, Tiezheng Ge, Bo Zheng, Qin Jin
Synchronized Video Storytelling: Generating Video Narrations with Structured Storyline. ACL (1) (2024)
Qingrong He, Kejun Lin, Shizhe Chen, Anwen Hu, Qin Jin
Think-Program-reCtify: 3D Situated Reasoning with Large Language Models. CoRR (2024)
Fengyuan Zhang, Zhaopei Huang, Xinjie Zhang, Qin Jin
Adaptive Temporal Motion Guided Graph Convolution Network for Micro-expression Recognition. CoRR (2024)
Liang Zhang, Anwen Hu, Haiyang Xu, Ming Yan, Yichen Xu, Qin Jin, Ji Zhang, Fei Huang
TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learning. CoRR (2024)
Yawen Zeng, Ning Han, Keyu Pan, Qin Jin
Temporally Language Grounding With Multi-Modal Multi-Prompt Tuning. IEEE Trans. Multim. 26 (2024)
Boshen Xu, Sipeng Zheng, Qin Jin
SPAFormer: Sequential 3D Part Assembly with Transformers. CoRR (2024)
Dingyi Yang, Chunru Zhan, Ziheng Wang, Biao Wang, Tiezheng Ge, Bo Zheng, Qin Jin
Synchronized Video Storytelling: Generating Video Narrations with Structured Storyline. CoRR (2024)
Zhaopei Huang, Jinming Zhao, Qin Jin
ECR-Chain: Advancing Generative Language Models to Better Emotion-Cause Reasoners through Reasoning Chains. CoRR (2024)
Yuting Mei, Linli Yao, Qin Jin
UBiSS: A Unified Framework for Bimodal Semantic Summarization of Videos. CoRR (2024)
Yuxun Tang, Jiatong Shi, Yuning Wu, Qin Jin
SingMOS: An extensive Open-Source Singing Voice Dataset for MOS Prediction. CoRR (2024)
Boshen Xu, Ziheng Wang, Yang Du, Zhinan Song, Sipeng Zheng, Qin Jin
EgoNCE++: Do Egocentric Video-Language Models Really Understand Hand-Object Interactions? CoRR (2024)
Tenggan Zhang, Xinjie Zhang, Jinming Zhao, Li Zhou, Qin Jin
ESCoT: Towards Interpretable Emotional Support Dialogue Systems. ACL (1) (2024)
Xuankai Chang, Jiatong Shi, Jinchuan Tian, Yuning Wu, Yuxun Tang, Yihan Wu, Shinji Watanabe, Yossi Adi, Xie Chen, Qin Jin
The Interspeech 2024 Challenge on Speech Processing Using Discrete Units. CoRR (2024)
Ye Wang, Yuting Mei, Sipeng Zheng, Qin Jin
QuadrupedGPT: Towards a Versatile Quadruped Agent in Open-ended Worlds. CoRR (2024)
Zihao Yue, Yepeng Zhang, Ziheng Wang, Qin Jin
Movie101v2: Improved Movie Narration Benchmark. CoRR (2024)
Boshen Xu, Sipeng Zheng, Qin Jin
POV: Prompt-Oriented View-Agnostic Learning for Egocentric Hand-Object Interaction in the Multi-View World. CoRR (2024)
Jiatong Shi, Yueqian Lin, Xinyi Bai, Keyi Zhang, Yuning Wu, Yuxun Tang, Yifeng Yu, Qin Jin, Shinji Watanabe
Singing Voice Data Scaling-up: An Introduction to ACE-Opencpop and KiSing-v2. CoRR (2024)
Zihao Yue, Liang Zhang, Qin Jin
Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective. CoRR (2024)
Yuchen Liu, Haoyu Zhang, Shichao Liu, Xiang Yin, Zejun Ma, Qin Jin
Emotionally Situated Text-to-Speech Synthesis in User-Agent Conversation. ACM Multimedia (2023)
Anwen Hu, Shizhe Chen, Liang Zhang, Qin Jin
Explore and Tell: Embodied Visual Captioning in 3D Environments. CoRR (2023)
Yuning Wu, Jiatong Shi, Tao Qian, Dongji Gao, Qin Jin
PHONEix: Acoustic Feature Processing Strategy for Enhanced Singing Pronunciation with Phoneme Distribution Predictor. CoRR (2023)
Zihao Yue, Qi Zhang, Anwen Hu, Liang Zhang, Ziheng Wang, Qin Jin
Movie101: A New Movie Understanding Benchmark. ACL (1) (2023)
Tao Qian, Fan Lou, Jiatong Shi, Yuning Wu, Shuai Guo, Xiang Yin, Qin Jin
UniLG: A Unified Structure-aware Framework for Lyrics Generation. ACL (1) (2023)
Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation. CVPR (2023)
Liang Zhang, Anwen Hu, Jing Zhang, Shuo Hu, Qin Jin
MPMQA: Multimodal Question Answering on Product Manuals. AAAI (2023)
Yuning Wu, Jiatong Shi, Tao Qian, Dongji Gao, Qin Jin
Phoneix: Acoustic Feature Processing Strategy for Enhanced Singing Pronunciation With Phoneme Distribution Predictor. ICASSP (2023)
Anwen Hu, Shizhe Chen, Liang Zhang, Qin Jin
Explore and Tell: Embodied Visual Captioning in 3D Environments. ICCV (2023)
Boshen Xu, Sipeng Zheng, Qin Jin
POV: Prompt-Oriented View-Agnostic Learning for Egocentric Hand-Object Interaction in the Multi-view World. ACM Multimedia (2023)
Yuning Wu, Yifeng Yu, Jiatong Shi, Tao Qian, Qin Jin
A Systematic Exploration of Joint-training for Singing Voice Synthesis. CoRR (2023)
Jiabo Ye, Anwen Hu, Haiyang Xu, Qinghao Ye, Ming Yan, Guohai Xu, Chenliang Li, Junfeng Tian, Qi Qian, Ji Zhang, Qin Jin, Liang He, Xin Alex Lin, Fei Huang
UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model. CoRR (2023)
Liang Zhang, Anwen Hu, Jing Zhang, Shuo Hu, Qin Jin
MPMQA: Multimodal Question Answering on Product Manuals. CoRR (2023)
Zhaopei Huang, Jinming Zhao, Qin Jin
Two-Stage Adaptation for Cross-Corpus Multimodal Emotion Recognition. NLPCC (2) (2023)
Linli Yao, Yuanmeng Zhang, Ziheng Wang, Xinglin Hou, Tiezheng Ge, Yuning Jiang, Qin Jin
Edit As You Wish: Video Description Editing with Multi-grained Commands. CoRR (2023)
Weijing Chen, Linli Yao, Qin Jin
Rethinking Benchmarks for Cross-modal Image-text Retrieval. SIGIR (2023)
Yun Zhang, Qi Lu, Qin Jin, Wanting Meng, Shuhu Yang, Shen Huang, Yanling Han, Zhonghua Hong, Zhansheng Chen, Weiliang Liu
Global Sea Surface Height Measurement From CYGNSS Based on Machine Learning. IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens. 16 (2023)
Jieting Chen, Junkai Ding, Wenping Chen, Qin Jin
Knowledge Enhanced Model for Live Video Comment Generation. CoRR (2023)
Ludan Ruan, Anwen Hu, Yuqing Song, Liang Zhang, Sipeng Zheng, Qin Jin
Accommodating Audio Modality in CLIP for Multimodal Processing. CoRR (2023)
Anwen Hu, Shizhe Chen, Liang Zhang, Qin Jin
InfoMetIC: An Informative Metric for Reference-free Image Caption Evaluation. CoRR (2023)
Yuqi Liu, Luhui Xu, Pengfei Xiong, Qin Jin
Token Mixing: Parameter-Efficient Transfer Learning from Image-Language to Video-Language. AAAI (2023)
Hongpeng Lin, Ludan Ruan, Wenke Xia, Peiyu Liu, Jingyuan Wen, Yixin Xu, Di Hu, Ruihua Song, Wayne Xin Zhao, Qin Jin, Zhiwu Lu
TikTalk: A Multi-Modal Dialogue Dataset for Real-World Chitchat. CoRR (2023)
Dingyi Yang, Hongyu Chen, Xinglin Hou, Tiezheng Ge, Yuning Jiang, Qin Jin
Visual Captioning at Will: Describing Images and Videos Guided by a Few Stylized Sentences. CoRR (2023)
Zihao Yue, Qi Zhang, Anwen Hu, Liang Zhang, Ziheng Wang, Qin Jin
Movie101: A New Movie Understanding Benchmark. CoRR (2023)
Dingyi Yang, Hongyu Chen, Xinglin Hou, Tiezheng Ge, Yuning Jiang, Qin Jin
Visual Captioning at Will: Describing Images and Videos Guided by a Few Stylized Sentences. ACM Multimedia (2023)
Weijing Chen, Linli Yao, Qin Jin
Rethinking Benchmarks for Cross-modal Image-text Retrieval. CoRR (2023)
Zihao Yue, Anwen Hu, Liang Zhang, Qin Jin
Learning Descriptive Image Captioning via Semipermeable Maximum Likelihood Estimation. CoRR (2023)
Sipeng Zheng, Boshen Xu, Qin Jin
Open-Category Human-Object Interaction Pre-training via Language Modeling Framework. CVPR (2023)
Linli Yao, Weijing Chen, Qin Jin
CapEnrich: Enriching Caption Semantics for Web Images via Cross-modal Pre-trained Knowledge. WWW (2023)
Ludan Ruan, Anwen Hu, Yuqing Song, Liang Zhang, Sipeng Zheng, Qin Jin
Accommodating Audio Modality in CLIP for Multimodal Processing. AAAI (2023)
Dingyi Yang, Qin Jin
Attractive Storyteller: Stylized Visual Storytelling with Unpaired Text. ACL (1) (2023)
Yawen Zeng, Qin Jin, Tengfei Bao, Wenfeng Li
Multi-Modal Knowledge Hypergraph for Diverse Image Retrieval. AAAI (2023)
Jiabo Ye, Anwen Hu, Haiyang Xu, Qinghao Ye, Ming Yan, Guohai Xu, Chenliang Li, Junfeng Tian, Qi Qian, Ji Zhang, Qin Jin, Liang He, Xin Lin, Fei Huang
UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model. EMNLP (Findings) (2023)
Liang Zhang, Ludan Ruan, Anwen Hu, Qin Jin
Multimodal Pretraining from Monolingual to Multilingual. Mach. Intell. Res. 20 (2) (2023)
Hongpeng Lin, Ludan Ruan, Wenke Xia, Peiyu Liu, Jingyuan Wen, Yixin Xu, Di Hu, Ruihua Song, Wayne Xin Zhao, Qin Jin, Zhiwu Lu
TikTalk: A Video-Based Dialogue Dataset for Multi-Modal Chitchat in Real World. ACM Multimedia (2023)
Anwen Hu, Shizhe Chen, Liang Zhang, Qin Jin
InfoMetIC: An Informative Metric for Reference-free Image Caption Evaluation. ACL (1) (2023)
Qi Zhang, Sipeng Zheng, Qin Jin
No-frills Temporal Video Grounding: Multi-Scale Neighboring Attention and Zoom-in Boundary Detection. CoRR (2023)
Zihao Yue, Anwen Hu, Liang Zhang, Qin Jin
Learning Descriptive Image Captioning via Semipermeable Maximum Likelihood Estimation. NeurIPS (2023)
Jieting Chen, Junkai Ding, Wenping Chen, Qin Jin
Knowledge Enhanced Model for Live Video Comment Generation. ICME (2023)
Yuqing Song, Shizhe Chen, Qin Jin, Wei Luo, Jun Xie, Fei Huang
Enhancing Neural Machine Translation With Dual-Side Multimodal Awareness. IEEE Trans. Multim. 24 (2022)
Jinming Zhao, Tenggan Zhang, Jingwen Hu, Yuchen Liu, Qin Jin, Xinchao Wang, Haizhou Li
M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Database. CoRR (2022)
Yuchen Liu, Jinming Zhao, Jingwen Hu, Ruichen Li, Qin Jin
DialogueEIN: Emotion Interaction Network for Dialogue Affective Analysis. COLING (2022)
Yuwen Chen, Jian Ma, Peihu Zhu, Xiaoming Huang, Qin Jin
Leveraging Trust Relations to Improve Academic Patent Recommendation. HICSS (2022)
Shuai Guo, Jiatong Shi, Tao Qian, Shinji Watanabe, Qin Jin
SingAug: Data Augmentation for Singing Voice Synthesis with Cycle-consistent Training Strategy. CoRR (2022)
Jiatong Shi, Shuai Guo, Tao Qian, Tomoki Hayashi, Yuning Wu, Fangzheng Xu, Xuankai Chang, Huazhe Li, Peter Wu, Shinji Watanabe, Qin Jin
Muskits: an End-to-end Music Processing Toolkit for Singing Voice Synthesis. INTERSPEECH (2022)
Qi Zhang, Zihao Yue, Anwen Hu, Ziheng Wang, Qin Jin
MovieUN: A Dataset for Movie Understanding and Narrating. EMNLP (Findings) (2022)
Qi Zhang, Yuqing Song, Qin Jin
Unifying Event Detection and Captioning as Sequence Generation via Pre-training. ECCV (36) (2022)
Qi Zhang, Yuqing Song, Qin Jin
Unifying Event Detection and Captioning as Sequence Generation via Pre-Training. CoRR (2022)
Linli Yao, Weiying Wang, Qin Jin
Image Difference Captioning with Pre-training and Contrastive Learning. CoRR (2022)
Sipeng Zheng, Qi Zhang, Bei Liu, Qin Jin, Jianlong Fu
Exploring Anchor-based Detection for Ego4D Natural Language Query. CoRR (2022)
Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation. CoRR (2022)
Yida Zhao, Yuqing Song, Qin Jin
Progressive Learning for Image Retrieval with Hybrid-Modality Queries. SIGIR (2022)
Xavier Alameda-Pineda, Qin Jin, Vincent Oria, Laura Toni
M4MM '22: 1st International Workshop on Methodologies for Multimedia. ACM Multimedia (2022)
Sipeng Zheng, Shizhe Chen, Qin Jin
VRDFormer: End-to-End Video Visual Relation Detection with Transformers. CVPR (2022)
Linli Yao, Weiying Wang, Qin Jin
Image Difference Captioning with Pre-training and Contrastive Learning. AAAI (2022)
Jinming Zhao, Tenggan Zhang, Jingwen Hu, Yuchen Liu, Qin Jin, Xinchao Wang, Haizhou Li
M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Database. ACL (1) (2022)
Sipeng Zheng, Shizhe Chen, Qin Jin
Few-Shot Action Recognition with Hierarchical Matching and Contrastive Learning. ECCV (4) (2022)
Yuqi Liu, Pengfei Xiong, Luhui Xu, Shengming Cao, Qin Jin
TS2-Net: Token Shift and Selection Transformer for Text-Video Retrieval. CoRR (2022)
Yuqi Liu, Pengfei Xiong, Luhui Xu, Shengming Cao, Qin Jin
TS2-Net: Token Shift and Selection Transformer for Text-Video Retrieval. ECCV (14) (2022)
Jinming Zhao, Ruichen Li, Qin Jin, Xinchao Wang, Haizhou Li
Memobert: Pre-Training Model with Prompt-Based Learning for Multimodal Emotion Recognition. ICASSP (2022)
Shuai Guo, Jiatong Shi, Tao Qian, Shinji Watanabe, Qin Jin
SingAug: Data Augmentation for Singing Voice Synthesis with Cycle-consistent Training Strategy. INTERSPEECH (2022)
Liyu Meng, Yuchen Liu, Xiaolong Liu, Zhaopei Huang, Yuan Cheng, Meng Wang, Chuanhe Liu, Qin Jin
Multi-modal Emotion Estimation for in-the-wild Videos. CoRR (2022)
Ludan Ruan, Qin Jin
Survey: Transformer based video-language pre-training. AI Open 3 (2022)
Tao Qian, Jiatong Shi, Shuai Guo, Peter Wu, Qin Jin
Training Strategies for Automatic Song Writing: A Unified Framework Perspective. ICASSP (2022)
Liyu Meng, Yuchen Liu, Xiaolong Liu, Zhaopei Huang, Wenqiang Jiang, Tenggan Zhang, Chuanhe Liu, Qin Jin
Valence and Arousal Estimation based on Multimodal Temporal-Aware Features for Videos in the Wild. CVPR Workshops (2022)
Tenggan Zhang, Chuanhe Liu, Xiaolong Liu, Yuchen Liu, Liyu Meng, Lei Sun, Wenqiang Jiang, Fengyuan Zhang, Jinming Zhao, Qin Jin
Multi-Task Learning Framework for Emotion Recognition In-the-Wild. ECCV Workshops (6) (2022)
Jiatong Shi, Shuai Guo, Tao Qian, Nan Huo, Tomoki Hayashi, Yuning Wu, Frank Xu, Xuankai Chang, Huazhe Li, Peter Wu, Shinji Watanabe, Qin Jin
Muskits: an End-to-End Music Processing Toolkit for Singing Voice Synthesis. CoRR (2022)
Liang Zhang, Anwen Hu, Qin Jin
Generalizing Multimodal Pre-training into Multilingual via Language Acquisition. CoRR (2022)
Linli Yao, Weijing Chen, Qin Jin
CapEnrich: Enriching Caption Semantics for Web Images via Cross-modal Pre-trained Knowledge. CoRR (2022)
Liang Zhang, Anwen Hu, Qin Jin
Multi-Lingual Acquisition on Multimodal Pre-training for Cross-modal Retrieval. NeurIPS (2022)
Si Liu, Qin Jin, Luoqi Liu, Zongheng Tang, Linli Lin
PIC'22: 4th Person in Context Workshop. ACM Multimedia (2022)
Yida Zhao, Yuqing Song, Qin Jin
Progressive Learning for Image Retrieval with Hybrid-Modality Queries. CoRR (2022)
Jiatong Shi, Shuai Guo, Nan Huo, Yuekai Zhang, Qin Jin
Sequence-To-Sequence Singing Voice Synthesis With Perceptual Entropy Loss. ICASSP (2021)
Ludan Ruan, Jieting Chen, Yuqing Song, Shizhe Chen, Qin Jin
Team RUC_AIM3 Technical Report at ActivityNet 2021: Entities Object Localization. CoRR (2021)
Anwen Hu, Shizhe Chen, Qin Jin
Question-controlled Text-aware Image Captioning. CoRR (2021)

Qin Jin.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Qin Jin