Yong Man Ro

ORCID

Publication Activity (10 Years)

Years Active: 1995-2024
Publications (10 Years): 219

Top Venues

CoRR

ICIP

ICASSP

IEEE Trans. Circuits Syst. Video Technol.

Publications

Byung-Kwan Lee, Beomchan Park, Chae Won Kim, Yong Man Ro
CoLLaVO: Crayon Large Language and Vision mOdel. CoRR (2024)
Taeheon Kim, Sangyun Chung, Damin Yeom, Youngjoon Yu, Hak Gu Kim, Yong Man Ro
MSCoTDet: Language-driven Multi-modal Fusion for Improved Multispectral Pedestrian Detection. CoRR (2024)
Sungjune Park, Hyunjun Kim, Yong Man Ro
Robust Pedestrian Detection via Constructing Versatile Pedestrian Knowledge Bank. CoRR (2024)
Minsu Kim, Jeong Hun Yeo, Jeongsoo Choi, Se Jin Park, Yong Man Ro
Multilingual Visual Speech Recognition with a Single Model by Learning with Discrete Visual Speech Units. CoRR (2024)
Junho Kim, Yeonju Kim, Yong Man Ro
What if...?: Counterfactual Inception to Mitigate Hallucination Effects in Large Multimodal Models. CoRR (2024)
Byung-Kwan Lee, Beomchan Park, Chae Won Kim, Yong Man Ro
MoAI: Mixture of All Intelligence for Large Language and Vision Models. CoRR (2024)
Sangmin Lee, Hyung-Il Kim, Yong Man Ro
Text-guided distillation learning to diversify video embeddings for text-video retrieval. Pattern Recognit. 156 (2024)
Jeong Hun Yeo, Seunghee Han, Minsu Kim, Yong Man Ro
Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing. CoRR (2024)
Byung-Kwan Lee, Beomchan Park, Chae Won Kim, Yong Man Ro
CoLLaVO: Crayon Large Language and Vision mOdel. ACL (Findings) (2024)
Sungjune Park, Hyunjun Kim, Yong Man Ro
Robust pedestrian detection via constructing versatile pedestrian knowledge bank. Pattern Recognit. 153 (2024)
Seunghee Han, Se Jin Park, Chae Won Kim, Yong Man Ro
Persona Extraction Through Semantic Similarity for Emotional Support Conversation Generation. ICASSP (2024)
Minsu Kim, Jeongsoo Choi, Soumi Maiti, Jeong Hun Yeo, Shinji Watanabe, Yong Man Ro
Towards Practical and Efficient Image-to-Speech Captioning with Vision-Language Pre-Training and Multi-Modal Tokens. ICASSP (2024)
Seunghee Han, Se Jin Park, Chae Won Kim, Yong Man Ro
Persona Extraction Through Semantic Similarity for Emotional Support Conversation Generation. CoRR (2024)
Byung-Kwan Lee, Chae Won Kim, Beomchan Park, Yong Man Ro
Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models. CoRR (2024)
Se Jin Park, Minsu Kim, Jeongsoo Choi, Yong Man Ro
Exploring Phonetic Context-Aware Lip-Sync for Talking Face Generation. ICASSP (2024)
Se Jin Park, Chae Won Kim, Hyeongseop Rha, Minsu Kim, Joanna Hong, Jeong Hun Yeo, Yong Man Ro
Let's Go Real Talk: Spoken Dialogue Model for Face-to-Face Conversation. CoRR (2024)
Seongyeop Kim, Hyung-Il Kim, Yong Man Ro
Improving Open Set Recognition via Visual Prompts Distilled from Common-Sense Knowledge. AAAI (2024)
Byung-Kwan Lee, Sangyun Chung, Chae Won Kim, Beomchan Park, Yong Man Ro
TroL: Traversal of Layers for Large Language and Vision Models. CoRR (2024)
Jeong Hun Yeo, Minsu Kim, Jeongsoo Choi, Dae Hoe Kim, Yong Man Ro
AKVSR: Audio Knowledge Empowered Visual Speech Recognition by Compressing Audio Knowledge of a Pretrained Model. IEEE Trans. Multim. 26 (2024)
Jeong Hun Yeo, Minsu Kim, Shinji Watanabe, Yong Man Ro
Visual Speech Recognition for Languages with Limited Labeled Data Using Automatic Labels from Whisper. ICASSP (2024)
Minsu Kim, Jee-weon Jung, Hyeongseop Rha, Soumi Maiti, Siddhant Arora, Xuankai Chang, Shinji Watanabe, Yong Man Ro
TMT: Tri-Modal Translation between Speech, Image, and Text by Processing Different Modalities as Different Languages. CoRR (2024)
Taeheon Kim, Sebin Shin, Youngjoon Yu, Hak Gu Kim, Yong Man Ro
Causal Mode Multiplexer: A Novel Framework for Unbiased Multispectral Pedestrian Detection. CoRR (2024)
Junho Kim, Hyunjun Kim, Yeonju Kim, Yong Man Ro
CODE: Contrasting Self-generated Description to Combat Hallucination in Large Multi-modal Models. CoRR (2024)
Jeongsoo Choi, Minsu Kim, Se Jin Park, Yong Man Ro
Text-Driven Talking Face Synthesis by Reprogramming Audio-Driven Models. ICASSP (2024)
Hong Joo Lee, Youngjoon Yu, Yong Man Ro
Advancing Adversarial Training by Injecting Booster Signal. CoRR (2023)
Jeongsoo Choi, Minsu Kim, Yong Man Ro
Intelligible Lip-to-Speech Synthesis with Speech Units. INTERSPEECH (2023)
Minsu Kim, Jeongsoo Choi, Dahun Kim, Yong Man Ro
Many-to-Many Spoken Language Translation via Unified Speech and Text Representation Learning with Unit-to-Unit Translation. CoRR (2023)
Byung-Kwan Lee, Junho Kim, Yong Man Ro
Mitigating Adversarial Vulnerability through Causal Parameter Estimation by Adversarial Double Machine Learning. ICCV (2023)
Joanna Hong, Se Jin Park, Yong Man Ro
Intuitive Multilingual Audio-Visual Speech Recognition with a Single-Trained Model. CoRR (2023)
Jeong Hun Yeo, Minsu Kim, Yong Man Ro
Multi-Temporal Lip-Audio Memory for Visual Speech Recognition. ICASSP (2023)
Jeong Hun Yeo, Minsu Kim, Shinji Watanabe, Yong Man Ro
Visual Speech Recognition for Low-resource Languages with Automatic Labels From Whisper Model. CoRR (2023)
Minsu Kim, Joanna Hong, Yong Man Ro
Lip-to-Speech Synthesis in the Wild with Multi-task Learning. CoRR (2023)
Se Jin Park, Minsu Kim, Jeongsoo Choi, Yong Man Ro
Exploring Phonetic Context in Lip Movement for Authentic Talking Face Generation. CoRR (2023)
Hong Joo Lee, Yong Man Ro
Robust Proxy: Improving Adversarial Robustness by Robust Proxy Learning. CoRR (2023)
Jeongsoo Choi, Minsu Kim, Se Jin Park, Yong Man Ro
Reprogramming Audio-driven Talking Face Synthesis into Text-driven. CoRR (2023)
Taeheon Kim, Youngjoon Yu, Yong Man Ro
Multispectral Invisible Coating: Laminated Visible-Thermal Physical Attack against Multispectral Object Detectors Using Transparent Low-E Films. AAAI (2023)
Jeongsoo Choi, Se Jin Park, Minsu Kim, Yong Man Ro
AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation. CoRR (2023)
Joanna Hong, Se Jin Park, Yong Man Ro
Intuitive Multilingual Audio-Visual Speech Recognition with a Single-Trained Model. EMNLP (Findings) (2023)
Junho Kim, Byung-Kwan Lee, Yong Man Ro
Causal Unsupervised Semantic Segmentation. CoRR (2023)
Jeongsoo Choi, Minsu Kim, Yong Man Ro
Intelligible Lip-to-Speech Synthesis with Speech Units. CoRR (2023)
Joanna Hong, Minsu Kim, Jeongsoo Choi, Yong Man Ro
Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoring. CoRR (2023)
Minsu Kim, Joanna Hong, Yong Man Ro
Lip-to-Speech Synthesis in the Wild with Multi-Task Learning. ICASSP (2023)
Hong Joo Lee, Yong Man Ro
Robust Proxy: Improving Adversarial Robustness by Robust Proxy Learning. IEEE Trans. Inf. Forensics Secur. 18 (2023)
Byung-Kwan Lee, Junho Kim, Yong Man Ro
Mitigating Adversarial Vulnerability through Causal Parameter Estimation by Adversarial Double Machine Learning. CoRR (2023)
Minsu Kim, Chae Won Kim, Yong Man Ro
Deep Visual Forced Alignment: Learning to Align Transcription with Talking Face Video. AAAI (2023)
Jeong Hun Yeo, Minsu Kim, Yong Man Ro
Multi-Temporal Lip-Audio Memory for Visual Speech Recognition. CoRR (2023)
Junho Kim. Byung-Kwan Lee, Yong Man Ro
Demystifying Causal Features on Adversarial Examples and Causal Inoculation for Robust Network by Adversarial Instrumental Variable Regression. CoRR (2023)
Jeongsoo Choi, Joanna Hong, Yong Man Ro
DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embedding. CoRR (2023)
Minsu Kim, Jeong Hun Yeo, Jeongsoo Choi, Yong Man Ro
Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge. ICCV (2023)
Sungjune Park, Hyunjun Kim, Yong Man Ro
Incorporating Language-Driven Appearance Knowledge Units with Visual Cues in Pedestrian Detection. CoRR (2023)
Se Jin Park, Joanna Hong, Minsu Kim, Yong Man Ro
DF-3DFace: One-to-Many Speech Synchronized 3D Face Animation with Diffusion. CoRR (2023)
Minsu Kim, Jeongsoo Choi, Soumi Maiti, Jeong Hun Yeo, Shinji Watanabe, Yong Man Ro
Towards Practical and Efficient Image-to-Speech Captioning with Vision-Language Pre-training and Multi-modal Tokens. CoRR (2023)
Yeonju Kim, Junho Kim, Byung-Kwan Lee, Sebin Shin, Yong Man Ro
Mitigating Dataset Bias in Image Captioning Through Clip Confounder-Free Captioning Network. ICIP (2023)
Minsu Kim, Jeong Hun Yeo, Jeongsoo Choi, Yong Man Ro
Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge. CoRR (2023)
Junho Kim, Byung-Kwan Lee, Yong Man Ro
Demystifying Causal Features on Adversarial Examples and Causal Inoculation for Robust Network by Adversarial Instrumental Variable Regression. CVPR (2023)
Minsu Kim, Hyung-Il Kim, Yong Man Ro
Prompt Tuning of Deep Neural Networks for Speaker-adaptive Visual Speech Recognition. CoRR (2023)
Jeong Hun Yeo, Minsu Kim, Jeongsoo Choi, Dae Hoe Kim, Yong Man Ro
AKVSR: Audio Knowledge Empowered Visual Speech Recognition by Compressing Audio Knowledge of a Pretrained Model. CoRR (2023)
Hakmin Lee, Yong Man Ro
Adversarial anchor-guided feature refinement for adversarial defense. Image Vis. Comput. 136 (2023)
Jung Uk Kim, Yong Man Ro
Similarity Relation Preserving Cross-Modal Learning for Multispectral Pedestrian Detection Against Adversarial Attacks. ICASSP (2023)
Joanna Hong, Minsu Kim, Jeongsoo Choi, Yong Man Ro
Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoring. CVPR (2023)
Jeongsoo Choi, Joanna Hong, Yong Man Ro
DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embedding. ICCV (2023)
Jung Uk Kim, Hyung-Il Kim, Yong Man Ro
Stereoscopic Vision Recalling Memory for Monocular 3D Object Detection. IEEE Trans. Image Process. 32 (2023)
Sungjune Park, Jung Uk Kim, Jin Mo Song, Yong Man Ro
Robust Multispectral Pedestrian Detection Via Spectral Position-Free Feature Mapping. ICIP (2023)
Minsu Kim, Chae Won Kim, Yong Man Ro
Deep Visual Forced Alignment: Learning to Align Transcription with Talking Face Video. CoRR (2023)
Taeheon Kim, Youngjoon Yu, Yong Man Ro
Defending Physical Adversarial Attack on Object Detection via Adversarial Patch-Feature Energy. ACM Multimedia (2022)
Youngjoon Yu, Hong Joo Lee, Hakmin Lee, Yong Man Ro
Defending Person Detection Against Adversarial Patch Attack by Using Universal Defensive Frame. IEEE Trans. Image Process. 31 (2022)
Taeheon Kim, Hong Joo Lee, Yong Man Ro
Map: Multispectral Adversarial Patch to Attack Person Detection. ICASSP (2022)
Minsu Kim, Youngjoon Yu, Sungjune Park, Yong Man Ro
Meta Input: How to Leverage Off-the-Shelf Deep Neural Networks. CoRR (2022)
Wissam J. Baddar, Sangmin Lee, Yong Man Ro
On-the-Fly Facial Expression Prediction Using LSTM Encoded Appearance-Suppressed Dynamics. IEEE Trans. Affect. Comput. 13 (1) (2022)
Junho Kim, Seongyeop Kim, Seong Tae Kim, Yong Man Ro
Robust Perturbation for Visual Explanation: Cross-Checking Mask Optimization to Avoid Class Distortion. IEEE Trans. Image Process. 31 (2022)
Minsu Kim, Joanna Hong, Yong Man Ro
Lip to Speech Synthesis with Visual Context Attentional GAN. CoRR (2022)
Se Jin Park, Minsu Kim, Joanna Hong, Jeongsoo Choi, Yong Man Ro
SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory. CoRR (2022)
Sangmin Lee, Seongyeop Kim, Hak Gu Kim, Yong Man Ro
Assessing Individual VR Sickness Through Deep Feature Fusion of VR Video and Physiological Response. IEEE Trans. Circuits Syst. Video Technol. 32 (5) (2022)
Joanna Hong, Minsu Kim, Yong Man Ro
VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection. ECCV (36) (2022)
Jung Uk Kim, Sungjune Park, Yong Man Ro
Uncertainty-Guided Cross-Modal Learning for Robust Multispectral Pedestrian Detection. IEEE Trans. Circuits Syst. Video Technol. 32 (3) (2022)
Sangmin Lee, Sungjune Park, Yong Man Ro
IVIST: Interactive Video Search Tool in VBS 2022. MMM (2) (2022)
Minsu Kim, Jeong Hun Yeo, Yong Man Ro
Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Reading. AAAI (2022)
Youngjoon Yu, Hong Joo Lee, Hakmin Lee, Yong Man Ro
Defending Against Person Hiding Adversarial Patch Attack with a Universal White Frame. CoRR (2022)
Sangmin Lee, Hyung-Il Kim, Yong Man Ro
Weakly Paired Associative Learning for Sound and Image Representations via Bimodal Associative Memory. CVPR (2022)
Hyung-Il Kim, Kimin Yun, Yong Man Ro
Face Shape-Guided Deep Feature Alignment for Face Recognition Robust to Face Misalignment. IEEE Trans. Biom. Behav. Identity Sci. 4 (4) (2022)
Joanna Hong, Minsu Kim, Daehun Yoo, Yong Man Ro
Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognition. INTERSPEECH (2022)
Byung-Kwan Lee, Junho Kim, Yong Man Ro
Masking Adversarial Damage: Finding Adversarial Saliency for Robust and Sparse Network. CVPR (2022)
Junho Kim, Byung-Kwan Lee, Yong Man Ro
Distilling Robust and Non-Robust Features in Adversarial Examples by Information Bottleneck. CoRR (2022)
Minsu Kim, Joanna Hong, Se Jin Park, Yong Man Ro
CroMM-VSR: Cross-Modal Memory Augmented Visual Speech Recognition. IEEE Trans. Multim. 24 (2022)
Byung-Kwan Lee, Junho Kim, Yong Man Ro
Masking Adversarial Damage: Finding Adversarial Saliency for Robust and Sparse Network. CoRR (2022)
Joanna Hong, Minsu Kim, Yong Man Ro
VisageSynTalk: Unseen Speaker Video-to-Speech Synthesis via Speech-Visage Feature Selection. CoRR (2022)
Sangmin Lee, Sungjune Park, Yong Man Ro
Audio-Visual Mismatch-Aware Video Retrieval via Association and Adjustment. ECCV (14) (2022)
Joanna Hong, Minsu Kim, Daehun Yoo, Yong Man Ro
Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognition. CoRR (2022)
Hyung-Il Kim, Kimin Yun, Yong Man Ro
Face Shape-Guided Deep Feature Alignment for Face Recognition Robust to Face Misalignment. CoRR (2022)
Sungjune Park, Dae Hwi Choi, Jung Uk Kim, Yong Man Ro
Robust Thermal Infrared Pedestrian Detection By Associating Visible Pedestrian Knowledge. ICASSP (2022)
Minsu Kim, Jeong Hun Yeo, Yong Man Ro
Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Reading. CoRR (2022)
Minsu Kim, Hyunjun Kim, Yong Man Ro
Speaker-Adaptive Lip Reading with User-Dependent Padding. ECCV (36) (2022)
Se Jin Park, Minsu Kim, Joanna Hong, Jeongsoo Choi, Yong Man Ro
SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory. AAAI (2022)
Minsu Kim, Hyunjun Kim, Yong Man Ro
Speaker-adaptive Lip Reading with User-dependent Padding. CoRR (2022)
Jung Uk Kim, Sungjune Park, Yong Man Ro
Towards Versatile Pedestrian Detector with Multisensory-Matching and Multispectral Recalling Memory. AAAI (2022)
Minsu Kim, Joanna Hong, Se Jin Park, Yong Man Ro
Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video. CoRR (2022)
Yoonho Lee, Heeju Choi, Sungjune Park, Yong Man Ro
IVIST: Interactive Video Search Tool in VBS 2021. MMM (2) (2021)
Hong Joo Lee, Yong Man Ro
Adversarially Robust Multi-Sensor Fusion Model Training Via Random Feature Fusion For Semantic Segmentation. ICIP (2021)
Hak Gu Kim, Sangmin Lee, Seongyeop Kim, Heoun-taek Lim, Yong Man Ro
Towards a Better Understanding of VR Sickness: Physical Symptom Prediction for VR Contents. CoRR (2021)
Minho Park, Hak Gu Kim, Sangmin Lee, Yong Man Ro
Robust Video Frame Interpolation With Exceptional Motion Map. IEEE Trans. Circuits Syst. Video Technol. 31 (2) (2021)

Yong Man Ro.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Yong Man Ro