Shao-Yen Tseng

Publication Activity (10 Years)

Years Active: 2010-2024
Publications (10 Years): 28

Top Topics

Multimodal Fusion

Animal Behavior

Top Venues

IEEE Signal Process. Lett.

NAACL-HLT (Findings)

Publications

Zhipeng Cai, Matthias Mueller, Reiner Birkl, Diana Wofk, Shao-Yen Tseng, Junda Cheng, Gabriela Ben Melech Stan, Vasudev Lal, Michael Paulitsch
L-MAGIC: Language Model Assisted Generation of Images with Coherence. CoRR (2024)
Gabriela Ben Melech Stan, Raanan Y. Yehezkel Rohekar, Yaniv Gurwicz, Matthew Lyle Olson, Anahita Bhiwandiwalla, Estelle Aflalo, Chenfei Wu, Nan Duan, Shao-Yen Tseng, Vasudev Lal
LVLM-Intrepret: An Interpretability Tool for Large Vision-Language Models. CoRR (2024)
Musashi Hinck, Carolin Holtermann, Matthew Lyle Olson, Florian Schneider, Sungduk Yu, Anahita Bhiwandiwalla, Anne Lauscher, Shao-Yen Tseng, Vasudev Lal
Why do LLaVA Vision-Language Models Reply to Images in English? CoRR (2024)
Musashi Hinck, Matthew L. Olson, David Cobbley, Shao-Yen Tseng, Vasudev Lal
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model. CoRR (2024)
Avinash Madasu, Estelle Aflalo, Gabriela Ben Melech Stan, Shao-Yen Tseng, Gedas Bertasius, Vasudev Lal
Improving Video Retrieval Using Multilingual Knowledge Transfer. ECIR (1) (2023)
Xiao Xu, Bei Li, Chenfei Wu, Shao-Yen Tseng, Anahita Bhiwandiwalla, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan
ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning. ACL (1) (2023)
Avinash Madasu, Estelle Aflalo, Gabriela Ben Melech Stan, Shachar Rosenman, Shao-Yen Tseng, Gedas Bertasius, Vasudev Lal
MuMUR: Multilingual Multimodal Universal Retrieval. Inf. Retr. J. 26 (1) (2023)
Gabriela Ben Melech Stan, Diana Wofk, Scottie Fox, Alex Redden, Will Saxton, Jean Yu, Estelle Aflalo, Shao-Yen Tseng, Fabio Nonato, Matthias Müller, Vasudev Lal
LDM3D: Latent Diffusion Model for 3D. CoRR (2023)
Xiao Xu, Bei Li, Chenfei Wu, Shao-Yen Tseng, Anahita Bhiwandiwalla, Shachar Rosenman, Vasudev Lal, Wanxiang Che, Nan Duan
ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning. CoRR (2023)
Gabriela Ben Melech Stan, Diana Wofk, Estelle Aflalo, Shao-Yen Tseng, Zhipeng Cai, Michael Paulitsch, Vasudev Lal
LDM3D-VR: Latent Diffusion Model for 3D VR. CoRR (2023)
Vin Sachidananda, Shao-Yen Tseng, Erik Marchi, Sachin Kajarekar, Panayiotis Georgiou
CALM: Contrastive Aligned Audio-Language Multirate and Multimodal Representations. CoRR (2022)
Avinash Madasu, Estelle Aflalo, Gabriela Ben Melech Stan, Shao-Yen Tseng, Gedas Bertasius, Vasudev Lal
Improving video retrieval using multilingual knowledge transfer. CoRR (2022)
Estelle Aflalo, Meng Du, Shao-Yen Tseng, Yongfei Liu, Chenfei Wu, Nan Duan, Vasudev Lal
VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers. CVPR (2022)
Estelle Aflalo, Meng Du, Shao-Yen Tseng, Yongfei Liu, Chenfei Wu, Nan Duan, Vasudev Lal
VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers. CoRR (2022)
Yongfei Liu, Chenfei Wu, Shao-Yen Tseng, Vasudev Lal, Xuming He, Nan Duan
KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation. NAACL-HLT (Findings) (2022)
Shao-Yen Tseng, Shrikanth Narayanan, Panayiotis G. Georgiou
Multimodal Embeddings From Language Models for Emotion Recognition in the Wild. IEEE Signal Process. Lett. 28 (2021)
Sandeep Nallan Chakravarthula, Md. Nasir, Shao-Yen Tseng, Haoqi Li, Tae Jin Park, Brian R. Baucom, Craig J. Bryan, Shrikanth Narayanan, Panayiotis G. Georgiou
Automatic Prediction of Suicidal Risk in Military Couples Using Multimodal Interaction Cues from Couples Conversations. ICASSP (2020)
Sandeep Nallan Chakravarthula, Haoqi Li, Shao-Yen Tseng, Maija Reblin, Panayiotis G. Georgiou
Predicting Behavior in Cancer-Afflicted Patient and Spouse Interactions Using Speech and Language. INTERSPEECH (2019)
Shao-Yen Tseng, Brian R. Baucom, Panayiotis G. Georgiou
Unsupervised online multitask learning of behavioral sentence embeddings. PeerJ Comput. Sci. 5 (2019)
Sandeep Nallan Chakravarthula, Haoqi Li, Shao-Yen Tseng, Maija Reblin, Panayiotis G. Georgiou
Predicting Behavior in Cancer-Afflicted Patient and Spouse Interactions using Speech and Language. CoRR (2019)
Prashanth Gurunath Shivakumar, Shao-Yen Tseng, Panayiotis G. Georgiou, Shrikanth S. Narayanan
Behavior Gated Language Models. CoRR (2019)
Shao-Yen Tseng, Panayiotis G. Georgiou, Shrikanth S. Narayanan
Multimodal Embeddings from Language Models. CoRR (2019)
Shao-Yen Tseng, Juncheng Li, Yun Wang, Florian Metze, Joseph Szurley, Samarjit Das
Multiple Instance Deep Learning for Weakly Supervised Small-Footprint Audio Event Detection. INTERSPEECH (2018)
Shao-Yen Tseng, Haoqi Li, Brian R. Baucom, Panayiotis G. Georgiou
"Honey, I Learned to Talk": Multimodal Fusion for Behavior Analysis. ICMI (2018)
Shao-Yen Tseng, Panayiotis G. Georgiou
Multi-Task Unsupervised Contextual Learning for Behavioral Annotation. CoRR (2018)
Shao-Yen Tseng, Juncheng Li, Yun Wang, Joseph Szurley, Florian Metze, Samarjit Das
Multiple Instance Deep Learning for Weakly Supervised Audio Event Detection. CoRR (2017)
Shao-Yen Tseng, Brian R. Baucom, Panayiotis G. Georgiou
Approaching Human Performance in Behavior Estimation in Couples Therapy Using Deep Sentence Embeddings. INTERSPEECH (2017)
Shao-Yen Tseng, Sandeep Nallan Chakravarthula, Brian R. Baucom, Panayiotis G. Georgiou
Couples Behavior Modeling and Annotation Using Low-Resource LSTM Language Models. INTERSPEECH (2016)
Wai-Chi Fang, Hsiang-Cheh Huang, Shao-Yen Tseng
Design of heart rate variability processor for portable 3-lead ECG monitoring system-on-chip. Expert Syst. Appl. 40 (5) (2013)
Ericson Chua, Wai-Chi Fang, Chiu-Kuo Chen, Chih-Chung Fu, Shao-Yen Tseng, Shih Kang, Zong-Han Hsieh
A highly-integrated biomedical multiprocessor system for portable brain-heart monitoring. ISCAS (2011)
Chih-Chung Fu, Chiu-Kuo Chen, Shao-Yen Tseng, Shih Kang, Ericson Chua, Wai-Chi Fang
Portable Brain-Heart Monitoring System. FGIT-DTA/BSBT (2010)
Chiu-Kuo Chen, Ericson Chua, Shao-Yen Tseng, Chih-Chung Fu, Wai-Chi Fang
Implementation of a hardware-efficient EEG processor for brain monitoring systems. SoCC (2010)
Shao-Yen Tseng, Wai-Chi Fang
A Time-Frequency HRV Processor Using Windowed Lomb Periodogram. FGIT-DTA/BSBT (2010)