Jing Yu Koh

Publication Activity (10 Years)

Years Active: 2016-2024
Publications (10 Years): 35

Top Topics

Image Generation

Boundary Detection

Top Venues

Publications

Jing Yu Koh, Robert Lo, Lawrence Jang, Vikram Duvvur, Ming Chong Lim, Po-Yu Huang, Graham Neubig, Shuyan Zhou, Ruslan Salakhutdinov, Daniel Fried
VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks. CoRR (2024)
Chen Henry Wu, Jing Yu Koh, Ruslan Salakhutdinov, Daniel Fried, Aditi Raghunathan
Adversarial Attacks on Multimodal Agents. CoRR (2024)
Jing Yu Koh, Stephen McAleer, Daniel Fried, Ruslan Salakhutdinov
Tree Search for Language Model Agents. CoRR (2024)
Jing Yu Koh, Robert Lo, Lawrence Jang, Vikram Duvvur, Ming Chong Lim, Po-Yu Huang, Graham Neubig, Shuyan Zhou, Russ Salakhutdinov, Daniel Fried
VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks. ACL (1) (2024)
Raghav Kapoor, Yash Parag Butala, Melisa Russak, Jing Yu Koh, Kiran Kamble, Waseem AlShikh, Ruslan Salakhutdinov
OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web. CoRR (2024)
Aishwarya Kamath, Peter Anderson, Su Wang, Jing Yu Koh, Alexander Ku, Austin Waters, Yinfei Yang, Jason Baldridge, Zarana Parekh
A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learning. CVPR (2023)
Jing Yu Koh, Daniel Fried, Ruslan Salakhutdinov
Generating Images with Multimodal Language Models. CoRR (2023)
Kyle Sargent, Jing Yu Koh, Han Zhang, Huiwen Chang, Charles Herrmann, Pratul Srinivasan, Jiajun Wu, Deqing Sun
VQ3D: Learning a 3D-Aware Generative Model on ImageNet. CoRR (2023)
Jing Yu Koh, Harsh Agrawal, Dhruv Batra, Richard Tucker, Austin Waters, Honglak Lee, Yinfei Yang, Jason Baldridge, Peter Anderson
Simple and Effective Synthesis of Indoor 3D Scenes. AAAI (2023)
Kyle Sargent, Jing Yu Koh, Han Zhang, Huiwen Chang, Charles Herrmann, Pratul Srinivasan, Jiajun Wu, Deqing Sun
VQ3D: Learning a 3D-Aware Generative Model on ImageNet. ICCV (2023)
Minji Yoon, Jing Yu Koh, Bryan Hooi, Ruslan Salakhutdinov
Multimodal Graph Learning for Generative Tasks. CoRR (2023)
Jing Yu Koh, Ruslan Salakhutdinov, Daniel Fried
Grounding Language Models to Images for Multimodal Generation. CoRR (2023)
Jing Yu Koh, Daniel Fried, Russ Salakhutdinov
Generating Images with Multimodal Language Models. NeurIPS (2023)
Jing Yu Koh, Ruslan Salakhutdinov, Daniel Fried
Grounding Language Models to Images for Multimodal Inputs and Outputs. ICML (2023)
Jiahui Yu, Xin Li, Jing Yu Koh, Han Zhang, Ruoming Pang, James Qin, Alexander Ku, Yuanzhong Xu, Jason Baldridge, Yonghui Wu
Vector-quantized Image Modeling with Improved VQGAN. ICLR (2022)
Aishwarya Kamath, Peter Anderson, Su Wang, Jing Yu Koh, Alexander Ku, Austin Waters, Yinfei Yang, Jason Baldridge, Zarana Parekh
A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learning. CoRR (2022)
Jing Yu Koh, Harsh Agrawal, Dhruv Batra, Richard Tucker, Austin Waters, Honglak Lee, Yinfei Yang, Jason Baldridge, Peter Anderson
Simple and Effective Synthesis of Indoor 3D Scenes. CoRR (2022)
Jiahui Yu, Yuanzhong Xu, Jing Yu Koh, Thang Luong, Gunjan Baid, Zirui Wang, Vijay Vasudevan, Alexander Ku, Yinfei Yang, Burcu Karagol Ayan, Ben Hutchinson, Wei Han, Zarana Parekh, Xin Li, Han Zhang, Jason Baldridge, Yonghui Wu
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation. Trans. Mach. Learn. Res. 2022 (2022)
Jiahui Yu, Yuanzhong Xu, Jing Yu Koh, Thang Luong, Gunjan Baid, Zirui Wang, Vijay Vasudevan, Alexander Ku, Yinfei Yang, Burcu Karagol Ayan, Ben Hutchinson, Wei Han, Zarana Parekh, Xin Li, Han Zhang, Jason Baldridge, Yonghui Wu
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation. CoRR (2022)
Han Zhang, Jing Yu Koh, Jason Baldridge, Honglak Lee, Yinfei Yang
Cross-Modal Contrastive Learning for Text-to-Image Generation. CVPR (2021)
Wonkwang Lee, Whie Jung, Han Zhang, Ting Chen, Jing Yu Koh, Thomas E. Huang, Hyungsuk Yoon, Honglak Lee, Seunghoon Hong
Revisiting Hierarchical Approach for Persistent Long-Term Video Prediction. CoRR (2021)
Jiahui Yu, Xin Li, Jing Yu Koh, Han Zhang, Ruoming Pang, James Qin, Alexander Ku, Yuanzhong Xu, Jason Baldridge, Yonghui Wu
Vector-quantized Image Modeling with Improved VQGAN. CoRR (2021)
Han Zhang, Jing Yu Koh, Jason Baldridge, Honglak Lee, Yinfei Yang
Cross-Modal Contrastive Learning for Text-to-Image Generation. CoRR (2021)
Jing Yu Koh, Honglak Lee, Yinfei Yang, Jason Baldridge, Peter Anderson
Pathdreamer: A World Model for Indoor Navigation. ICCV (2021)
Jing Yu Koh, Jason Baldridge, Honglak Lee, Yinfei Yang
Text-to-Image Generation Grounded by Fine-Grained User Attention. WACV (2021)
Wonkwang Lee, Whie Jung, Han Zhang, Ting Chen, Jing Yu Koh, Thomas E. Huang, Hyungsuk Yoon, Honglak Lee, Seunghoon Hong
Revisiting Hierarchical Approach for Persistent Long-Term Video Prediction. ICLR (2021)
Jing Yu Koh, Honglak Lee, Yinfei Yang, Jason Baldridge, Peter Anderson
Pathdreamer: A World Model for Indoor Navigation. CoRR (2021)
Jing Yu Koh, Duc Thanh Nguyen, Quang-Trung Truong, Sai-Kit Yeung, Alexander Binder
SideInfNet: A Deep Neural Network for Semi-Automatic Semantic Segmentation with Side Information. CoRR (2020)
Jing Yu Koh, Jason Baldridge, Honglak Lee, Yinfei Yang
Text-to-Image Generation Grounded by Fine-Grained User Attention. CoRR (2020)
Jing Yu Koh, Duc Thanh Nguyen, Quang-Trung Truong, Sai-Kit Yeung, Alexander Binder
SideInfNet: A Deep Neural Network for Semi-Automatic Semantic Segmentation with Side Information. ECCV (24) (2020)
Supriyo Ghosh, Jing Yu Koh, Patrick Jaillet
Improving Customer Satisfaction in Bike Sharing Systems through Dynamic Repositioning. IJCAI (2019)
Gary Goh, Jing Yu Koh, Yue Zhang
Twitter-Informed Crowd Flow Prediction. ICDM Workshops (2018)
Tian Feng, Quang-Trung Truong, Duc Thanh Nguyen, Jing Yu Koh, Lap-Fai Yu, Alexander Binder, Sai-Kit Yeung
Urban Zoning Using Higher-Order Markov Random Fields on Multi-View Imagery Data. ECCV (8) (2018)
Jing Yu Koh, Wojciech Samek, Klaus-Robert Müller, Alexander Binder
Object Boundary Detection and Classification with Image-Level Labels. GCPR (2017)
Jing Yu Koh, Wojciech Samek, Klaus-Robert Müller, Alexander Binder
Zero Shot Learning for Semantic Boundary Detection - How Far Can We Get? CoRR (2016)