Jing Yu Koh

38 papers A* 11A 1Journal 20Unranked 6
YearRankTypeTitle / Venue / Authors
2025 A* conf
Dissecting Adversarial Robustness of Multimodal LM Agents.
ICLR
Chen Henry Wu, Rishi Rajesh Shah, Jing Yu Koh, Russ Salakhutdinov, Daniel Fried, Aditi Raghunathan
2025 J jnl
Tree Search for Language Model Agents.
Trans. Mach. Learn. Res.
Jing Yu Koh, Stephen Marcus McAleer, Daniel Fried, Ruslan Salakhutdinov
2024 J jnl
Adversarial Attacks on Multimodal Agents.
CoRR
Chen Henry Wu, Jing Yu Koh, Ruslan Salakhutdinov, Daniel Fried, Aditi Raghunathan
2024 — conf
OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web.
ECCV (68)
Raghav Kapoor, Yash Parag Butala, Melisa Russak, Jing Yu Koh, Kiran Kamble, Waseem AlShikh, Ruslan Salakhutdinov
2024 J jnl
OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web.
CoRR
Raghav Kapoor, Yash Parag Butala, Melisa Russak, Jing Yu Koh, Kiran Kamble, Waseem AlShikh, Ruslan Salakhutdinov
2024 J jnl
Tree Search for Language Model Agents.
CoRR
Jing Yu Koh, Stephen McAleer, Daniel Fried, Ruslan Salakhutdinov
2024 — conf
VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks.
ACL (1)
Jing Yu Koh, Robert Lo, Lawrence Jang, Vikram Duvvur, Ming Chong Lim, Po-Yu Huang, Graham Neubig, Shuyan Zhou, Russ Salakhutdinov, Daniel Fried
2024 J jnl
VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks.
CoRR
Jing Yu Koh, Robert Lo, Lawrence Jang, Vikram Duvvur, Ming Chong Lim, Po-Yu Huang, Graham Neubig, Shuyan Zhou, Ruslan Salakhutdinov, Daniel Fried
2023 A* conf
A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learning.
CVPR
Aishwarya Kamath, Peter Anderson, Su Wang, Jing Yu Koh, Alexander Ku, Austin Waters, Yinfei Yang, Jason Baldridge, Zarana Parekh
2023 A* conf
Generating Images with Multimodal Language Models.
NeurIPS
Jing Yu Koh, Daniel Fried, Russ Salakhutdinov
2023 J jnl
Generating Images with Multimodal Language Models.
CoRR
Jing Yu Koh, Daniel Fried, Ruslan Salakhutdinov
2023 J jnl
Grounding Language Models to Images for Multimodal Generation.
CoRR
Jing Yu Koh, Ruslan Salakhutdinov, Daniel Fried
2023 A* conf
Grounding Language Models to Images for Multimodal Inputs and Outputs.
ICML
Jing Yu Koh, Ruslan Salakhutdinov, Daniel Fried
2023 J jnl
Multimodal Graph Learning for Generative Tasks.
CoRR
Minji Yoon, Jing Yu Koh, Bryan Hooi, Ruslan Salakhutdinov
2023 A* conf
Simple and Effective Synthesis of Indoor 3D Scenes.
AAAI
Jing Yu Koh, Harsh Agrawal, Dhruv Batra, Richard Tucker, Austin Waters, Honglak Lee, Yinfei Yang, Jason Baldridge, Peter Anderson
2023 A* conf
VQ3D: Learning a 3D-Aware Generative Model on ImageNet.
ICCV
Kyle Sargent, Jing Yu Koh, Han Zhang, Huiwen Chang, Charles Herrmann, Pratul P. Srinivasan, Jiajun Wu, Deqing Sun
2023 J jnl
VQ3D: Learning a 3D-Aware Generative Model on ImageNet.
CoRR
Kyle Sargent, Jing Yu Koh, Han Zhang, Huiwen Chang, Charles Herrmann, Pratul P. Srinivasan, Jiajun Wu, Deqing Sun
2022 J jnl
A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learning.
CoRR
Aishwarya Kamath, Peter Anderson, Su Wang, Jing Yu Koh, Alexander Ku, Austin Waters, Yinfei Yang, Jason Baldridge, Zarana Parekh
2022 J jnl
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation.
CoRR
Jiahui Yu, Yuanzhong Xu, Jing Yu Koh, Thang Luong, Gunjan Baid, Zirui Wang, Vijay Vasudevan, Alexander Ku, Yinfei Yang, Burcu Karagol Ayan, Ben Hutchinson, Wei Han, Zarana Parekh, Xin Li, Han Zhang, Jason Baldridge, Yonghui Wu
2022 J jnl
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation.
Trans. Mach. Learn. Res.
Jiahui Yu, Yuanzhong Xu, Jing Yu Koh, Thang Luong, Gunjan Baid, Zirui Wang, Vijay Vasudevan, Alexander Ku, Yinfei Yang, Burcu Karagol Ayan, Ben Hutchinson, Wei Han, Zarana Parekh, Xin Li, Han Zhang, Jason Baldridge, Yonghui Wu
2022 J jnl
Simple and Effective Synthesis of Indoor 3D Scenes.
CoRR
Jing Yu Koh, Harsh Agrawal, Dhruv Batra, Richard Tucker, Austin Waters, Honglak Lee, Yinfei Yang, Jason Baldridge, Peter Anderson
2022 A* conf
Vector-quantized Image Modeling with Improved VQGAN.
ICLR
Jiahui Yu, Xin Li, Jing Yu Koh, Han Zhang, Ruoming Pang, James Qin, Alexander Ku, Yuanzhong Xu, Jason Baldridge, Yonghui Wu
2021 A* conf
Cross-Modal Contrastive Learning for Text-to-Image Generation.
CVPR
Han Zhang, Jing Yu Koh, Jason Baldridge, Honglak Lee, Yinfei Yang
2021 J jnl
Cross-Modal Contrastive Learning for Text-to-Image Generation.
CoRR
Han Zhang, Jing Yu Koh, Jason Baldridge, Honglak Lee, Yinfei Yang
2021 A* conf
Pathdreamer: A World Model for Indoor Navigation.
ICCV
Jing Yu Koh, Honglak Lee, Yinfei Yang, Jason Baldridge, Peter Anderson
2021 J jnl
Pathdreamer: A World Model for Indoor Navigation.
CoRR
Jing Yu Koh, Honglak Lee, Yinfei Yang, Jason Baldridge, Peter Anderson
2021 A* conf
Revisiting Hierarchical Approach for Persistent Long-Term Video Prediction.
ICLR
Wonkwang Lee, Whie Jung, Han Zhang, Ting Chen, Jing Yu Koh, Thomas E. Huang, Hyungsuk Yoon, Honglak Lee, Seunghoon Hong
2021 J jnl
Revisiting Hierarchical Approach for Persistent Long-Term Video Prediction.
CoRR
Wonkwang Lee, Whie Jung, Han Zhang, Ting Chen, Jing Yu Koh, Thomas E. Huang, Hyungsuk Yoon, Honglak Lee, Seunghoon Hong
2021 A conf
Text-to-Image Generation Grounded by Fine-Grained User Attention.
WACV
Jing Yu Koh, Jason Baldridge, Honglak Lee, Yinfei Yang
2021 J jnl
Vector-quantized Image Modeling with Improved VQGAN.
CoRR
Jiahui Yu, Xin Li, Jing Yu Koh, Han Zhang, Ruoming Pang, James Qin, Alexander Ku, Yuanzhong Xu, Jason Baldridge, Yonghui Wu
2020 — conf
SideInfNet: A Deep Neural Network for Semi-Automatic Semantic Segmentation with Side Information.
ECCV (24)
Jing Yu Koh, Duc Thanh Nguyen, Quang-Trung Truong, Sai-Kit Yeung, Alexander Binder
2020 J jnl
SideInfNet: A Deep Neural Network for Semi-Automatic Semantic Segmentation with Side Information.
CoRR
Jing Yu Koh, Duc Thanh Nguyen, Quang-Trung Truong, Sai-Kit Yeung, Alexander Binder
2020 J jnl
Text-to-Image Generation Grounded by Fine-Grained User Attention.
CoRR
Jing Yu Koh, Jason Baldridge, Honglak Lee, Yinfei Yang
2019 A* conf
Improving Customer Satisfaction in Bike Sharing Systems through Dynamic Repositioning.
IJCAI
Supriyo Ghosh, Jing Yu Koh, Patrick Jaillet
2018 — conf
Twitter-Informed Crowd Flow Prediction.
ICDM Workshops
Gary Goh, Jing Yu Koh, Yue Zhang
2018 — conf
Urban Zoning Using Higher-Order Markov Random Fields on Multi-View Imagery Data.
ECCV (8)
Tian Feng, Quang-Trung Truong, Duc Thanh Nguyen, Jing Yu Koh, Lap-Fai Yu, Alexander Binder, Sai-Kit Yeung
2017 — conf
Object Boundary Detection and Classification with Image-Level Labels.
GCPR
Jing Yu Koh, Wojciech Samek, Klaus-Robert Müller, Alexander Binder
2016 J jnl
Zero Shot Learning for Semantic Boundary Detection - How Far Can We Get?
CoRR
Jing Yu Koh, Wojciech Samek, Klaus-Robert Müller, Alexander Binder