Jing Yu Koh

I am an AI Resident at Google Research in Mountain View, California. I work with research scientists and engineers on machine learning research, and my current interests are in multi-modal learning and generative models.

Before joining Google, I was an undergrad at the Singapore University of Technology and Design. I graduated with Summa Cum Laude (highest honors) in 2019.

Publications (Google Scholar)

J.Y. Koh, H. Lee, Y. Yang, J. Baldridge, P. Anderson, "Pathdreamer: A World Model for Indoor Navigation", Preprint. May 2021.

H. Zhang*, J.Y. Koh*, J. Baldridge, H. Lee, Y. Yang, "Cross-Modal Contrastive Learning for Text-to-Image Generation", in CVPR, June 2021. (* denotes equal contribution)


J.Y. Koh, J. Baldridge, H. Lee, Y. Yang, "Text-to-Image Generation Grounded by Fine-Grained User Attention", in The IEEE Winter Conference on Applications of Computer Vision (WACV)., January 2021.


J.Y. Koh, D.T. Nguyen, Q.T. Truong, S.-K. Yeung, and A. Binder, "SideInfNet: A Deep Neural Network for Semi-Automatic Semantic Segmentation with Side Information", in ECCV., August 2020.

S. Ghosh*, J.Y. Koh*, and P. Jaillet, "Improving customer satisfaction in bike sharing systems through dynamic repositioning", IJCAI, August 2019. (* denotes equal contribution).


G. Goh, J.Y. Koh, and Y. Zhang, "Twitter-informed Crowd Flow Prediction", IEEE International Conference on Data Mining (ICDM) Workshops, November 2018.

ECCV 2018

T.Feng, Q.-T. Truong, D.T. Nguyen, J.Y. Koh, L.-F. Yu, A. Binder, and S.-K. Yeung, " Urban Zoning Using Higher-Order Markov Random Fields on Multi-View Imagery Data" in ECCV, September 2018.

GCPR 2017

J.Y. Koh, W. Samek, K.-R. Mùˆller, and A. Binder, "Object Boundary Detection and Classification", in 39th German Conference on Pattern Recognition (GCPR), September 2017.



Model Zoo curates pre-trained deep learning models and code, making it easy for researchers to find models for various frameworks.

Web Application
Reading Stash

Web application that provides readers with book recommendations for a selected genre.

Web Application
Yu Sheng

The CNY Yusheng app is a reference app designed to help you learn more about unique Chinese New Year traditions and the yusheng dish.

iOS Application

Decision making app for iOS that allows you to objectively evaluate and analyze each choice.

iOS Application
Pixel Warrior

Castle-defense strategy game for iOS. Permanent death and level randomisation make no two games alike.

iOS Game