GauGAN renders scenes from scratch

20 maart, 2019

Farisch Hanoeman Foto School of Data Science

Farisch Hanoeman

“Just last year Nvidia introduced an incredible use of GANs creating interactive AI rendered virtual worlds. Now, the company used the same algorithms to create a doodling app called GauGAN. It allows anyone to use a MS-Paint like environment and convert it directly into photorealistic scenes.”


GauGAN, named after post-Impressionist artist Paul Gauguin, works by associating each color with a specific object. For example, brown for “rock”, light blue for “sky” and grey for “cloud”. Once a color is painted, a deep learning model trained on a million images fills in the texture. The app also has a tool for selecting time of day or style of painting. GauGAN is not yet publicly available, but important questions about disinformation and truth are already raised. Fortunately, the AI research community is already at work trying to tackle this problem.

Wil jij zelf Deep Learning technieken toepassen?

“The course was extensive in both theoretical and practical perspective. The trainer knew how to explain the concepts well and provided notebooks with code examples. Overall it was a very interesting and educational training, allowing me to use these techniques in my daily work.”


Steven Jongerden – Senior Data Scientist bij Capgemini

Scroll to Top