GauGAN renders scenes from scratch

By Farisch Hanoeman, March 20, 2019.

Just last year Nvidia introduced an incredible use of GANs creating interactive AI rendered virtual worlds. Now, the company used the same algorithms to create a doodling app called GauGAN. It allows anyone to use a MS-Paint like environment and convert it directly into photorealistic scenes.


GauGAN, named after post-Impressionist artist Paul Gauguin, works by associating each color with a specific object. For example, brown for “rock”, light blue for “sky” and grey for “cloud”. Once a color is painted, a deep learning model trained on a million images fills in the texture. The app also has a tool for selecting time of day or style of painting. GauGAN is not yet publicly available, but important questions about disinformation and truth are already raised. Fortunately, the AI research community is already at work trying to tackle this problem.

Call Now Button

Corona update: onze cursussen gaan door in kleine groepen met inachtneming van de veiligheidsmaatregelen van het RIVM.