Canvas | Sketching-App

Nvidia’s GauGan is now called Canvas – and is available as a beta. The app can be used to transform crude drawings into pretty works of art.

The trick to Canvas is that it uses Generative Adversarial Networks (GAN) to convert segmentation maps into images. To do this, Canvas uses a deep learning model that has been trained on millions of images. The second trick with Canvas is that the whole thing runs in real time. While you are still slapping your clumsy children’s drawings onto the digital canvas, Canvas transforms your blobs into high-quality works of art that would fetch top prices at Sotheby’s or Christie’s. Or something like that. While the app was previously accessible in the browser, it is now designed as a desktop app. One side effect of this is that you need an RTX-capable graphics card to use Canvas.

If you want to know how GANs actually work and what Generators and Discriminators have to do with them, we recommend our current issue 04 : 2021, where you will find the article “Katze ergo sum?” by our author Björn Eichelbaum, who breaks down how AI (artificial intelligence), ML (machine learning) and DL (deep learning) can be explained using cat pictures in a popular science style.

You can download the beta of Nvidia’s Canvas here. The Nvidia forum welcomes feedback on the beta. The video below will give you a flavour of the Canvas app.

Introducing the NVIDIA Canvas App – Paint With AI