Icarus is a piece of digital artwork by Javier Ideami which was uploaded on November 9th, 2019.
Icarus
Top view of the middle stages of a training process that connects two minima. Mode Connectivity. Optima of complex loss functions connected by simple... more
Title
Icarus
Artist
Javier Ideami
Medium
Digital Art - Digital
Description
Top view of the middle stages of a training process that connects two minima. Mode Connectivity. Optima of complex loss functions connected by simple curves over which training and test accuracy are nearly constant. Visualization data generated through a collaboration between Pavel Izmailov (@Pavel_Izmailov), Timur Garipov (@tim_garipov) and Javier Ideami (@ideami). Based on the NeurIPS 2018 paper by Timur Garipov, Pavel Izmailov, Dmitrii Podoprikhin, Dmitry Vetrov, Andrew Gordon Wilson: https://arxiv.org/abs/1802.10026 | Creative visualization and artwork produced by Javier Ideami.
Real data, resnet-20 no-skip, cifar10, sgd-mom, bs=128, wd=3e-4, mom=0.9, bn, train mod, 90k pts. log scaled (orig loss nums).
This piece has been created through a multi day process composed of different stages that begin with the training of deep learning neural networks and proceeds through a number of phases until arriving to the final artwork.
Final artwork created by Javier Ideami.
For more about the Loss Landscape project visit losslandscape.com
Uploaded
November 9th, 2019
More from Javier Ideami
Comments
There are no comments for Icarus. Click here to post the first comment.