Parallel/distributed implementation of cellular training for generative adversarial neural networks

被引:6
作者
Perez, Emiliano [1 ]
Nesmachnow, Sergio [1 ]
Toutouh, Jamal [2 ]
Hemberg, Erik [2 ]
O'reily, Una-May [2 ]
机构
[1] Univ Republica, Montevideo, Uruguay
[2] MIT, 77 Massachusetts Ave, Cambridge, MA 02139 USA
来源
2020 IEEE 34TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2020) | 2020年
关键词
parallel computing; computational intelligence; neural networks; generative adversarial networks;
D O I
10.1109/IPDPSW50202.2020.00092
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Generative adversarial networks (GANs) are widely used to learn generative models. GANs consist of two networks, a generator and a discriminator, that apply adversarial learning to optimize their parameters. This article presents a parallel/distributed implementation of a cellular competitive coevolutionary method to train two populations of GANs. A distributed memory parallel implementation is proposed for execution in high performance/supercomputing centers. Efficient results are reported on addressing the generation of handwritten digits (MNIST dataset samples). Moreover, the proposed implementation is able to reduce the training times and scale properly when considering different grid sizes for training.
引用
收藏
页码:512 / 518
页数:7
相关论文
共 21 条
[1]  
Adlam B, 2019, ADV NEUR IN, V32
[2]  
Al-Dujaili Abdullah, 2018, AAAI 2018 FALL S
[3]  
[Anonymous], 1998, The MNIST database of handwritten digits
[4]  
[Anonymous], 2018, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2018.00980
[5]  
Arjovsky Martin, 2017, 5 INT C LEARN REPR I
[6]  
Arora S., 2018, ICLR
[7]  
Arora S, 2017, PR MACH LEARN RES, V70
[8]  
Foster I., 1995, Designing and Building Parallel Programs: Concepts and Tools for Parallel Software Engineering
[9]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[10]  
Gropp W., 2014, Using MPI: Portable Parallel Programming with the Message-Passing Interface