R2D2: A scalable deep learning toolkit for medical imaging segmentation

被引:5
作者
Guedria, Soulaimane [1 ,2 ]
De Palma, Noel [1 ]
Renard, Felix [1 ,2 ]
Vuillerme, Nicolas [2 ,3 ]
机构
[1] Univ Grenoble Alpes, CNRS, Grenoble INP, LIG, Grenoble, France
[2] Univ Grenoble Alpes, AGEIS, Grenoble, France
[3] Inst Univ France, Paris, France
关键词
deep learning; distributed optimization; distributed systems; high-performance computing; medical imaging; semantic segmentation; software engineering; NEURAL-NETWORK; PLATFORM;
D O I
10.1002/spe.2878
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep learning has gained a significant popularity in recent years thanks to its tremendous success across a wide range of relevant fields of applications, including medical image analysis domain in particular. Although convolutional neural networks (CNNs) based medical applications have been providing powerful solutions and revolutionizing medicine, efficiently training of CNNs models is a tedious and challenging task. It is a computationally intensive process taking long time and rare system resources, which represents a significant hindrance to scientific research progress. In order to address this challenge, we propose in this article, R2D2, a scalable intuitive deep learning toolkit for medical imaging semantic segmentation. To the best of our knowledge, the present work is the first that aims to tackle this issue by offering a novel distributed versions of two well-known and widely used CNN segmentation architectures [ie, fully convolutional network (FCN) and U-Net]. We introduce the design and the core building blocks of R2D2. We further present and analyze its experimental evaluation results on two different concrete medical imaging segmentation use cases. R2D2 achieves up to17.5xand10.4xspeedup than single-node based training of U-Net and FCN, respectively, with a negligible, though still unexpected segmentation accuracy loss. R2D2 offers not only an empirical evidence and investigates in-depth the latest published works but also it facilitates and significantly reduces the effort required by researchers to quickly prototype and easily discover cutting-edge CNN configurations and architectures.
引用
收藏
页码:1966 / 1985
页数:20
相关论文
共 84 条
[1]  
Akiba Takuya, 2017, ARXIV171104325
[2]  
[Anonymous], 1995, HDB BRAIN THEORY NEU
[3]  
[Anonymous], 2012, Advances in neural information processing systems
[4]  
[Anonymous], 2017, Scaling SGD batch size to 32K for ImageNet training
[5]  
[Anonymous], 2014, ADV NEURAL INFORM PR
[6]  
[Anonymous], 2001, IEEE INT SIGN PROC
[7]  
[Anonymous], 2015, ABS150504366 CORR
[8]  
[Anonymous], 2018, CoRR abs/1802.05799
[9]  
[Anonymous], 2015, Tech. Rep.
[10]  
[Anonymous], 2012, Proceedings of the 29th International Coference on International Conference on Machine Learning, ICML'12, page