EEvoU-Net: An ensemble of evolutionary deep fully convolutional neural networks for medical image segmentation

被引:10
作者
Hassanzadeh, Tahereh [1 ]
Essam, Daryl [1 ]
Sarker, Ruhul [1 ]
机构
[1] Univ New South Wales, Sch Engn & Informat Technol, Sydney, Australia
关键词
Deep Convolutional Neural Network; Medical image segmentation; Neuroevolution; Ensemble model; Optimisation; Genetic Algorithm; PROSTATE SEGMENTATION;
D O I
10.1016/j.asoc.2023.110405
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Developing a Deep Convolutional Neural Network (DCNN) is a challenging research topic which needs extensive efforts and computation to find a proper network structure and a precise set of hyperparameters. The problem is that in most of the cases the achieved network works well on the specific application or dataset, and a small to significant changes are required to adapt it for a new one. Besides, the limited number of available labelled images and the required computational infrastructure, make this task even more challenging. Therefore, developing an automatic method that is able to find a network structure and its parameters, while using minimum computation, seems necessary. Evolutionary computation is an optimisation method that can be used to address the mentioned difficulties. This paper proposes an evolutionary-based framework to find a set of precise and small networks for medical image segmentation, and also, an ensemble model to improve the quality of segmentation. To the best of our knowledge, EEvoU-Net is the first ensemble method that utilises a set of evolutionary U-Net-based deep networks for medical image segmentation. In the proposed model, a Genetic Algorithm (GA) is applied to design a set of optimal network structures, along with their parameters, using a new fixed-length encoding strategy to create variable length networks, for medical image segmentation. The proposed model is evaluated using five different, publicly available medical image segmentation datasets. The best found evolutionary networks, outperformed U-Net, ResU-Net, DenseU-Net, NAS U-Net, AdaResU-Net, EvoU-Net, DenseRes, 2D to 3D EvoU-Net, and Attention EvoU-Net in the most of the cases using considerable less trainable parameters. Furthermore, EEvoU-Net as an ensemble of evolutionary networks, has also substantially improved over those previous results. (c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:17
相关论文
共 86 条
[1]  
Aloysius N, 2017, 2017 INTERNATIONAL CONFERENCE ON COMMUNICATION AND SIGNAL PROCESSING (ICCSP), P588, DOI 10.1109/ICCSP.2017.8286426
[2]  
[Anonymous], 2011, Advanced engineering mathematics
[3]  
Antonelli M, 2021, Arxiv, DOI arXiv:2106.05735
[4]  
Badirli S, 2020, Arxiv, DOI [arXiv:2002.07971, DOI 10.48550/ARXIV.2002.07971]
[5]   AdaResU-Net: Multiobjective adaptive convolutional neural network for medical image segmentation [J].
Baldeon-Calisto, Maria ;
Lai-Yuen, Susana K. .
NEUROCOMPUTING, 2020, 392 :325-340
[6]   On the automated, evolutionary design of neural networks: past, present, and future [J].
Baldominos, Alejandro ;
Saez, Yago ;
Isasi, Pedro .
NEURAL COMPUTING & APPLICATIONS, 2020, 32 (02) :519-545
[7]   Supervised remote sensing image segmentation using boosted convolutional neural networks [J].
Basaeed, Essa ;
Bhaskar, Harish ;
Al-Mualla, Mohammed .
KNOWLEDGE-BASED SYSTEMS, 2016, 99 :19-27
[8]   LEARNING LONG-TERM DEPENDENCIES WITH GRADIENT DESCENT IS DIFFICULT [J].
BENGIO, Y ;
SIMARD, P ;
FRASCONI, P .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02) :157-166
[9]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[10]  
Calimeri Francesco, 2017, IT WORKSH NEUR NETS, P173