ConvUNeXt: An efficient convolution neural network for medical image segmentation

被引:176
作者
Han, Zhimeng [1 ]
Jian, Muwei [2 ,3 ]
Wang, Gai-Ge [1 ]
机构
[1] Ocean Univ China, Sch Comp Sci & Technol, Qingdao, Peoples R China
[2] Linyi Univ, Sch Informat Sci & Technol, Linyi, Shandong, Peoples R China
[3] Shandong Univ Finance & Econ, Sch Comp Sci & Technol, Jinan, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolution neural network; Deep learning; Medical image processing; Semantic segmentation;
D O I
10.1016/j.knosys.2022.109512
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, ConvNeXts constructing from standard ConvNet modules has produced competitive performance in various image applications. In this paper, an efficient model based on the classical UNet, which can achieve promising results with a low number of parameters, is proposed for medical image segmentation. Inspired by ConvNeXt, the designed model is called ConvUNeXt and towards reduction in the amount of parameters while retaining outstanding segmentation superiority. Specifically, we firstly improved the convolution block of UNet by using large convolution kernels and depth-wise separable convolution to considerably decrease the number of parameters; then residual connections in both encoder and decoder are added and pooling is abandoned via adopting convolution for down-sampling; during skip connection, a lightweight attention mechanism is designed to filter out noise in low-level semantic information and suppress irrelevant features, so that the network can pay more attention to the target area. Compared to the standard UNet, our model has 20% fewer parameters, meanwhile, experimental results on different datasets show that it exhibits superior segmentation performance when the amount of data is scarce or sufficient. Code will be available at https://github.com/1914669687/ConvUNeXt. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:7
相关论文
共 49 条
[1]   BARF: A new direct and cross-based binary residual feature fusion with uncertainty-aware module for medical image classification [J].
Abdar, Moloud ;
Fahami, Mohammad Amin ;
Chakrabarti, Satarupa ;
Khosravi, Abbas ;
Plawiak, Pawel ;
Acharya, U. Rajendra ;
Tadeusiewicz, Ryszard ;
Nahavandi, Saeid .
INFORMATION SCIENCES, 2021, 577 (577) :353-378
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]   Robust Vessel Segmentation in Fundus Images [J].
Budai, A. ;
Bock, R. ;
Maier, A. ;
Hornegger, J. ;
Michelson, G. .
INTERNATIONAL JOURNAL OF BIOMEDICAL IMAGING, 2013, 2013 (2013)
[4]  
Chen LC, 2016, Arxiv, DOI [arXiv:1412.7062, DOI 10.48550/ARXIV.1412.7062]
[5]  
Chen LC, 2017, Arxiv, DOI [arXiv:1706.05587, DOI 10.48550/ARXIV.1706.05587]
[6]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[7]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[8]   Malicious code detection based on CNNs and multi-objective algorithm [J].
Cui, Zhihua ;
Du, Lei ;
Wang, Penghong ;
Cai, Xingjuan ;
Zhang, Wensheng .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2019, 129 :50-58
[9]   Detection of Malicious Code Variants Based on Deep Learning [J].
Cui, Zhihua ;
Xue, Fei ;
Cai, Xingjuan ;
Cao, Yang ;
Wang, Gai-ge ;
Chen, Jinjun .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (07) :3187-3196
[10]  
Dosovitskiy A, 2021, Arxiv, DOI [arXiv:2010.11929, DOI 10.48550/ARXIV.2010.11929]