MTC-Net: Multi-scale feature fusion network for medical image segmentation

被引:0
作者
Ren S. [1 ]
Wang Y. [1 ]
机构
[1] Department of Computer Science and Technology, Shandong University of Science and Technology, Qingdao
基金
中国国家自然科学基金;
关键词
deep learning; detail enhancement; feature fusion; Medical image segmentation; multi-scale features;
D O I
10.3233/JIFS-237963
中图分类号
学科分类号
摘要
Image segmentation is critical in medical image processing for lesion detection, localisation, and subsequent diagnosis. Currently, computer-aided diagnosis (CAD) has played a significant role in improving diagnostic efficiency and accuracy. The segmentation task is made more difficult by the hazy lesion boundaries and uneven forms. Because standard convolutional neural networks (CNNs) are incapable of capturing global contextual information, adequate segmentation results are impossible to achieve. We propose a multiscale feature fusion network (MTC-Net) in this paper that integrates deep separable convolution and self-attentive modules in the encoder to achieve better local continuity of images and feature maps. In the decoder, a multi-branch multi-scale feature fusion module (MSFB) is utilized to improve the network's feature extraction capability, and it is integrated with a global cooperative aggregation module (GCAM) to learn more contextual information and adaptively fuse multi-scale features. To develop rich hierarchical representations of irregular forms, the suggested detail enhancement module (DEM) adaptively integrates local characteristics with their global dependencies. To validate the effectiveness of the proposed network, we conducted extensive experiments, evaluated on the public datasets of skin, breast, thyroid and gastrointestinal tract with ISIC2018, BUSI, TN3K and Kvasir-SEG. The comparison with the latest methods also verifies the superiority of our proposed MTC-Net in terms of accuracy. © 2024 - IOS Press. All rights reserved.
引用
收藏
页码:8729 / 8740
页数:11
相关论文
共 38 条
[11]  
Alimjan G., Jiaermuhamaiti Y., Jumahong H., Zhu S., Nurmamat P., An image change detection algorithm based on multi-feature self-attention fusion mechanism Unet network, International Journal of Pattern Recognition and Artificial Intelligence, 35, 14, (2021)
[12]  
Bi L., Kim J., Ahn E., Feng D., Fulham M., Semi-automatic skin lesion segmentation via fully convolutional networks, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), pp. 561-564, (2017)
[13]  
Nasr-Esfahani E., Rafiei S., Jafari M.H., Karimi N., Wrobel J.S., Samavi S., Reza Soroushmehr S.M., Dense pooling layers in fully convolutional network for skin lesion segmentation, Computerized Medical Imaging and Graphics, 78, (2019)
[14]  
Zhao C., Shuai R., Ma L., Liu W., Wu M., Segmentation of dermoscopy images based on deformable 3D convolution and ResU-NeXt++, Medical & Biological Engineering & Computing, 59, 9, pp. 1815-1832, (2021)
[15]  
Dai D., Dong C., Xu S., Yan Q., Li Z., Zhang C., Luo N., Ms red: A novel multi-scale residual encoding and decoding network for skin lesion segmentation, Medical Image Analysis, 75, (2022)
[16]  
Wu H., Chen S., Chen G., Wang W., Lei B., Wen Z., Fat-net: Feature adaptive transformers for automated skin lesion segmentation, Medical Image Analysis, 76, (2022)
[17]  
Han K., Xiao A., Wu E., Guo J., Xu C., Wang Y., Transformer in transformer, Advances in Neural Information Processing Systems, 34, pp. 15908-15919, (2021)
[18]  
Wang W., Xie E., Li X., Fan D.-P., Song K., Liang D., Lu T., Luo P., Shao L., Pyramid vision transformer: A versatile backbone for dense prediction without convolutions, Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 568-578, (2021)
[19]  
Liu Z., Lin Y., Cao Y., Hu H., Wei Y., Zhang Z., Lin S., Guo B., Swin transformer: Hierarchical vision transformer using shifted windows, Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10012-10022, (2021)
[20]  
Yuan P., Lin S., Cui C., Du Y., Guo R., He D., Ding E., Han S., Hs-resnet: Hierarchical-split block on convolutional neural network, (2020)