Multi-scale contextual semantic enhancement network for 3D medical image segmentation

被引:1
|
作者
Xia, Tingjian [1 ]
Huang, Guoheng [1 ]
Pun, Chi-Man [2 ]
Zhang, Weiwen [1 ]
Li, Jiajian [1 ]
Ling, Wing-Kuen [3 ]
Lin, Chao [4 ]
Yang, Qi [4 ]
机构
[1] Guangdong Univ Technol, Sch Comp Sci & Technol, Guangzhou 510006, Peoples R China
[2] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
[3] Guangdong Univ Technol, Sch Informat Engn, Guangzhou 510006, Peoples R China
[4] Sun Yat sen Univ, State Key Lab Oncol South China, Collaborat Innovat Ctr Canc Med, Dept Nasopharyngeal,Carcinoma Guangdong Key Lab Na, Guangzhou 510060, Peoples R China
来源
PHYSICS IN MEDICINE AND BIOLOGY | 2022年 / 67卷 / 22期
关键词
3D medical image segmentation; nasopharyngeal carcinoma; liver tumor; multi-scale context; feature enhancement; class imbalance; NEURAL-NETWORKS; NET;
D O I
10.1088/1361-6560/ac9e41
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Accurate and automatic segmentation of medical images is crucial for improving the efficiency of disease diagnosis and making treatment plans. Although methods based on convolutional neural networks have achieved excellent results in numerous segmentation tasks of medical images, they still suffer from challenges including drastic scale variations of lesions, blurred boundaries of lesions and class imbalance. Our objective is to design a segmentation framework named multi-scale contextual semantic enhancement network (3D MCSE-Net) to address the above problems. Approach. The 3D MCSE-Net mainly consists of a multi-scale context pyramid fusion module (MCPFM), a triple feature adaptive enhancement module (TFAEM), and an asymmetric class correction loss (ACCL) function. Specifically, the MCPFM resolves the problem of unreliable predictions due to variable morphology and drastic scale variations of lesions by capturing the multi-scale global context of feature maps. Subsequently, the TFAEM overcomes the problem of blurred boundaries of lesions caused by the infiltrating growth and complex context of lesions by adaptively recalibrating and enhancing the multi-dimensional feature representation of suspicious regions. Moreover, the ACCL alleviates class imbalances by adjusting asy mmetric correction coefficient and weighting factor. Main results. Our method is evaluated on the nasopharyngeal cancer tumor segmentation (NPCTS) dataset, the public dataset of the MICCAI 2017 liver tumor segmentation (LiTS) challenge and the 3D image reconstruction for comparison of algorithm and DataBase (3Dircadb) dataset to verify its effectiveness and generalizability. The experimental results show the proposed components all have unique strengths and exhibit mutually reinforcing properties. More importantly, the proposed 3D MCSE-Net outperforms previous state-of-the-art methods for tumor segmentation on the NPCTS, LiTS and 3Dircadb dataset. Significance. Our method addresses the effects of drastic scale variations of lesions, blurred boundaries of lesions and class imbalance, and improves tumors segmentation accuracy, which facilitates clinical medical diagnosis and treatment planning.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] A Multi-scale Network for Semantic Segmentation of 3D Point Clouds
    He, Ying
    Xiao, Li
    Jiang, Yong
    Sun, Zhigang
    Wang, Zhuo
    Peng, Gang
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 4113 - 4118
  • [2] 3DMAX-Net: A Multi-Scale Spatial Contextual Network for 3D Point Cloud Semantic Segmentation
    Ma, Yanxin
    Guo, Yulan
    Lei, Yinjie
    Lu, Min
    Zhang, Jun
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 1560 - 1566
  • [3] MULTI-SCALE BIDIRECTIONAL ENHANCEMENT NETWORK FOR 3D DENTAL MODEL SEGMENTATION
    Li, Zigang
    Liu, Tingting
    Wang, Jun
    Zhang, Changdong
    Jia, Xiuyi
    2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022), 2022,
  • [4] Pyramid scene parsing network in 3D: Improving semantic segmentation of point clouds with multi-scale contextual information
    Fang, Hao
    Lafarge, Florent
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 154 : 246 - 258
  • [5] A multi-scale 3D Otsu thresholding algorithm for medical image segmentation
    Feng, Yuncong
    Zhao, Haiying
    Li, Xiongfei
    Zhang, Xiaoli
    Li, Hongpeng
    DIGITAL SIGNAL PROCESSING, 2017, 60 : 186 - 199
  • [6] A Multi-Scale Contextual Information Enhancement Network for Crack Segmentation
    Zhang, Lili
    Liao, Yang
    Wang, Gaoxu
    Chen, Jun
    Wang, Huibin
    APPLIED SCIENCES-BASEL, 2022, 12 (21):
  • [7] MCDALNet: Multi-scale Contextual Dual Attention Learning Network for Medical Image Segmentation
    Guo, Pengcheng
    Su, Xiangdong
    Zhang, Haoran
    Bao, Feilong
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [8] Semantic segmentation of multi-scale remote sensing images with contextual feature enhancement
    Zhang, Mei
    Liu, Lingling
    Pei, Yongtao
    Xie, Guojing
    Wen, Jinghua
    VISUAL COMPUTER, 2025, 41 (02): : 1303 - 1317
  • [9] Remote sensing image semantic segmentation network based on multi-scale feature enhancement fusion
    Wang, Feiting
    Zhang, Yuan
    Hu, Qiongqiong
    Zhu, Yu
    GEOCARTO INTERNATIONAL, 2024, 39 (01)
  • [10] 2D medical image segmentation via learning multi-scale contextual dependencies
    Pang, Shuchao
    Du, Anan
    Yu, Zhenmei
    Orgun, Mehmet A.
    METHODS, 2022, 202 : 40 - 53