ICL-Net: Global and Local Inter-Pixel Correlations Learning Network for Skin Lesion Segmentation

被引:46
作者
Cao, Weiwei [1 ,2 ]
Yuan, Gang [1 ,2 ]
Liu, Qi [1 ,2 ]
Peng, Chengtao [3 ]
Xie, Jing [4 ]
Yang, Xiaodong [1 ,2 ]
Ni, Xinye [5 ,6 ]
Zheng, Jian [1 ,2 ]
机构
[1] Univ Sci & Technol China, Sch Biomed Engn Suzhou, Div Life Sci & Med, Hefei 230026, Peoples R China
[2] Chinese Acad Sci, Suzhou Inst Biomed Engn & Technol, Med Imaging Dept, Suzhou 215163, Peoples R China
[3] Univ Sci & Technol China, Hefei 230026, Peoples R China
[4] Shanghai Univ, Wenzhou Peoples Hosp, Affiliated Hosp 3, Dept Dermatol, Wenzhou 325000, Peoples R China
[5] Nanjing Med Univ, Affiliated Changzhou Peoples Hosp 2, Changzhou 213003, Peoples R China
[6] Nanjing Med Univ, Ctr Med Phys, Changzhou 213003, Peoples R China
关键词
Lesions; Skin; Correlation; Image segmentation; Semantics; Task analysis; Transformers; Dermoscopic images; inter-pixel correlations learning; metric learning; pyramid transformer; skin lesion segmentation; DERMOSCOPIC IMAGE SEGMENTATION;
D O I
10.1109/JBHI.2022.3162342
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Skin lesion segmentation is a fundamental procedure in computer-aided melanoma diagnosis. However, due to the diverse shape, variable size, blurry boundary, and noise interference of lesion regions, existing methods may struggle with the challenge of inconsistency within classes and indiscrimination between classes. In view of this, we propose a novel method to learn and model interpixel correlations from both global and local aspects, which can increase inter-class variances and intra-class similarities. Specifically, under the encoder-decoder architecture, we first design a pyramid transformer inter-pixel correlations (PTIC) module, aiming at capturing the non-local context information of different levels and further exploring the global pixel-level relationship to deal with the large variance of shape and size. Further, we devise a local neighborhood metric learning (LNML) module to strengthen the local semantic correlations learning capability and increase the separability between classes in the feature space. These two modules can complementarily strengthen the feature representation capability via exploiting the inter-pixel semantic correlations, thus further improving intra-class consistency and inter-class variance. Comprehensive experiments are performed on public skin lesion segmentation datasets: ISIC 2018, ISIC2016, and PH2, and experimental results demonstrate that the proposed method achieves better segmentation performance than other state-of-theart methods.
引用
收藏
页码:145 / 156
页数:12
相关论文
共 55 条
[1]   Attention Augmented Convolutional Networks [J].
Bello, Irwan ;
Zoph, Barret ;
Vaswani, Ashish ;
Shlens, Jonathon ;
Le, Quoc V. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3285-3294
[2]  
Bi L, 2019, I S BIOMED IMAGING, P1100, DOI [10.1109/isbi.2019.8759479, 10.1109/ISBI.2019.8759479]
[3]   Dermoscopic Image Segmentation via Multistage Fully Convolutional Networks [J].
Bi, Lei ;
Kim, Jinman ;
Ahn, Euijoon ;
Kumar, Ashnil ;
Fulham, Michael ;
Feng, Dagan .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2017, 64 (09) :2065-2074
[4]   Edge and neighborhood guidance network for 2D medical image segmentation [J].
Cao, Weiwei ;
Zheng, Jian ;
Xiang, Dehui ;
Ding, Saisai ;
Sun, Haotian ;
Yang, Xiaodong ;
Liu, Zhaobang ;
Dai, Yakang .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 69 (69)
[5]  
Codella NCF, 2018, I S BIOMED IMAGING, P168, DOI 10.1109/ISBI.2018.8363547
[6]   Deep attention branch networks for skin lesion classification [J].
Ding, Saisai ;
Wu, Zhongyi ;
Zheng, Yanyan ;
Liu, Zhaobang ;
Yang, Xiaodong ;
Yang, Xiaokai ;
Yuan, Gang ;
Xie, Jing .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2021, 212
[7]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[8]   Commonality-Parsing Network Across Shape and Appearance for Partially Supervised Instance Segmentation [J].
Fan, Qi ;
Ke, Lei ;
Pei, Wenjie ;
Tang, Chi-Keung ;
Tai, Yu-Wing .
COMPUTER VISION - ECCV 2020, PT VIII, 2020, 12353 :379-396
[9]  
Feng Cheng, 2020, Medical Image Computing and Computer Assisted Intervention - MICCAI 2020. 23rd International Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12264), P108, DOI 10.1007/978-3-030-59719-1_11
[10]   CPFNet: Context Pyramid Fusion Network for Medical Image Segmentation [J].
Feng, Shuanglang ;
Zhao, Heming ;
Shi, Fei ;
Cheng, Xuena ;
Wang, Meng ;
Ma, Yuhui ;
Xiang, Dehui ;
Zhu, Weifang ;
Chen, Xinjian .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (10) :3008-3018