MLMSeg: A multi-view learning model for ultrasound thyroid nodule segmentation

被引:18
作者
Chen, Guanyuan [1 ]
Tan, Guanghua [1 ]
Duan, Mingxing [1 ]
Pu, Bin [2 ]
Luo, Hongxia [3 ]
Li, Shengli [4 ]
Li, Kenli [1 ]
机构
[1] Hunan Univ, Coll Comp Sci & Elect Engn, Changsha 410000, Peoples R China
[2] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
[3] Wenzhou Med Univ, Affiliated Hosp 2, Dept Ultrason Diag, Yuying Childrens Hosp, Zhejiang, Peoples R China
[4] Southern Med Univ, Shenzhen Maternal & Child Hlth Hosp, Dept Ultrasound, Shenzhen, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Thyroid nodule segmentation; Multi-view learning; Graph convolutional network; Transformer; Feature fusion;
D O I
10.1016/j.compbiomed.2023.107898
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Accurate segmentation of the thyroid gland in ultrasound images is an essential initial step in distinguishing between benign and malignant nodules, thus facilitating early diagnosis. Most existing deep learning -based methods to segment thyroid nodules are learned from only a single view or two views, which limits the performance of segmenting nodules at different scales in complex ultrasound scanning environments. To address this limitation, this study proposes a multi -view learning model, abbreviated as MLMSeg. First, a deep convolutional neural network is introduced to encode the features of the local view. Second, a multichannel transformer module is designed to capture long-range dependency correlations of global view between different nodules. Third, there are semantic relationships of structural view between features of different layers. For example, low-level features and high-level features are endowed with hidden relationships in the feature space. To this end, a cross -layer graph convolutional module is proposed to adaptively learn the correlations of high-level and low-level features by constructing graphs across different layers. In addition, in the view fusion, a channel -aware graph attention block is devised to fuse the features from the aforementioned views for accurate segmentation of thyroid nodules. To demonstrate the effectiveness of the proposed method, extensive comparative experiments were conducted with 14 baseline methods. MLMSeg achieved higher Dice coefficients (92.10% and 83.84%) and Intersection over Union scores (86.60% and 73.52%) on two different thyroid datasets. The exceptional segmentation capability of MLMSeg for thyroid nodules can greatly assist in localizing thyroid nodules and facilitating more precise measurements of their transverse and longitudinal diameters, which is of significant clinical relevance for the diagnosis of thyroid nodules.
引用
收藏
页数:10
相关论文
共 45 条
[1]   Thyroid cancer [J].
Cabanillas, Maria E. ;
McFadden, David G. ;
Durante, Cosimo .
LANCET, 2016, 388 (10061) :2783-2795
[2]  
Cao Hu, 2023, Computer Vision - ECCV 2022 Workshops: Proceedings. Lecture Notes in Computer Science (13803), P205, DOI 10.1007/978-3-031-25066-8_9
[3]   Joint Segmentation and Differential Diagnosis of Thyroid Nodule in Contrast-Enhanced Ultrasound Images [J].
Chen, Fang ;
Han, Haojie ;
Wan, Peng ;
Liao, Hongen ;
Liu, Chunrui ;
Zhang, Daoqiang .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2023, 70 (09) :2722-2732
[4]  
Chen J., 2021, arXiv
[5]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[6]   Multi-Label Image Recognition with Graph Convolutional Networks [J].
Chen, Zhao-Min ;
Wei, Xiu-Shen ;
Wang, Peng ;
Guo, Yanwen .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :5172-5181
[7]   Hybrid transformer UNet for thyroid segmentation from ultrasound scans [J].
Chi, Jianning ;
Li, Zelan ;
Sun, Zhiyi ;
Yu, Xiaosheng ;
Wang, Huan .
COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 153
[8]   Knowledge and Spatial Pyramid Distance-Based Gated Graph Attention Network for Remote Sensing Semantic Segmentation [J].
Cui, Wei ;
He, Xin ;
Yao, Meng ;
Wang, Ziwei ;
Hao, Yuanjie ;
Li, Jie ;
Wu, Weijie ;
Zhao, Huilin ;
Xia, Cong ;
Li, Jin ;
Cui, Wenqi .
REMOTE SENSING, 2021, 13 (07)
[9]   Weighted Feature Fusion of Convolutional Neural Network and Graph Attention Network for Hyperspectral Image Classification [J].
Dong, Yanni ;
Liu, Quanwei ;
Du, Bo ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1559-1572
[10]  
Dosovitskiy A, 2021, Arxiv, DOI [arXiv:2010.11929, 10.48550/arXiv.2010.11929, DOI 10.48550/ARXIV.2010.11929]