An efficient interactive segmentation framework for medical images without pre-training

被引:3
作者
Sun, Lei [1 ]
Tian, Zhiqiang [1 ]
Chen, Zhang [1 ]
Luo, Wenrui [1 ]
Du, Shaoyi [2 ]
机构
[1] Xi An Jiao Tong Univ, Sch Software Engn, Xian, Peoples R China
[2] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian, Peoples R China
基金
中国国家自然科学基金;
关键词
graph convolutional network; interactive segmentation; medical images; user intervention;
D O I
10.1002/mp.16120
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Background and PurposeAccurate and efficient medical image segmentation plays an important role in subsequent clinical applications such as diagnosis and surgical planning. This paper proposes an efficient interactive framework based on a graph convolutional network (GCN) for medical image segmentation. MethodsThe initial segmentation results showed that a set of boundary control points can be generated for further interactive segmentation. We presented an adaptive interactive manner that allows the user to click on the boundary for fast interaction or drag the erroneous predicted control points for accurate correction. Furthermore, we proposed an interactive segmentation network (referred to as IVIF-GCN) to learn user experience in the interactive process by transforming interactive cues into annotations. In IVIF-GCN, a module of information fusion of image features and vertex position features (IVIF) is proposed to learn the location relationship between the current vertex and the neighboring vertices. Finally, the locations of control points around the interaction point is predicted and updated automatically. ResultsThe proposed method achieves mean Dice of 96.6% and 91.3% on PROMISE12 and our in-house nasopharyngeal carcinoma (NPC) test sets, respectively. The experimental results showed that the proposed method outperforms the state-of-the-art segmentation methods. ConclusionsThe proposed interactive medical image segmentation method can efficiently improve segmentation results for clinical applications in the absence of training data. The GUI tool based on our method is available at .
引用
收藏
页码:2239 / 2248
页数:10
相关论文
共 43 条
[1]  
Alzahrani Y., 2021, SN Comput. Sci., V2, P1
[2]  
Andersson F., 2003, Bezier and B-Spline Technology
[3]  
Blake A, 2004, LECT NOTES COMPUT SC, V3021, P428
[4]  
Boykov YY, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL I, PROCEEDINGS, P105, DOI 10.1109/ICCV.2001.937505
[5]   Annotating Object Instances with a Polygon-RNN [J].
Castrejon, Lluis ;
Kundu, Kaustav ;
Urtasun, Raquel ;
Fidler, Sanja .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :4485-4493
[6]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[7]  
Cicek O, 2016, INT C MED IM COMP CO, P424, DOI [DOI 10.1007/978-3-319-46723-8_49, DOI 10.1007/978]
[8]   Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN plus [J].
Acuna, David ;
Ling, Huan ;
Kar, Amlan ;
Fidler, Sanja .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :859-868
[9]   Spline-based framework for interactive segmentation in biomedical imaging [J].
Delgado-Gonzalo, R. ;
Unser, M. .
IRBM, 2013, 34 (03) :235-243
[10]  
Elnakib A, 2011, MULTI MODALITY STATE-OF-THE-ART MEDICAL IMAGE SEGMENTATION AND REGISTRATION METHODOLOGIES, VOL II, P1, DOI 10.1007/978-1-4419-8204-9_1