Unsupervised domain adaptation method for segmenting cross-sectional CCA images

被引:8
作者
van Knippenberg, Luuk [1 ]
van Sloun, Ruud J. G. [1 ,3 ]
Mischi, Massimo [1 ,3 ]
de Ruijter, Joerik [2 ]
Lopata, Richard [2 ,3 ]
Bouwman, R. Arthur [3 ]
机构
[1] Eindhoven Univ Technol, Dept Elect Engn, Eindhoven, Netherlands
[2] Eindhoven Univ Technol, Dept Biomed Engn, Eindhoven, Netherlands
[3] Catharina Hosp, Dept Anesthesiol, Eindhoven, Netherlands
关键词
Deep learning; Unsupervised domain adaptation; Vessel segmentation; Ultrasound; INTIMA-MEDIA THICKNESS; CAROTID-ARTERY; ULTRASOUND IMAGES; 3-DIMENSIONAL ULTRASOUND; INTEGRATED-SYSTEM; FLOW ESTIMATION; SEGMENTATION; DOPPLER; WALL;
D O I
10.1016/j.cmpb.2022.107037
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objectives: Automatic vessel segmentation in ultrasound is challenging due to the qual-ity of the ultrasound images, which is affected by attenuation, high level of speckle noise and acoustic shadowing. Recently, deep convolutional neural networks are increasing in popularity due to their great performance on image segmentation problems, including vessel segmentation. Traditionally, large labeled datasets are required to train a network that achieves high performance, and is able to generalize well to different orientations, transducers and ultrasound scanners. However, these large datasets are rare, given that it is challenging and time-consuming to acquire and manually annotate in-vivo data.Methods: In this work, we present a model-based, unsupervised domain adaptation method that consists of two stages. In the first stage, the network is trained on simulated ultrasound images, which have an accurate ground truth. In the second stage, the network continues training on in-vivo data in an unsu-pervised way, therefore not requiring the data to be labelled. Rather than using an adversarial neural network, prior knowledge on the elliptical shape of the segmentation mask is used to detect unexpected outputs.Results: The segmentation performance was quantified using manually segmented images as ground truth. Due to the proposed domain adaptation method, the median Dice similarity coefficient increased from 0 to 0.951, outperforming a domain adversarial neural network (median Dice 0.922) and a state-of-the-art Star-Kalman algorithm that was specifically designed for this dataset (median Dice 0.942).Conclusions: The results show that it is feasible to first train a neural network on simulated data, and then apply model-based domain adaptation to further improve segmentation performance by training on unlabeled in-vivo data. This overcomes the limitation of conventional deep learning approaches to require large amounts of manually labeled in-vivo data. Since the proposed domain adaptation method only requires prior knowledge on the shape of the segmentation mask, performance can be explored in various domains and applications in future research.(c) 2022 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )
引用
收藏
页数:11
相关论文
共 46 条
[1]   Deep learning fully convolution network for lumen characterization in diabetic patients using carotid ultrasound: a tool for stroke risk [J].
Biswas, Mainak ;
Kuppili, Venkatanareshbabu ;
Saba, Luca ;
Edla, Damodar Reddy ;
Suri, Harman S. ;
Sharma, Aditya ;
Cuadrado-Godia, Elisa ;
Laird, John R. ;
Nicolaides, Andrew ;
Suri, Jasjit S. .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2019, 57 (02) :543-564
[2]  
Christodoulou L., 2012, 5 INT S COMMUN CONTR, DOI [10.1109/ISCCSP.2012.6217824, DOI 10.1109/ISCCSP.2012.6217824]
[3]   SIMUS: An open-source simulator for medical ultrasound imaging. Part II: Comparison with four simulators [J].
Cigier, Amanda ;
Varray, Francois ;
Garcia, Damien .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 220
[4]   A Generalized Approach for Automatic 3-D Geometry Assessment of Blood Vessels in Transverse Ultrasound Images Using Convolutional Neural Networks [J].
de Ruijter, Joerik ;
Muijsers, Judith J. M. ;
van de Vosse, Frans N. ;
van Sambeek, Marc R. H. M. ;
Lopata, Richard G. P. .
IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2021, 68 (11) :3326-3335
[5]   Automated 3D geometry segmentation of the healthy and diseased carotid artery in free-hand, probe tracked ultrasound images [J].
de Ruijter, Joerik ;
van Sambeek, Marc ;
van de Vosse, Frans ;
Lopata, Richard .
MEDICAL PHYSICS, 2020, 47 (03) :1034-1047
[6]   Characterization of a completely user-independent algorithm for carotid artery segmentation in 2-D ultrasound images [J].
Delsanto, Silvia ;
Molinari, Filippo ;
Giustetto, Pierangela ;
Liboni, William ;
Badalamenti, Sergio ;
Suri, Jasjit S. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2007, 56 (04) :1265-1274
[7]  
Ganin Y, 2017, ADV COMPUT VIS PATT, P189, DOI 10.1007/978-3-319-58347-1_10
[8]   Accuracy and variability assessment of a semiautomatic technique for segmentation of the carotid arteries from three-dimensional ultrasound images [J].
Gill, JD ;
Ladak, HM ;
Steinman, DA ;
Fenster, A .
MEDICAL PHYSICS, 2000, 27 (06) :1333-1342
[9]   Using the hough transform to segment ultrasound images of longitudinal and transverse sections of the carotid artery [J].
Golemati, Spyretta ;
Stoitsis, John ;
Sifakis, Emmanouil G. ;
Balkizas, Thomas ;
Nikita, Konstantina S. .
ULTRASOUND IN MEDICINE AND BIOLOGY, 2007, 33 (12) :1918-1932
[10]   Real-time vessel segmentation and tracking for ultrasound imaging applications [J].
Guerrero, Julian ;
Salcudean, Septimiu E. ;
McEwen, James A. ;
Masri, Bassarn A. ;
Nicolaou, Savvakis .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2007, 26 (08) :1079-1090