Unsupervised domain adaptation method for segmenting cross-sectional CCA images

被引:8
作者
van Knippenberg, Luuk [1 ]
van Sloun, Ruud J. G. [1 ,3 ]
Mischi, Massimo [1 ,3 ]
de Ruijter, Joerik [2 ]
Lopata, Richard [2 ,3 ]
Bouwman, R. Arthur [3 ]
机构
[1] Eindhoven Univ Technol, Dept Elect Engn, Eindhoven, Netherlands
[2] Eindhoven Univ Technol, Dept Biomed Engn, Eindhoven, Netherlands
[3] Catharina Hosp, Dept Anesthesiol, Eindhoven, Netherlands
关键词
Deep learning; Unsupervised domain adaptation; Vessel segmentation; Ultrasound; INTIMA-MEDIA THICKNESS; CAROTID-ARTERY; ULTRASOUND IMAGES; 3-DIMENSIONAL ULTRASOUND; INTEGRATED-SYSTEM; FLOW ESTIMATION; SEGMENTATION; DOPPLER; WALL;
D O I
10.1016/j.cmpb.2022.107037
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objectives: Automatic vessel segmentation in ultrasound is challenging due to the qual-ity of the ultrasound images, which is affected by attenuation, high level of speckle noise and acoustic shadowing. Recently, deep convolutional neural networks are increasing in popularity due to their great performance on image segmentation problems, including vessel segmentation. Traditionally, large labeled datasets are required to train a network that achieves high performance, and is able to generalize well to different orientations, transducers and ultrasound scanners. However, these large datasets are rare, given that it is challenging and time-consuming to acquire and manually annotate in-vivo data.Methods: In this work, we present a model-based, unsupervised domain adaptation method that consists of two stages. In the first stage, the network is trained on simulated ultrasound images, which have an accurate ground truth. In the second stage, the network continues training on in-vivo data in an unsu-pervised way, therefore not requiring the data to be labelled. Rather than using an adversarial neural network, prior knowledge on the elliptical shape of the segmentation mask is used to detect unexpected outputs.Results: The segmentation performance was quantified using manually segmented images as ground truth. Due to the proposed domain adaptation method, the median Dice similarity coefficient increased from 0 to 0.951, outperforming a domain adversarial neural network (median Dice 0.922) and a state-of-the-art Star-Kalman algorithm that was specifically designed for this dataset (median Dice 0.942).Conclusions: The results show that it is feasible to first train a neural network on simulated data, and then apply model-based domain adaptation to further improve segmentation performance by training on unlabeled in-vivo data. This overcomes the limitation of conventional deep learning approaches to require large amounts of manually labeled in-vivo data. Since the proposed domain adaptation method only requires prior knowledge on the shape of the segmentation mask, performance can be explored in various domains and applications in future research.(c) 2022 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )
引用
收藏
页数:11
相关论文
共 46 条
[31]   Real-Time Automatic Artery Segmentation, Reconstruction and Registration for Ultrasound-Guided Regional Anaesthesia of the Femoral Nerve [J].
Smistad, Erik ;
Lindseth, Frank .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (03) :752-761
[32]   Automated detection of the carotid artery wall in B-mode ultrasound images using active contours initialized by the Hough transform [J].
Stoitsis, J. ;
Golemati, S. ;
Kendros, S. ;
Nikita, K. S. .
2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vols 1-8, 2008, :3146-3149
[33]   Adversarial Discriminative Domain Adaptation [J].
Tzeng, Eric ;
Hoffman, Judy ;
Saenko, Kate ;
Darrell, Trevor .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2962-2971
[34]   Three-dimensional ultrasound of carotid atherosclerosis: Semiautomated segmentation using a level set-based method [J].
Ukwatta, E. ;
Awad, J. ;
Ward, A. D. ;
Buchanan, D. ;
Samarabandu, J. ;
Parraga, G. ;
Fenster, A. .
MEDICAL PHYSICS, 2011, 38 (05) :2479-2493
[35]   Automated measurement of fetal head circumference using 2D ultrasound images [J].
van den Heuvel, Thomas L. A. ;
de Bruijn, Dagmar ;
de Korte, Chris L. ;
van Ginneken, Bram .
PLOS ONE, 2018, 13 (08)
[36]   An Angle-Independent Cross-Sectional Doppler Method for Flow Estimation in the Common Carotid Artery [J].
van Knippenberg, Luuk ;
van Sloun, Ruud J. G. ;
Shulepov, Sergei ;
Bouwman, R. Arthur ;
Mischi, Massimo .
IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2020, 67 (08) :1513-1524
[37]   Semantic segmentation with DenseNets for carotid artery ultrasound plaque segmentation and CIMT estimation [J].
Vila, Maria del Mar ;
Remeseiro, Beatriz ;
Grau, Maria ;
Elosua, Roberto ;
Betriu, Angels ;
Fernandez-Giraldez, Elvira ;
Igual, Laura .
ARTIFICIAL INTELLIGENCE IN MEDICINE, 2020, 103
[38]   Fully Automated Common Carotid Artery and Internal Jugular Vein Identification and Tracking Using B-Mode Ultrasound [J].
Wang, David C. ;
Klatzky, Roberta ;
Wu, Bing ;
Weller, Gregory ;
Sampson, Allan R. ;
Stetten, George D. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2009, 56 (06) :1691-1699
[39]   A Pilot Assessment of Carotid and Brachial Artery Blood Flow Estimation Using Ultrasound Doppler in Cardiac Surgery Patients [J].
Weber, Ulrike ;
Glassford, Neil J. ;
Eastwood, Glenn M. ;
Bellomo, Rinaldo ;
Hilton, Andrew K. .
JOURNAL OF CARDIOTHORACIC AND VASCULAR ANESTHESIA, 2016, 30 (01) :141-148
[40]  
Weisstein E.W., 2020, From MathWorld-A Wolfram Web Resource