Training Variational Networks With Multidomain Simulations: Speed-of-Sound Image Reconstruction

被引:20
作者
Bernhardt, Melanie [1 ]
Vishnevskiy, Valery [1 ]
Rau, Richard [1 ]
Goksel, Orcun [1 ]
机构
[1] Swiss Fed Inst Technol, Comp Assisted Applicat Med, CH-8092 Zurich, Switzerland
基金
瑞士国家科学基金会;
关键词
Image reconstruction; Training; Adaptation models; Optimization; Imaging; Transducers; Robustness; neural networks; ultrasonography; COMPUTED ULTRASOUND TOMOGRAPHY; ECHO-MODE;
D O I
10.1109/TUFFC.2020.3010186
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Speed-of-sound (SoS) has been shown as a potential biomarker for breast cancer imaging, successfully differentiating malignant tumors from benign ones. SoS images can be reconstructed from time-of-flight measurements from ultrasound images acquired using conventional handheld ultrasound transducers. Variational networks (VNs) have recently been shown to be a potential learning-based approach for optimizing inverse problems in image reconstruction. Despite earlier promising results, these methods, however, do not generalize well from simulated to acquired data, due to the domain shift. In this work, we present for the first time a VN solution for a pulse-echo SoS image reconstruction problem using diverging waves with conventional transducers and single-sided tissue access. This is made possible by incorporating simulations with varying complexity into training. We use loop unrolling of gradient descent with momentum, with an exponentially weighted loss of outputs at each unrolled iteration in order to regularize the training. We learn norms as activation functions regularized to have smooth forms for robustness to input distribution variations. We evaluate reconstruction quality on the ray-based and full-wave simulations as well as on the tissue-mimicking phantom data, in comparison with a classical iterative [limited-memory BroydenFletcherGoldfarbShanno (L-BFGS)] optimization of this image reconstruction problem. We show that the proposed regularization techniques combined with multisource domain training yield substantial improvements in the domain adaptation capabilities of VN, reducing the median root mean squared error (RMSE) by 54 on a wave-based simulation data set compared to the baseline VN. We also show that on data acquired from a tissue-mimicking breast phantom, the proposed VN provides improved reconstruction in 12 ms.
引用
收藏
页码:2584 / 2594
页数:11
相关论文
共 51 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]  
[Anonymous], 2017, CoRR, abs/1707.08114
[3]  
Broyden C. G., 1970, Journal of the Institute of Mathematics and Its Applications, V6, P222
[4]   Multisource Domain Adaptation and Its Application to Early Detection of Fatigue [J].
Chattopadhyay, Rita ;
Sun, Qian ;
Fan, Wei ;
Davidson, Ian ;
Panchanathan, Sethuraman ;
Ye, Jieping .
ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2012, 6 (04)
[5]  
Colton D., 2013, INVERSE ACOUSTIC ELE, Vthird
[6]  
Duan LX, 2012, PROC CVPR IEEE, P1338, DOI 10.1109/CVPR.2012.6247819
[7]   Domain Adaptation from Multiple Sources: A Domain-Dependent Regularization Approach [J].
Duan, Lixin ;
Xu, Dong ;
Tsang, Ivor Wai-Hung .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (03) :504-518
[8]   Detection of breast cancer with ultrasound tomography: First results with the Computed Ultrasound Risk Evaluation (CURE) prototype [J].
Duric, Nebojsa ;
Littrup, Peter ;
Poulo, Lou ;
Babkin, Alex ;
Pevzner, Roman ;
Holsapple, Earle ;
Rama, Olsi ;
Glide, Carri .
MEDICAL PHYSICS, 2007, 34 (02) :773-785
[9]   A Deep Learning Framework for Single-Sided Sound Speed Inversion in Medical Ultrasound [J].
Feigin, Micha ;
Freedman, Daniel ;
Anthony, Brian W. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2020, 67 (04) :1142-1151
[10]   Optimization Methods for Magnetic Resonance Image Reconstruction: Key Models and Optimization Algorithms [J].
Fessler, Jeffrey A. .
IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (01) :33-40