Improving sub-pixel accuracy in ultrasound localization microscopy using supervised and self-supervised deep learning

被引:5
作者
Zhang, Zeng [1 ]
Hwang, Misun [2 ,3 ]
Kilbaugh, Todd J. [4 ]
Katz, Joseph [1 ]
机构
[1] Johns Hopkins Univ, Dept Mech Engn, Baltimore, MD 21218 USA
[2] Childrens Hosp Philadelphia, Dept Radiol, Philadelphia, PA USA
[3] Univ Penn, Perelman Sch Med, Dept Radiol, Philadelphia, PA USA
[4] Childrens Hosp Philadelphia, Dept Anesthesiol & Crit Care Med, Philadelphia, PA USA
关键词
ultrasound localization microscopy; super-resolution ultrasound imaging; self-supervised learning; deep learning; BLOOD-FLOW; SUPERRESOLUTION; ENHANCEMENT; RESOLUTION;
D O I
10.1088/1361-6501/ad1671
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With a spatial resolution of tens of microns, ultrasound localization microscopy (ULM) reconstructs microvascular structures and measures intravascular flows by tracking microbubbles (1-5 mu m) in contrast enhanced ultrasound (CEUS) images. Since the size of CEUS bubble traces, e.g. 0.5-1 mm for ultrasound with a wavelength lambda = 280 mu m, is typically two orders of magnitude larger than the bubble diameter, accurately localizing microbubbles in noisy CEUS data is vital to the fidelity of the ULM results. In this paper, we introduce a residual learning based supervised super-resolution blind deconvolution network (SupBD-net), and a new loss function for a self-supervised blind deconvolution network (SelfBD-net), for detecting bubble centers at a spatial resolution finer than lambda/10. Our ultimate purpose is to improve the ability to distinguish closely located microvessels and the accuracy of the velocity profile measurements in macrovessels. Using realistic synthetic data, the performance of these methods is calibrated and compared against several recently introduced deep learning and blind deconvolution techniques. For bubble detection, errors in bubble center location increase with the trace size, noise level, and bubble concentration. For all cases, SupBD-net yields the least error, keeping it below 0.1 lambda. For unknown bubble trace morphology, where all the supervised learning methods fail, SelfBD-net can still maintain an error of less than 0.15 lambda. SupBD-net also outperforms the other methods in separating closely located bubbles and parallel microvessels. In macrovessels, SupBD-net maintains the least errors in the vessel radius and velocity profile after introducing a procedure that corrects for terminated tracks caused by overlapping traces. Application of these methods is demonstrated by mapping the cerebral microvasculature of a neonatal pig, where neighboring microvessels separated by 0.15 lambda can be readily distinguished by SupBD-net and SelfBD-net, but not by the other techniques. Hence, the newly proposed residual learning based methods improve the spatial resolution and accuracy of ULM in micro- and macro-vessels.
引用
收藏
页数:25
相关论文
共 55 条
[1]   Detection and Tracking of Multiple Microbubbles in Ultrasound B-Mode Images [J].
Ackermann, Dimitri ;
Schmitz, Georg .
IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2016, 63 (01) :72-82
[2]   Image Super-resolution via Progressive Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :904-912
[3]   Imaging Enhancement of Light-Sheet Fluorescence Microscopy via Deep Learning [J].
Bai, Chen ;
Liu, Chao ;
Yu, Xianghua ;
Peng, Tong ;
Min, Junwei ;
Yan, Shaohui ;
Dan, Dan ;
Yao, Baoli .
IEEE PHOTONICS TECHNOLOGY LETTERS, 2019, 31 (22) :1803-1806
[4]   MONOTONE PIECEWISE BICUBIC INTERPOLATION [J].
CARLSON, RE ;
FRITSCH, FN .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1985, 22 (02) :386-400
[5]   Localization Free Super-Resolution Microbubble Velocimetry Using a Long Short-Term Memory Neural Network [J].
Chen, Xi ;
Lowerison, Matthew R. ;
Dong, Zhijie ;
Sekaran, Nathiya Vaithiyalingam Chandra ;
Llano, Daniel A. ;
Song, Pengfei .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (08) :2374-2385
[6]   In Vivo Acoustic Super-Resolution and Super-Resolved Velocity Mapping Using Microbubbles [J].
Christensen-Jeffries, Kirsten ;
Browning, Richard J. ;
Tang, Meng-Xing ;
Dunsby, Christopher ;
Eckersley, Robert J. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2015, 34 (02) :433-440
[7]   Ultrasound Localization Microscopy and Super-Resolution: A State of the Art [J].
Couture, Olivier ;
Hingot, Vincent ;
Heiles, Baptiste ;
Muleki-Seya, Pauline ;
Tanter, Mickael .
IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2018, 65 (08) :1304-1320
[8]   Flow field visualization of sediment-laden flow using ultrasonic imaging [J].
Crapper, M ;
Bruce, T ;
Gouble, C .
DYNAMICS OF ATMOSPHERES AND OCEANS, 2000, 31 (1-4) :233-245
[9]  
Cristianini N., 2000, An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
[10]   Diagnostic Threshold Values of Cerebral Perfusion Measured With Computed Tomography for Delayed Cerebral Ischemia After Aneurysmal Subarachnoid Hemorrhage [J].
Dankbaar, Jan Willem ;
de Rooij, Nicolien Karen ;
Rijsdijk, Mienke ;
Velthuis, Birgitta K. ;
Frijns, Catharine J. M. ;
Rinkel, Gabriel J. E. ;
van der Schaaf, Irene C. .
STROKE, 2010, 41 (09) :1927-1932