Reconstructing Undersampled Photoacoustic Microscopy Images Using Deep Learning

被引:100
作者
DiSpirito, Anthony, III [1 ]
Li, Daiwei [1 ]
Vu, Tri [1 ]
Chen, Maomao [1 ]
Zhang, Dong [1 ,2 ]
Luo, Jianwen [2 ]
Horstmeyer, Roarke [3 ]
Yao, Junjie [1 ]
机构
[1] Duke Univ, Photoacoust Imaging Lab, Durham, NC 27708 USA
[2] Tsinghua Univ, Dept Biomed Engn, Beijing 100084, Peoples R China
[3] Duke Univ, Computat Opt Lab, Durham, NC 27708 USA
基金
美国国家卫生研究院;
关键词
Deep learning; Image reconstruction; Biomedical optical imaging; High-speed optical techniques; Optical imaging; Spatial resolution; Convolutional neural networks; deep learning; Fully Dense U-net; high-speed imaging; murine brain vasculature; photoacoustic microscopy; undersampled images; RESOLUTION; TOMOGRAPHY;
D O I
10.1109/TMI.2020.3031541
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
One primary technical challenge in photoacoustic microscopy (PAM) is the necessary compromise between spatial resolution and imaging speed. In this study, we propose a novel application of deep learning principles to reconstruct undersampled PAM images and transcend the trade-off between spatial resolution and imaging speed. We compared various convolutional neural network (CNN) architectures, and selected a Fully Dense U-net (FD U-net) model that produced the best results. To mimic various undersampling conditions in practice, we artificially downsampled fully-sampled PAM images of mouse brain vasculature at different ratios. This allowed us to not only definitively establish the ground truth, but also train and test our deep learning model at various imaging conditions. Our results and numerical analysis have collectively demonstrated the robust performance of our model to reconstruct PAM images with as few as 2% of the original pixels, which can effectively shorten the imaging time without substantially sacrificing the image quality.
引用
收藏
页码:562 / 570
页数:9
相关论文
共 52 条
[1]   Uniqueness of reconstruction and an inversion procedure for thermoacoustic and photoacoustic tomography with variable sound speed [J].
Agranovsky, Mark ;
Kuchment, Peter .
INVERSE PROBLEMS, 2007, 23 (05) :2089-2102
[2]   Deep learning for photoacoustic tomography from sparse data [J].
Antholzer, Stephan ;
Haltmeier, Markus ;
Schwab, Johannes .
INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2019, 27 (07) :987-1005
[3]   Datafication and empowerment: How the open data movement re-articulates notions of democracy, participation, and journalism [J].
Baack, Stefan .
BIG DATA & SOCIETY, 2015, 2 (02)
[4]   Biomedical photoacoustic imaging [J].
Beard, Paul .
INTERFACE FOCUS, 2011, 1 (04) :602-631
[5]   Functional and oxygen-metabolic photoacoustic microscopy of the awake mouse brain [J].
Cao, Rui ;
Li, Jun ;
Ning, Bo ;
Sun, Naidi ;
Wang, Tianxiong ;
Zuo, Zhiyi ;
Hu, Song .
NEUROIMAGE, 2017, 150 :77-87
[6]  
Chen G., 2019, CoRR
[7]   Simultaneous photoacoustic imaging of intravascular and tissue oxygenation [J].
Chen, Maomao ;
Knox, Hailey J. ;
Tang, Yuqi ;
Liu, Wei ;
Nie, Liming ;
Chan, Jefferson ;
Yao, Junjie .
OPTICS LETTERS, 2019, 44 (15) :3773-3776
[8]   Deep-learning-based motion-correction algorithm in optical resolution photoacoustic microscopy [J].
Chen, Xingxing ;
Qi, Weizhi ;
Xi, Lei .
VISUAL COMPUTING FOR INDUSTRY BIOMEDICINE AND ART, 2019, 2 (01)
[9]  
Clevert D.-A., 2016, 4 INT C LEARN REPR I
[10]   Deep learning optoacoustic tomography with sparse data [J].
Davoudi, Neda ;
Dean-Ben, Xose Luis ;
Razansky, Daniel .
NATURE MACHINE INTELLIGENCE, 2019, 1 (10) :453-460