Reconstructing Undersampled Photoacoustic Microscopy Images Using Deep Learning

被引:94
作者
DiSpirito, Anthony, III [1 ]
Li, Daiwei [1 ]
Vu, Tri [1 ]
Chen, Maomao [1 ]
Zhang, Dong [1 ,2 ]
Luo, Jianwen [2 ]
Horstmeyer, Roarke [3 ]
Yao, Junjie [1 ]
机构
[1] Duke Univ, Photoacoust Imaging Lab, Durham, NC 27708 USA
[2] Tsinghua Univ, Dept Biomed Engn, Beijing 100084, Peoples R China
[3] Duke Univ, Computat Opt Lab, Durham, NC 27708 USA
基金
美国国家卫生研究院;
关键词
Deep learning; Image reconstruction; Biomedical optical imaging; High-speed optical techniques; Optical imaging; Spatial resolution; Convolutional neural networks; deep learning; Fully Dense U-net; high-speed imaging; murine brain vasculature; photoacoustic microscopy; undersampled images; RESOLUTION; TOMOGRAPHY;
D O I
10.1109/TMI.2020.3031541
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
One primary technical challenge in photoacoustic microscopy (PAM) is the necessary compromise between spatial resolution and imaging speed. In this study, we propose a novel application of deep learning principles to reconstruct undersampled PAM images and transcend the trade-off between spatial resolution and imaging speed. We compared various convolutional neural network (CNN) architectures, and selected a Fully Dense U-net (FD U-net) model that produced the best results. To mimic various undersampling conditions in practice, we artificially downsampled fully-sampled PAM images of mouse brain vasculature at different ratios. This allowed us to not only definitively establish the ground truth, but also train and test our deep learning model at various imaging conditions. Our results and numerical analysis have collectively demonstrated the robust performance of our model to reconstruct PAM images with as few as 2% of the original pixels, which can effectively shorten the imaging time without substantially sacrificing the image quality.
引用
收藏
页码:562 / 570
页数:9
相关论文
共 52 条
  • [1] Uniqueness of reconstruction and an inversion procedure for thermoacoustic and photoacoustic tomography with variable sound speed
    Agranovsky, Mark
    Kuchment, Peter
    [J]. INVERSE PROBLEMS, 2007, 23 (05) : 2089 - 2102
  • [2] Deep learning for photoacoustic tomography from sparse data
    Antholzer, Stephan
    Haltmeier, Markus
    Schwab, Johannes
    [J]. INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2019, 27 (07) : 987 - 1005
  • [3] Datafication and empowerment: How the open data movement re-articulates notions of democracy, participation, and journalism
    Baack, Stefan
    [J]. BIG DATA & SOCIETY, 2015, 2 (02):
  • [4] Biomedical photoacoustic imaging
    Beard, Paul
    [J]. INTERFACE FOCUS, 2011, 1 (04) : 602 - 631
  • [5] Functional and oxygen-metabolic photoacoustic microscopy of the awake mouse brain
    Cao, Rui
    Li, Jun
    Ning, Bo
    Sun, Naidi
    Wang, Tianxiong
    Zuo, Zhiyi
    Hu, Song
    [J]. NEUROIMAGE, 2017, 150 : 77 - 87
  • [6] Chen G., 2019, CoRR
  • [7] Simultaneous photoacoustic imaging of intravascular and tissue oxygenation
    Chen, Maomao
    Knox, Hailey J.
    Tang, Yuqi
    Liu, Wei
    Nie, Liming
    Chan, Jefferson
    Yao, Junjie
    [J]. OPTICS LETTERS, 2019, 44 (15) : 3773 - 3776
  • [8] Deep-learning-based motion-correction algorithm in optical resolution photoacoustic microscopy
    Chen, Xingxing
    Qi, Weizhi
    Xi, Lei
    [J]. VISUAL COMPUTING FOR INDUSTRY BIOMEDICINE AND ART, 2019, 2 (01)
  • [9] Clevert D.-A., 2016, 4 INT C LEARN REPR I
  • [10] Deep learning optoacoustic tomography with sparse data
    Davoudi, Neda
    Dean-Ben, Xose Luis
    Razansky, Daniel
    [J]. NATURE MACHINE INTELLIGENCE, 2019, 1 (10) : 453 - 460