Reconstructing Undersampled Photoacoustic Microscopy Images Using Deep Learning

被引:92
|
作者
DiSpirito, Anthony, III [1 ]
Li, Daiwei [1 ]
Vu, Tri [1 ]
Chen, Maomao [1 ]
Zhang, Dong [1 ,2 ]
Luo, Jianwen [2 ]
Horstmeyer, Roarke [3 ]
Yao, Junjie [1 ]
机构
[1] Duke Univ, Photoacoust Imaging Lab, Durham, NC 27708 USA
[2] Tsinghua Univ, Dept Biomed Engn, Beijing 100084, Peoples R China
[3] Duke Univ, Computat Opt Lab, Durham, NC 27708 USA
基金
美国国家卫生研究院;
关键词
Deep learning; Image reconstruction; Biomedical optical imaging; High-speed optical techniques; Optical imaging; Spatial resolution; Convolutional neural networks; deep learning; Fully Dense U-net; high-speed imaging; murine brain vasculature; photoacoustic microscopy; undersampled images; RESOLUTION; TOMOGRAPHY;
D O I
10.1109/TMI.2020.3031541
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
One primary technical challenge in photoacoustic microscopy (PAM) is the necessary compromise between spatial resolution and imaging speed. In this study, we propose a novel application of deep learning principles to reconstruct undersampled PAM images and transcend the trade-off between spatial resolution and imaging speed. We compared various convolutional neural network (CNN) architectures, and selected a Fully Dense U-net (FD U-net) model that produced the best results. To mimic various undersampling conditions in practice, we artificially downsampled fully-sampled PAM images of mouse brain vasculature at different ratios. This allowed us to not only definitively establish the ground truth, but also train and test our deep learning model at various imaging conditions. Our results and numerical analysis have collectively demonstrated the robust performance of our model to reconstruct PAM images with as few as 2% of the original pixels, which can effectively shorten the imaging time without substantially sacrificing the image quality.
引用
收藏
页码:562 / 570
页数:9
相关论文
共 50 条
  • [21] Deep Particle Tracker: Automatic Tracking of Particles in Fluorescence Microscopy Images Using Deep Learning
    Spilger, Roman
    Wollmann, Thomas
    Qiang, Yu
    Imle, Andrea
    Lee, Ji Young
    Mueller, Barbara
    Fackler, Oliver T.
    Bartenschlager, Ralf
    Rohr, Karl
    DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, DLMIA 2018, 2018, 11045 : 128 - 136
  • [22] Unsupervised Segmentation of 3D Microvascular Photoacoustic Images Using Deep Generative Learning
    Sweeney, Paul W.
    Hacker, Lina
    Lefebvre, Thierry L.
    Brown, Emma L.
    Grohl, Janek
    Bohndiek, Sarah E.
    ADVANCED SCIENCE, 2024, 11 (32)
  • [23] Combined Detection and Segmentation of Cell Nuclei in Microscopy Images Using Deep Learning
    Ram, Sundaresh
    Nguyen, Vicky T.
    Limesand, Kirsten H.
    Rodriguez, Jeffrey J.
    2020 IEEE SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION (SSIAI 2020), 2020, : 26 - 29
  • [24] Automated Analysis of In Vivo Confocal Microscopy Corneal Images Using Deep Learning
    Oakley, Jonathan D.
    Russakoff, Daniel B.
    Weinberg, Rachel
    McCarron, Megan
    Brill, Samuel
    Misra, Stuti
    McGhee, Charles N.
    Mankowski, Joseph
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2018, 59 (09)
  • [25] Automated classification of multiphoton microscopy images of ovarian tissue using deep learning
    Huttunen, Mikko J.
    Hassan, Abdurahman
    McCloskey, Curtis W.
    Fasih, Sijyl
    Upham, Jeremy
    Vanderhyden, Barbara C.
    Boyd, Robert W.
    Murugkar, Sangeeta
    JOURNAL OF BIOMEDICAL OPTICS, 2018, 23 (06)
  • [26] Predicting pharmaceutical powder flow from microscopy images using deep learning
    Wilkinson, Matthew R.
    Pereira Diaz, Laura
    Vassileiou, Antony D.
    Armstrong, John A.
    Brown, Cameron J.
    Castro-Dominguez, Bernardo
    Florence, Alastair J.
    DIGITAL DISCOVERY, 2023, 2 (02): : 459 - 470
  • [27] Deep learning-assisted frequency-domain photoacoustic microscopy
    Tserevelakis, George J.
    Barmparis, Georgios D.
    Kokosalis, Nikolaos
    Giosa, Eirini Smaro
    Pavlopoulos, Anastasios
    Tsironis, Giorgos P.
    Zacharakis, Giannis
    OPTICS LETTERS, 2023, 48 (10) : 2720 - 2723
  • [28] High-resolution photoacoustic microscopy with deep penetration through learning
    Cheng, Shengfu
    Zhou, Yingying
    Chen, Jiangbo
    Li, Huanhao
    Wang, Lidai
    Lai, Puxiang
    PHOTOACOUSTICS, 2022, 25
  • [29] Reconstructing MR images from undersampled data: Data-weighting considerations
    Pipe, JG
    MAGNETIC RESONANCE IN MEDICINE, 2000, 43 (06) : 867 - 875
  • [30] Asbestos Detection with Fluorescence Microscopy Images and Deep Learning
    Cai, Changjie
    Nishimura, Tomoki
    Hwang, Jooyeon
    Hu, Xiao-Ming
    Kuroda, Akio
    SENSORS, 2021, 21 (13)