Reconstructing Undersampled Photoacoustic Microscopy Images Using Deep Learning

被引:92
|
作者
DiSpirito, Anthony, III [1 ]
Li, Daiwei [1 ]
Vu, Tri [1 ]
Chen, Maomao [1 ]
Zhang, Dong [1 ,2 ]
Luo, Jianwen [2 ]
Horstmeyer, Roarke [3 ]
Yao, Junjie [1 ]
机构
[1] Duke Univ, Photoacoust Imaging Lab, Durham, NC 27708 USA
[2] Tsinghua Univ, Dept Biomed Engn, Beijing 100084, Peoples R China
[3] Duke Univ, Computat Opt Lab, Durham, NC 27708 USA
基金
美国国家卫生研究院;
关键词
Deep learning; Image reconstruction; Biomedical optical imaging; High-speed optical techniques; Optical imaging; Spatial resolution; Convolutional neural networks; deep learning; Fully Dense U-net; high-speed imaging; murine brain vasculature; photoacoustic microscopy; undersampled images; RESOLUTION; TOMOGRAPHY;
D O I
10.1109/TMI.2020.3031541
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
One primary technical challenge in photoacoustic microscopy (PAM) is the necessary compromise between spatial resolution and imaging speed. In this study, we propose a novel application of deep learning principles to reconstruct undersampled PAM images and transcend the trade-off between spatial resolution and imaging speed. We compared various convolutional neural network (CNN) architectures, and selected a Fully Dense U-net (FD U-net) model that produced the best results. To mimic various undersampling conditions in practice, we artificially downsampled fully-sampled PAM images of mouse brain vasculature at different ratios. This allowed us to not only definitively establish the ground truth, but also train and test our deep learning model at various imaging conditions. Our results and numerical analysis have collectively demonstrated the robust performance of our model to reconstruct PAM images with as few as 2% of the original pixels, which can effectively shorten the imaging time without substantially sacrificing the image quality.
引用
收藏
页码:562 / 570
页数:9
相关论文
共 50 条
  • [1] Three-dimensional reconstructing undersampled photoacoustic microscopy images using deep learning
    Seong, Daewoon
    Lee, Euimin
    Kim, Yoonseok
    Han, Sangyeob
    Lee, Jaeyul
    Jeon, Mansik
    Kim, Jeehyun
    PHOTOACOUSTICS, 2023, 29
  • [2] Accelerating photoacoustic microscopy by reconstructing undersampled images using diffusion models
    Loc, Irem
    Unlu, M. Burcin
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [3] Utilization of Curvelet Transform in Reconstructing Cellular Images for Undersampled Optical-Resolution Photoacoustic Microscopy
    Sulistyawan, I. Gede Eka
    Nishimae, Daisuke
    Ishii, Takuro
    Saijo, Yoshifumi
    IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2023, 70 (12) : 1631 - 1641
  • [4] Reconstructing Cancellous Bone From Down-Sampled Optical-Resolution Photoacoustic Microscopy Images With Deep Learning
    Wang, Jingxian
    Li, Boyi
    Zhou, Tianhua
    Liu, Chengcheng
    Lu, Mengyang
    Gu, Wenting
    Liu, Xin
    Ta, Dean
    ULTRASOUND IN MEDICINE AND BIOLOGY, 2024, 50 (09): : 1459 - 1471
  • [5] Denoising method for photoacoustic microscopy using deep learning
    Tang, Kanggao
    Li, Bo
    Zhang, Jinhong
    Wei, Jianshuang
    Song, Lingfang
    Song, Xianlin
    SPIE FUTURE SENSING TECHNOLOGIES (2020), 2020, 11525
  • [6] A Deep Learning Approach for the Photoacoustic Tomography Recovery From Undersampled Measurements
    Shahid, Husnain
    Khalid, Adnan
    Liu, Xin
    Irfan, Muhammad
    Ta, Dean
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [7] Structure and oxygen saturation recovery of sparse photoacoustic microscopy images by deep learning
    Zhang, Shuyan
    Li, Jingtan
    Shen, Lin
    Zhao, Zhonghao
    Lee, Minjun
    Qian, Kun
    Sun, Naidi
    Hu, Bin
    PHOTOACOUSTICS, 2025, 42
  • [8] Semantic segmentation of multispectral photoacoustic images using deep learning
    Schellenberg, Melanie
    Dreher, Kris K.
    Holzwarth, Niklas
    Isensee, Fabian
    Reinke, Annika
    Schreck, Nicholas
    Seitel, Alexander
    Tizabi, Minu D.
    Maier-Hein, Lena
    Groehl, Janek
    PHOTOACOUSTICS, 2022, 26
  • [9] Reconstructing symmetric images from their undersampled Fourier intensities
    Millane, RP
    Stroud, WJ
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1997, 14 (03): : 568 - 579
  • [10] Denoising method for image quality improvement in photoacoustic microscopy using deep learning
    Yu, Ziming
    Tang, Kanggao
    Song, Xianlin
    COMPUTATIONAL OPTICS 2021, 2021, 11875