Physics-Guided Deep Learning for 3D Photoacoustic Microscopy

被引:0
作者
Zhang, Jitong [1 ]
Zhang, Ke [1 ]
Tang, Xiangjiang [1 ]
Zhou, Jiasheng [2 ]
He, Pengbo [1 ]
Tang, Xingye [1 ]
Liang, Siqi [3 ]
Chen, Sung-Liang [1 ,2 ,4 ,5 ]
机构
[1] Shanghai Jiao Tong Univ, Univ Michigan Shanghai Jiao Tong Univ Joint Inst, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Inst Med Robot, Shanghai 200240, Peoples R China
[3] Hunan Univ Sci & Technol, Sch Informat & Elect Engn, Xiangtan 411201, Peoples R China
[4] Minist Educ, Engn Res Ctr Digital Med & Clin Translat, Shanghai 200030, Peoples R China
[5] Shanghai Jiao Tong Univ, State Key Lab Photon & Commun, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金; 上海市自然科学基金;
关键词
3D microscopy; deep learning; depth of focus; photoacoustic microscopy; physical guidance; IMAGES; RESOLUTION;
D O I
10.1002/lpor.202500352
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Photoacoustic microscopy (PAM) achieves high lateral resolution through tight light focusing but suffers from a narrow depth of focus (DOF). Here the enhancement of PAM image quality for 3D microscopy is aimed by achieving high resolution over a large DOF, accurately restoring object sizes, and minimizing artifacts introduced during image acquisition. A novel approach is proposed that initially acquires 3D PAM images with a large DOF but low resolution through loose light focusing, and subsequently enhances resolution and image quality using a deep learning network termed LDHR-Net. This network is trained on synthetic low-resolution and high-resolution image pairs generated using a physical Gaussian beam model, which accounts for depth-dependent blurring. Application of the proposed model to experimentally acquired phantom data demonstrates significant improvements, achieving lateral resolution of approximate to 4 mu m across an unprecedentedly large DOF of approximate to 4.5 mm, a 25-fold increase compared to the intrinsic DOF (approximate to 0.18 mm) of a PAM system with the same lateral resolution. The model's effectiveness and robustness are further validated qualitatively and quantitatively on in vivo microvasculature structures, including those in the mouse ear, back, and brain. This method provides an effective and practical solution for obtaining high-quality 3D PAM images.
引用
收藏
页数:12
相关论文
共 30 条
  • [1] Super-Resolution Photoacoustic Microscopy Using Structured-Illumination
    Amjadian, Mohammadreza
    Mostafavi, Seyed Masood
    Chen, Jiangbo
    Kavehvash, Zahra
    Zhu, Jingyi
    Wang, Lidai
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (09) : 2197 - 2207
  • [2] Optical-resolution photoacoustic microscopy with a needle-shaped beam
    Cao, Rui
    Zhao, Jingjing
    Li, Lei
    Du, Lin
    Zhang, Yide
    Luo, Yilin
    Jiang, Laiming
    Davis, Samuel
    Zhou, Qifa
    de la Zerda, Adam
    Wang, Lihong, V
    [J]. NATURE PHOTONICS, 2023, 17 (01) : 89 - +
  • [3] Chen GY, 2019, Arxiv, DOI arXiv:1905.05928
  • [4] Confocal visible/NIR photoacoustic microscopy of tumors with structural, functional, and nanoprobe contrasts
    Chen, Jiangbo
    Zhang, Yachao
    Li, Xiaozhen
    Zhu, Jingyi
    Li, Dengfeng
    Li, Shengliang
    Lee, Chun-Sing
    Wang, Lidai
    [J]. PHOTONICS RESEARCH, 2020, 8 (12) : 1875 - 1880
  • [5] High-resolution photoacoustic microscopy with deep penetration through learning
    Cheng, Shengfu
    Zhou, Yingying
    Chen, Jiangbo
    Li, Huanhao
    Wang, Lidai
    Lai, Puxiang
    [J]. PHOTOACOUSTICS, 2022, 25
  • [6] High-speed photoacoustic microscopy: A review dedicated on light sources
    Cho, Soon-Woo
    Park, Sang Min
    Park, Byullee
    Kim, Do Yeon
    Lee, Tae Geol
    Kim, Beop-Min
    Kim, Chulhong
    Kim, Jeesu
    Lee, Sang-Won
    Kim, Chang-Seok
    [J]. PHOTOACOUSTICS, 2021, 24
  • [7] Rapid ultraviolet photoacoustic remote sensing microscopy using voice-coil stage scanning
    Cikaluk, Brendyn D.
    Restall, Brendon S.
    Haven, Nathaniel J. M.
    Martell, Matthew T.
    Mcalister, Ewan A.
    Zemp, Roger J.
    [J]. OPTICS EXPRESS, 2023, 31 (06) : 10136 - 10149
  • [8] Reconstructing Undersampled Photoacoustic Microscopy Images Using Deep Learning
    DiSpirito, Anthony, III
    Li, Daiwei
    Vu, Tri
    Chen, Maomao
    Zhang, Dong
    Luo, Jianwen
    Horstmeyer, Roarke
    Yao, Junjie
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (02) : 562 - 570
  • [9] Fully Dense UNet for 2-D Sparse Photoacoustic Tomography Artifact Removal
    Guan, Steven
    Khan, Amir A.
    Sikdar, Siddhartha
    Chitnis, Parag V.
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (02) : 568 - 576
  • [10] Deep learning-based aberration compensation improves contrast and resolution in fluorescence microscopy
    Guo, Min
    Wu, Yicong
    Hobson, Chad M.
    Su, Yijun
    Qian, Shuhao
    Krueger, Eric
    Christensen, Ryan
    Kroeschell, Grant
    Bui, Johnny
    Chaw, Matthew
    Zhang, Lixia
    Liu, Jiamin
    Hou, Xuekai
    Han, Xiaofei
    Lu, Zhiye
    Ma, Xuefei
    Zhovmer, Alexander
    Combs, Christian
    Moyle, Mark
    Yemini, Eviatar
    Liu, Huafeng
    Liu, Zhiyi
    Benedetto, Alexandre
    La Riviere, Patrick
    Colon-Ramos, Daniel
    Shroff, Hari
    [J]. NATURE COMMUNICATIONS, 2025, 16 (01)