UNet-Att: a self-supervised denoising and recovery model for two-photon microscopic image

被引:0
|
作者
Lu, Yuer [1 ,2 ]
Ying, Yongfa [3 ,4 ]
Lin, Chen [3 ,4 ]
Wang, Yan [5 ]
Jin, Jun [3 ,4 ]
Jiang, Xiaoming [1 ]
Shuai, Jianwei [1 ,2 ]
Li, Xiang [3 ,4 ]
Zhong, Jinjin [1 ,2 ]
机构
[1] Univ Chinese Acad Sci, Wenzhou Inst, Wenzhou Key Lab Biophys, Wenzhou 325001, Zhejiang, Peoples R China
[2] Zhejiang Lab Regenerat Med Vis & Brain Hlth, Oujiang Lab, Wenzhou 325001, Zhejiang, Peoples R China
[3] Xiamen Univ, Dept Phys, Xiamen 361005, Peoples R China
[4] Xiamen Univ, Fujian Prov Key Lab Soft Funct Mat Res, Xiamen 361005, Peoples R China
[5] Northwestern Univ, McCormick Sch Engn, Evanston, IL 60208 USA
关键词
Two-photon microscopy image; Image denoising; Deep learning; Attention; Unet plus plus; U-NET;
D O I
10.1007/s40747-024-01633-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Two-photon microscopy is indispensable in cell and molecular biology for its high-resolution visualization of cellular and molecular dynamics. However, the inevitable low signal-to-noise conditions significantly degrade image quality, obscuring essential details and complicating morphological analysis. While existing denoising methods such as CNNs, Noise2Noise, and DeepCAD serve broad applications in imaging, they still have limitations in preserving texture structures and fine details in two-photon microscopic images affected by complex noise, particularly in sophisticated structures like neuronal synapses. To improve two-photon microscopy image denoising effectiveness, by experimenting on real two-photon microscopy images, we propose a novel deep learning framework, the UNet-Att model, which integrates a specifically tailored UNet++ architecture with attention mechanisms. Specifically, this approach consists of a sophisticated downsampling module for extracting hierarchical features at varied scales, and an innovative attention module that strategically emphasizes salient features during the integration process. The architecture is completed by an ingenious upsampling pathway that reconstructs the image with high fidelity, ensuring the retention of textural integrity. Additionally, the model supports end-to-end training, optimizing its denoising efficacy. The UNet-Att model proves to surpass mainstream algorithms in the dual objectives of denoising and preserving the textural intricacies of original images, which is evidenced by an increase of 9.42 dB in the high Peak Signal-to-Noise Ratio (PSNR) coupled with an improvement of 0.1131 in the Structural Similarity Index Measurement (SSIM). The ablation experiments reveal the effectiveness of each module. The associated Python packages and datasets of UNet-Att are freely available at https://github.com/ZjjDh/UNet-Att.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Two-photon Voltage Imaging Denoising by Self-supervised Learning
    Liu, Chang
    Platisa, Jelena
    Ye, Xin
    Ahrens, Allison M.
    Chen, Ichun Anderson
    Davison, Ian G.
    Pieribone, Vincent A.
    Chen, Jerry L.
    Tian, Lei
    NEURAL IMAGING AND SENSING 2023, 2023, 12365
  • [2] Self-supervised deep-learning two-photon microscopy
    He, Yuezhi
    Yao, Jing
    Liu, Lina
    Gao, Yufeng
    Yu, Jia
    Ye, Shiwei
    Li, Hui
    Zheng, Wei
    PHOTONICS RESEARCH, 2023, 11 (01) : 1 - 11
  • [3] Self-supervised deep-learning two-photon microscopy
    YUEZHI HE
    JING YAO
    LINA LIU
    YUFENG GAO
    JIA YU
    SHIWEI YE
    HUI LI
    WEI ZHENG
    Photonics Research, 2023, 11 (01) : 1 - 11
  • [4] Investigating self-supervised image denoising with denaturation
    Waida, Hiroki
    Yamazaki, Kimihiro
    Tokuhisa, Atsushi
    Wada, Mutsuyo
    Wada, Yuichiro
    NEURAL NETWORKS, 2025, 184
  • [5] Leveraging Self-supervised Denoising for Image Segmentation
    Prakash, Mangal
    Buchholz, Tim-Oliver
    Lalit, Manan
    Tomancak, Pavel
    Jug, Florian
    Krull, Alexander
    2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 428 - 432
  • [6] Two-scale Real Image Blind Denoising with Self-supervised Constraints
    Wang D.
    Pan J.-S.
    Tang J.-H.
    Ruan Jian Xue Bao/Journal of Software, 2023, 34 (06): : 2942 - 2958
  • [7] A self-supervised network for image denoising and watermark removal
    Tian, Chunwei
    Xiao, Jingyu
    Zhang, Bob
    Zuo, Wangmeng
    Zhang, Yudong
    Lin, Chia -Wen
    NEURAL NETWORKS, 2024, 174
  • [8] Self-Supervised Joint Learning for pCLE Image Denoising
    Yang, Kun
    Zhang, Haojie
    Qiu, Yufei
    Zhai, Tong
    Zhang, Zhiguo
    SENSORS, 2024, 24 (09)
  • [9] Image denoising for fluorescence microscopy by supervised to self-supervised transfer learning
    Wang, Yina
    Pinkard, Henry
    Khwaja, Emaad
    Zhou, Shuqin
    Waller, Laura
    Huang, Bo
    OPTICS EXPRESS, 2021, 29 (25) : 41303 - 41312
  • [10] A self-supervised CNN for image denoising with self-similarity prior
    Fang, Wenqian
    Li, Hongwei
    2022 16TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP2022), VOL 1, 2022, : 66 - 69