UNet-Att: a self-supervised denoising and recovery model for two-photon microscopic image

被引:0
|
作者
Lu, Yuer [1 ,2 ]
Ying, Yongfa [3 ,4 ]
Lin, Chen [3 ,4 ]
Wang, Yan [5 ]
Jin, Jun [3 ,4 ]
Jiang, Xiaoming [1 ]
Shuai, Jianwei [1 ,2 ]
Li, Xiang [3 ,4 ]
Zhong, Jinjin [1 ,2 ]
机构
[1] Univ Chinese Acad Sci, Wenzhou Inst, Wenzhou Key Lab Biophys, Wenzhou 325001, Zhejiang, Peoples R China
[2] Zhejiang Lab Regenerat Med Vis & Brain Hlth, Oujiang Lab, Wenzhou 325001, Zhejiang, Peoples R China
[3] Xiamen Univ, Dept Phys, Xiamen 361005, Peoples R China
[4] Xiamen Univ, Fujian Prov Key Lab Soft Funct Mat Res, Xiamen 361005, Peoples R China
[5] Northwestern Univ, McCormick Sch Engn, Evanston, IL 60208 USA
关键词
Two-photon microscopy image; Image denoising; Deep learning; Attention; Unet plus plus; U-NET;
D O I
10.1007/s40747-024-01633-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Two-photon microscopy is indispensable in cell and molecular biology for its high-resolution visualization of cellular and molecular dynamics. However, the inevitable low signal-to-noise conditions significantly degrade image quality, obscuring essential details and complicating morphological analysis. While existing denoising methods such as CNNs, Noise2Noise, and DeepCAD serve broad applications in imaging, they still have limitations in preserving texture structures and fine details in two-photon microscopic images affected by complex noise, particularly in sophisticated structures like neuronal synapses. To improve two-photon microscopy image denoising effectiveness, by experimenting on real two-photon microscopy images, we propose a novel deep learning framework, the UNet-Att model, which integrates a specifically tailored UNet++ architecture with attention mechanisms. Specifically, this approach consists of a sophisticated downsampling module for extracting hierarchical features at varied scales, and an innovative attention module that strategically emphasizes salient features during the integration process. The architecture is completed by an ingenious upsampling pathway that reconstructs the image with high fidelity, ensuring the retention of textural integrity. Additionally, the model supports end-to-end training, optimizing its denoising efficacy. The UNet-Att model proves to surpass mainstream algorithms in the dual objectives of denoising and preserving the textural intricacies of original images, which is evidenced by an increase of 9.42 dB in the high Peak Signal-to-Noise Ratio (PSNR) coupled with an improvement of 0.1131 in the Structural Similarity Index Measurement (SSIM). The ablation experiments reveal the effectiveness of each module. The associated Python packages and datasets of UNet-Att are freely available at https://github.com/ZjjDh/UNet-Att.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] IDR: Self-Supervised Image Denoising via Iterative Data Refinement
    Zhang, Yi
    Li, Dasong
    Law, Ka Lung
    Wang, Xiaogang
    Qin, Hongwei
    Li, Hongsheng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2088 - 2097
  • [22] Patch-Craft Self-Supervised Training for Correlated Image Denoising
    Vaksman, Gregory
    Elad, Michael
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5795 - 5804
  • [23] Pol2Pol: self-supervised polarimetric image denoising
    Liu, Hedong
    Li, Xiaobo
    Cheng, Zhenzhou
    Liu, Tiegen
    Zhai, Jingsheng
    Hu, Haofeng
    OPTICS LETTERS, 2023, 48 (18) : 4821 - 4824
  • [24] Multi-view Self-supervised Disentanglement for General Image Denoising
    Chen, Hao
    Qu, Chenyuan
    Zhang, Yu
    Chen, Chen
    Jiao, Jianbo
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12247 - 12257
  • [25] Self-supervised ultrasound image denoising based on weighted joint loss
    Yu, Chunlei
    Ren, Fuquan
    Bao, Shuang
    Yang, Yurong
    Xu, Xing
    DIGITAL SIGNAL PROCESSING, 2025, 162
  • [26] Self-Supervised Image Denoising Using Implicit Deep Denoiser Prior
    Lin, Huangxing
    Zhuang, Yihong
    Ding, Xinghao
    Zeng, Delu
    Huang, Yue
    Tu, Xiaotong
    Paisley, John
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 2, 2023, : 1586 - 1594
  • [27] Self-Supervised Denoising of single OCT image with Self2Self-OCT Network
    Ge, Chenkun
    Yu, Xiaojun
    Li, Mingshuai
    Mo, Jianhua
    2022 IEEE 7TH OPTOELECTRONICS GLOBAL CONFERENCE, OGC, 2022, : 200 - 204
  • [28] Self2Self With Dropout: Learning Self-Supervised Denoising From Single Image
    Quan, Yuhui
    Chen, Mingqin
    Pang, Tongyao
    Ji, Hui
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1887 - 1895
  • [29] Random Sub-Samples Generation for Self-Supervised Real Image Denoising
    Pan, Yizhong
    Liu, Xiao
    Liao, Xiangyu
    Cao, Yuanzhouhan
    Ren, Chao
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12116 - 12125
  • [30] Self-Supervised Deep Learning for Low-Dose CT Image Denoising
    Bai, T.
    Nguyen, D.
    Jiang, S.
    MEDICAL PHYSICS, 2020, 47 (06) : E658 - E658