Enhancing image resolution of confocal fluorescence microscopy with deep learning (vol 4, 2, 2023)

被引:5
作者
Huang, Boyi [1 ]
Li, Jia [1 ]
Yao, Bowen [1 ]
Yang, Zhigang [1 ]
Lam, Edmund Y. [2 ]
Zhang, Jia [1 ]
Yan, Wei [1 ]
Qu, Junle [1 ]
机构
[1] Shenzhen Univ, Coll Phys & Optoelect Engn, Key Lab Optoelect Devices & Syst, Minist Educ & Guangdong Prov, Shenzhen 518060, Peoples R China
[2] Univ Hong Kong, Dept Elect & Elect Engn, Pokfulam, Hong Kong, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Deep learning; Generative adversarial network; Image resolution enhancement; Super-resolution fluorescence microscopy;
D O I
10.1186/s43074-023-00083-7
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Super-resolution optical imaging is crucial to the study of cellular processes. Current super-resolution fluorescence microscopy is restricted by the need of special fluorophores or sophisticated optical systems, or long acquisition and computational times. In this work, we present a deep-learning-based super-resolution technique of confocal microscopy. We devise a two-channel attention network (TCAN), which takes advantage of both spatial representations and frequency contents to learn a more precise mapping from low-resolution images to high-resolution ones. This scheme is robust against changes in the pixel size and the imaging setup, enabling the optimal model to generalize to different fluorescence microscopy modalities unseen in the training set. Our algorithm is validated on diverse biological structures and dual-color confocal images of actin-microtubules, improving the resolution from ~ 230 nm to ~ 110 nm. Last but not least, we demonstrate live-cell super-resolution imaging by revealing the detailed structures and dynamic instability of microtubules. © 2023, The Author(s).
引用
收藏
页数:1
相关论文
共 50 条
  • [21] Deep Learning for Image Super-Resolution: A Survey
    Wang, Zhihao
    Chen, Jian
    Hoi, Steven C. H.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (10) : 3365 - 3387
  • [22] Deep learning in medical image super resolution: a review
    Yang, Hujun
    Wang, Zhongyang
    Liu, Xinyao
    Li, Chuangang
    Xin, Junchang
    Wang, Zhiqiong
    [J]. APPLIED INTELLIGENCE, 2023, 53 (18) : 20891 - 20916
  • [23] DeepSR: A deep learning tool for image super resolution
    Temiz, Hakan
    [J]. SOFTWAREX, 2023, 21
  • [24] Deep learning in medical image super resolution: a review
    Hujun Yang
    Zhongyang Wang
    Xinyao Liu
    Chuangang Li
    Junchang Xin
    Zhiqiong Wang
    [J]. Applied Intelligence, 2023, 53 : 20891 - 20916
  • [25] Resolution and contrast enhancement in weighted subtraction microscopy by deep learning
    Qiu, Yuxuan
    Chen, Wei
    Huang, Yuran
    Xu, Yueshu
    Sun, Yile
    Jiang, Tao
    Zhang, Zhimin
    Tang, Longhua
    Hao, Xiang
    Kuang, Cuifang
    Liu, Xu
    [J]. OPTICS AND LASERS IN ENGINEERING, 2023, 164
  • [26] Advances in Deep Learning for Super-Resolution Microscopy (Invited)
    Lu, Xinyi
    Yu, Huang
    Zhang, Zitong
    Wu, Tianxiao
    Wu, Hongjun
    Liu, Yongtao
    Zhong, Fang
    Chao, Zuo
    Qian, Chen
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (16)
  • [27] A Conspectus of Deep Learning Techniques for Single-Image Super-Resolution
    Pandey, Garima
    Ghanekar, Umesh
    [J]. PATTERN RECOGNITION AND IMAGE ANALYSIS, 2022, 32 (01) : 11 - 32
  • [28] A Review of Single Image Super-Resolution Reconstruction Based on Deep Learning
    Wu J.
    Ye X.-J.
    Huang F.
    Chen L.-Q.
    Wang Z.-F.
    Liu W.-X.
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (09): : 2265 - 2294
  • [29] A Conspectus of Deep Learning Techniques for Single-Image Super-Resolution
    [J]. Pattern Recognition and Image Analysis, 2022, 32 : 11 - 32
  • [30] Fast Super-Resolution Fluorescence Microscopy Imaging with Low Signal-to-Noise Ratio Based on Deep Learning
    Xiao Kang
    Tian Lijun
    Wang Zhongyang
    [J]. CHINESE JOURNAL OF LASERS-ZHONGGUO JIGUANG, 2020, 47 (10):