Deep-learning-based methods for super-resolution fluorescence microscopy

被引:11
作者
Liao, Jianhui [1 ]
Qu, Junle [1 ]
Hao, Yongqi [2 ]
Li, Jia [1 ]
机构
[1] Shenzhen Univ, Coll Phys & Optoelect Engn, Shenzhen Key Lab Photon & Biophoton, Key Lab Optoelect Devices & Syst,Minist Educ & Gua, Shenzhen 518060, Peoples R China
[2] NARI Technol Co Ltd, NARI Grp Corp, State Grid Elect Power Res Inst, Nanjing 211106, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Super-resolution fluorescence microscopy; deep learning; convolutional neural network; generative adversarial network; image reconstruction; RESOLUTION LIMIT; LOCALIZATION; RECONSTRUCTION; MOLECULES; NETWORKS;
D O I
10.1142/S1793545822300166
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The algorithm used for reconstruction or resolution enhancement is one of the factors affecting the quality of super-resolution images obtained by fluorescence microscopy. Deep-learning-based algorithms have achieved state-of-the-art performance in super-resolution fluorescence microscopy and are becoming increasingly attractive. We firstly introduce commonly-used deep learning models, and then review the latest applications in terms of the network architectures, the training data and the loss functions. Additionally, we discuss the challenges and limits when using deep learning to analyze the fluorescence microscopic data, and suggest ways to improve the reliability and robustness of deep learning applications.
引用
收藏
页数:16
相关论文
共 61 条
  • [1] Abbe E., 1873, ARCH MIKROSK ANAT, V9, P413, DOI [10.1007/BF02956173, DOI 10.1007/BF02956173]
  • [2] Interpretation of intelligence in CNN-pooling processes: a methodological survey
    Akhtar, Nadeem
    Ragavendran, U.
    [J]. NEURAL COMPUTING & APPLICATIONS, 2020, 32 (03) : 879 - 898
  • [3] Arjovsky M., 2017, P INT C LEARN REPR, P1
  • [4] Analyzing Single Molecule Localization Microscopy Data Using Cubic Splines
    Babcock, Hazen P.
    Zhuang, Xiaowei
    [J]. SCIENTIFIC REPORTS, 2017, 7
  • [5] Applications, promises, and pitfalls of deep learning for fluorescence image reconstruction
    Belthangady, Chinmay
    Royer, Loic A.
    [J]. NATURE METHODS, 2019, 16 (12) : 1215 - 1225
  • [6] Berthelot D, 2017, ARXIV
  • [7] Imaging intracellular fluorescent proteins at nanometer resolution
    Betzig, Eric
    Patterson, George H.
    Sougrat, Rachid
    Lindwasser, O. Wolf
    Olenych, Scott
    Bonifacino, Juan S.
    Davidson, Michael W.
    Lippincott-Schwartz, Jennifer
    Hess, Harald F.
    [J]. SCIENCE, 2006, 313 (5793) : 1642 - 1645
  • [8] Large-Scale Machine Learning with Stochastic Gradient Descent
    Bottou, Leon
    [J]. COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, : 177 - 186
  • [9] Boyd N., 2018, BIORXIV, DOI [10.1101/267096v1, DOI 10.1101/267096V1]
  • [10] Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Model
    Cai, Jianrui
    Zeng, Hui
    Yong, Hongwei
    Cao, Zisheng
    Zhang, Lei
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3086 - 3095