Fast and Lightweight Network for Single Frame Structured Illumination Microscopy Super-Resolution

被引:8
|
作者
Cheng, Xi [1 ,2 ]
Li, Jun [1 ,2 ]
Dai, Qiang [3 ]
Fu, Zhenyong [1 ,2 ]
Yang, Jian [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens, Minist Educ, PCA Lab, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[3] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215031, Peoples R China
基金
中国博士后科学基金;
关键词
Lighting; Superresolution; Microscopy; Kernel; Convolution; Task analysis; Feature extraction; Image demoireing; structured illumination microscopy (SIM); superresolution; RESOLUTION;
D O I
10.1109/TIM.2022.3161721
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Structured illumination microscopy (SIM) is an important super-resolution-based microscopy technique that breaks the diffraction limit and enhances optical microscopy systems. With the development of biology and medical engineering, there is a high demand for real-time and robust SIM imaging under extreme low-light and short-exposure environments. Existing SIM techniques typically require multiple structured illumination frames to produce a high-resolution image. In this article, we propose a single-frame SIM (SF-SIM) based on deep learning. Our SF-SIM only needs one shot of a structured illumination frame and generates similar results compared with the traditional SIM systems that typically require 15 shots. In our SF-SIM, we propose a noise estimator that can effectively suppress the noise in the image and enable our method to work in the low-light and short-exposure environment without the need for stacking multiple frames for nonlocal denoising. We also design a bandpass attention module that makes our deep network more sensitive to the change of frequency and enhances the imaging quality. Our proposed SF-SIM is almost 14 times faster than traditional SIM methods when achieving similar results. Therefore, our method is significantly valuable for the development of microbiology and medicine.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Multifocus structured illumination microscopy for fast volumetric super-resolution imaging
    Abrahamsson, Sara
    Blom, Hans
    Agostinho, Ana
    Jans, Daniel C.
    Jost, Aurelie
    Mueller, Marcel
    Nilsson, Linnea
    Bernhem, Kristoffer
    Lambert, Talley J.
    Heintzmann, Rainer
    Brismar, Hjalmar
    BIOMEDICAL OPTICS EXPRESS, 2017, 8 (09): : 4135 - 4140
  • [2] Super-resolution reconstruction theory in structured illumination microscopy
    Zhou X.
    Dan D.
    Qian J.
    Yao B.
    Lei M.
    Lei, Ming (leiming@opt.ac.cn), 1600, Chinese Optical Society (37):
  • [3] Structured illumination microscopy for super-resolution and optical sectioning
    Dan, Dan
    Yao, Baoli
    Lei, Ming
    CHINESE SCIENCE BULLETIN, 2014, 59 (12): : 1291 - 1307
  • [4] Structured illumination microscopy for super-resolution and optical sectioning
    Dan Dan
    Baoli Yao
    Ming Lei
    Science Bulletin, 2014, (12) : 1291 - 1307
  • [5] Chiral structured illumination microscopy: fast imaging chiral domains at super-resolution
    Huang, Shiang-Yu
    Zhang, Jiwei
    Foerster, Ronny
    Karras, Christian
    Heintzmann, Rainer
    Huang, Jer-Shing
    UNCONVENTIONAL OPTICAL IMAGING III, 2022, 12136
  • [6] Super-resolution scanning microscopy with virtually structured illumination
    Zhang, Su
    Li, Jingtao
    Zou, Limin
    Ding, Xuemei
    TENTH INTERNATIONAL SYMPOSIUM ON PRECISION ENGINEERING MEASUREMENTS AND INSTRUMENTATION, 2019, 11053
  • [7] Investigation on Super-resolution Image Reconstruction for Structured Illumination Microscopy in the Spatial Domain
    Huang Caihong
    Zhu Xingxing
    Guo Wei
    Yi Dingrong
    Jin Fujiang
    Huang Lei
    ACTA PHOTONICA SINICA, 2022, 51 (11)
  • [8] Super-Resolution by Structured Illumination: Digital Holographic Microscopy for Metrology of Nanomaterials
    Shaji, Athira
    Sheeja, M. K.
    PHYSICA STATUS SOLIDI-RAPID RESEARCH LETTERS, 2025, 19 (04):
  • [9] Speckle Flow Structured Illumination Microscopy for dynamic super-resolution imaging
    Cao, Ruiming
    Liu, Fanglin Linda
    Yeh, Li-Hao
    Meng, Guanghan
    Waller, Laura
    HIGH-SPEED BIOMEDICAL IMAGING AND SPECTROSCOPY VIII, 2023, 12390
  • [10] Photoacoustic super-resolution microscopy using blind structured speckle illumination
    Burgholzer, P.
    Murray, T. W.
    Haltmeier, M.
    Leiss-Holzinger, E.
    Berer, T.
    PHOTONS PLUS ULTRASOUND: IMAGING AND SENSING 2017, 2017, 10064