Fast and Lightweight Network for Single Frame Structured Illumination Microscopy Super-Resolution

被引:9
|
作者
Cheng, Xi [1 ,2 ]
Li, Jun [1 ,2 ]
Dai, Qiang [3 ]
Fu, Zhenyong [1 ,2 ]
Yang, Jian [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens, Minist Educ, PCA Lab, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[3] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215031, Peoples R China
基金
中国博士后科学基金;
关键词
Lighting; Superresolution; Microscopy; Kernel; Convolution; Task analysis; Feature extraction; Image demoireing; structured illumination microscopy (SIM); superresolution; RESOLUTION;
D O I
10.1109/TIM.2022.3161721
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Structured illumination microscopy (SIM) is an important super-resolution-based microscopy technique that breaks the diffraction limit and enhances optical microscopy systems. With the development of biology and medical engineering, there is a high demand for real-time and robust SIM imaging under extreme low-light and short-exposure environments. Existing SIM techniques typically require multiple structured illumination frames to produce a high-resolution image. In this article, we propose a single-frame SIM (SF-SIM) based on deep learning. Our SF-SIM only needs one shot of a structured illumination frame and generates similar results compared with the traditional SIM systems that typically require 15 shots. In our SF-SIM, we propose a noise estimator that can effectively suppress the noise in the image and enable our method to work in the low-light and short-exposure environment without the need for stacking multiple frames for nonlocal denoising. We also design a bandpass attention module that makes our deep network more sensitive to the change of frequency and enhances the imaging quality. Our proposed SF-SIM is almost 14 times faster than traditional SIM methods when achieving similar results. Therefore, our method is significantly valuable for the development of microbiology and medicine.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Super-Resolution Structured Illumination Microscopy
    Heintzmann, Rainer
    Huser, Thomas
    CHEMICAL REVIEWS, 2017, 117 (23) : 13890 - 13908
  • [2] Multifocus structured illumination microscopy for fast volumetric super-resolution imaging
    Abrahamsson, Sara
    Blom, Hans
    Agostinho, Ana
    Jans, Daniel C.
    Jost, Aurelie
    Mueller, Marcel
    Nilsson, Linnea
    Bernhem, Kristoffer
    Lambert, Talley J.
    Heintzmann, Rainer
    Brismar, Hjalmar
    BIOMEDICAL OPTICS EXPRESS, 2017, 8 (09): : 4135 - 4140
  • [3] Chiral structured illumination microscopy: fast imaging chiral domains at super-resolution
    Huang, Shiang-Yu
    Zhang, Jiwei
    Foerster, Ronny
    Karras, Christian
    Heintzmann, Rainer
    Huang, Jer-Shing
    UNCONVENTIONAL OPTICAL IMAGING III, 2022, 12136
  • [4] Super-resolution reconstruction theory in structured illumination microscopy
    Zhou X.
    Dan D.
    Qian J.
    Yao B.
    Lei M.
    Lei, Ming (leiming@opt.ac.cn), 1600, Chinese Optical Society (37):
  • [5] In-Vivo Super-Resolution Microscopy by Structured Illumination
    Gustafsson, Mats G. L.
    BIOPHYSICAL JOURNAL, 2009, 96 (03) : 202A - 202A
  • [6] Structured illumination microscopy for super-resolution and optical sectioning
    Dan, Dan
    Yao, Baoli
    Lei, Ming
    CHINESE SCIENCE BULLETIN, 2014, 59 (12): : 1291 - 1307
  • [7] Structured Illumination Microscopy and Super-resolution Image Reconstruction
    Bi, Ying
    Qian, Jiaming
    Cao, Yu
    TWELFTH INTERNATIONAL CONFERENCE ON INFORMATION OPTICS AND PHOTONICS (CIOP 2021), 2021, 12057
  • [8] Structured illumination microscopy for super-resolution and optical sectioning
    Dan Dan
    Baoli Yao
    Ming Lei
    Science Bulletin, 2014, (12) : 1291 - 1307
  • [9] Super-resolution scanning microscopy with virtually structured illumination
    Zhang, Su
    Li, Jingtao
    Zou, Limin
    Ding, Xuemei
    TENTH INTERNATIONAL SYMPOSIUM ON PRECISION ENGINEERING MEASUREMENTS AND INSTRUMENTATION, 2019, 11053
  • [10] Fast, long-term, super-resolution imaging with Hessian structured illumination microscopy
    Xiaoshuai Huang
    Junchao Fan
    Liuju Li
    Haosen Liu
    Runlong Wu
    Yi Wu
    Lisi Wei
    Heng Mao
    Amit Lal
    Peng Xi
    Liqiang Tang
    Yunfeng Zhang
    Yanmei Liu
    Shan Tan
    Liangyi Chen
    Nature Biotechnology, 2018, 36 : 451 - 459