Fast and Lightweight Network for Single Frame Structured Illumination Microscopy Super-Resolution

被引:9
|
作者
Cheng, Xi [1 ,2 ]
Li, Jun [1 ,2 ]
Dai, Qiang [3 ]
Fu, Zhenyong [1 ,2 ]
Yang, Jian [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens, Minist Educ, PCA Lab, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[3] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215031, Peoples R China
基金
中国博士后科学基金;
关键词
Lighting; Superresolution; Microscopy; Kernel; Convolution; Task analysis; Feature extraction; Image demoireing; structured illumination microscopy (SIM); superresolution; RESOLUTION;
D O I
10.1109/TIM.2022.3161721
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Structured illumination microscopy (SIM) is an important super-resolution-based microscopy technique that breaks the diffraction limit and enhances optical microscopy systems. With the development of biology and medical engineering, there is a high demand for real-time and robust SIM imaging under extreme low-light and short-exposure environments. Existing SIM techniques typically require multiple structured illumination frames to produce a high-resolution image. In this article, we propose a single-frame SIM (SF-SIM) based on deep learning. Our SF-SIM only needs one shot of a structured illumination frame and generates similar results compared with the traditional SIM systems that typically require 15 shots. In our SF-SIM, we propose a noise estimator that can effectively suppress the noise in the image and enable our method to work in the low-light and short-exposure environment without the need for stacking multiple frames for nonlocal denoising. We also design a bandpass attention module that makes our deep network more sensitive to the change of frequency and enhances the imaging quality. Our proposed SF-SIM is almost 14 times faster than traditional SIM methods when achieving similar results. Therefore, our method is significantly valuable for the development of microbiology and medicine.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Super-resolution differential interference contrast microscopy by structured illumination
    Chen, Jianling
    Xu, Yan
    Lv, Xiaohua
    Lai, Xiaomin
    Zeng, Shaoqun
    OPTICS EXPRESS, 2013, 21 (01): : 112 - 121
  • [22] Structured illumination super-resolution microscopy technology : review and prospect
    Chen Ting-ai
    Chen Long-chao
    Li Hui
    Yu Jia
    Gao Yu-feng
    Zheng Wei
    CHINESE OPTICS, 2018, 11 (03): : 307 - 328
  • [23] Coherent super-resolution microscopy via laterally structured illumination
    Littleton, Brad
    Lai, Kim
    Longstaff, Dennis
    Sarafis, Vassilios
    Munroe, Paul
    Heckenberg, Norman
    Rubinsztein-Dunlop, Halina
    MICRON, 2007, 38 (02) : 150 - 157
  • [24] Super-Resolution Photoacoustic Microscopy Using Structured-Illumination
    Amjadian, Mohammadreza
    Mostafavi, Seyed Masood
    Chen, Jiangbo
    Kavehvash, Zahra
    Zhu, Jingyi
    Wang, Lidai
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (09) : 2197 - 2207
  • [25] Super-resolution structured illumination microscopy: past, present and future
    Prakash, Kirti
    Diederich, Benedict
    Reichelt, Stefanie
    Heintzmann, Rainer
    Schermelleh, Lothar
    PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2021, 379 (2199):
  • [26] Super-resolution video microscopy of live cells by structured illumination
    Kner, Peter
    Chhun, Bryant B.
    Griffis, Eric R.
    Winoto, Lukman
    Gustafsson, Mats G. L.
    NATURE METHODS, 2009, 6 (05) : 339 - U36
  • [27] Fusion diversion network for fast, accurate and lightweight single image super-resolution
    Gu, Zheng
    Chen, Liping
    Zheng, Yanhong
    Wang, Tong
    Li, Tieying
    SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (06) : 1351 - 1359
  • [28] Fusion diversion network for fast, accurate and lightweight single image super-resolution
    Zheng Gu
    Liping Chen
    Yanhong Zheng
    Tong Wang
    Tieying Li
    Signal, Image and Video Processing, 2021, 15 : 1351 - 1359
  • [29] Erratum: SIMcheck: a Toolbox for Successful Super-resolution Structured Illumination Microscopy
    Graeme Ball
    Justin Demmerle
    Rainer Kaufmann
    Ilan Davis
    Ian M. Dobbie
    Lothar Schermelleh
    Scientific Reports, 6
  • [30] Super-Resolution by Structured Illumination: Digital Holographic Microscopy for Metrology of Nanomaterials
    Shaji, Athira
    Sheeja, M. K.
    PHYSICA STATUS SOLIDI-RAPID RESEARCH LETTERS, 2025, 19 (04):