Fast and Lightweight Network for Single Frame Structured Illumination Microscopy Super-Resolution

被引:8
|
作者
Cheng, Xi [1 ,2 ]
Li, Jun [1 ,2 ]
Dai, Qiang [3 ]
Fu, Zhenyong [1 ,2 ]
Yang, Jian [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens, Minist Educ, PCA Lab, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[3] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215031, Peoples R China
基金
中国博士后科学基金;
关键词
Lighting; Superresolution; Microscopy; Kernel; Convolution; Task analysis; Feature extraction; Image demoireing; structured illumination microscopy (SIM); superresolution; RESOLUTION;
D O I
10.1109/TIM.2022.3161721
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Structured illumination microscopy (SIM) is an important super-resolution-based microscopy technique that breaks the diffraction limit and enhances optical microscopy systems. With the development of biology and medical engineering, there is a high demand for real-time and robust SIM imaging under extreme low-light and short-exposure environments. Existing SIM techniques typically require multiple structured illumination frames to produce a high-resolution image. In this article, we propose a single-frame SIM (SF-SIM) based on deep learning. Our SF-SIM only needs one shot of a structured illumination frame and generates similar results compared with the traditional SIM systems that typically require 15 shots. In our SF-SIM, we propose a noise estimator that can effectively suppress the noise in the image and enable our method to work in the low-light and short-exposure environment without the need for stacking multiple frames for nonlocal denoising. We also design a bandpass attention module that makes our deep network more sensitive to the change of frequency and enhances the imaging quality. Our proposed SF-SIM is almost 14 times faster than traditional SIM methods when achieving similar results. Therefore, our method is significantly valuable for the development of microbiology and medicine.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Label-Free Super-Resolution Microscopy with Coherent Nonlinear Structured-Illumination
    Huttunen, Mikko J.
    Abbas, Aazad
    Upham, Jeremy
    Boyd, Robert W.
    2018 20TH ANNIVERSARY INTERNATIONAL CONFERENCE ON TRANSPARENT OPTICAL NETWORKS (ICTON), 2018,
  • [22] Label-free super-resolution with coherent nonlinear structured-illumination microscopy
    Huttunen, Mikko J.
    Abbas, Aazad
    Upham, Jeremy
    Boyd, Robert W.
    JOURNAL OF OPTICS, 2017, 19 (08)
  • [23] Spectrum-optimized direct image reconstruction of super-resolution structured illumination microscopy
    Wen, Gang
    Li, Simin
    Liang, Yong
    Wang, Linbo
    Zhang, Jie
    Chen, Xiaohu
    Jin, Xin
    Chen, Chong
    Tang, Yuguo
    Li, Hui
    PHOTONIX, 2023, 4 (01)
  • [24] Fast Single Frame Super-Resolution Using Perceptual Visibility Optimization
    Liang, Luhong
    Luo, Peng
    Cheung, Wai Keung
    Chiu, King Hung
    2014 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2014, : 2716 - 2719
  • [25] An efficient lightweight network for single image super-resolution*
    Tang, Yinggan
    Zhang, Xiang
    Zhang, Xuguang
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 93
  • [26] Super-resolution confocal microscopy with structured detection
    Wang, Baokai
    Zou, Limin
    Zhang, Su
    Tan, Jiubin
    OPTICS COMMUNICATIONS, 2016, 381 : 277 - 281
  • [27] Super-resolution photoacoustic microscopy using blind structured illumination
    Murray, Todd W.
    Haltmeier, Markus
    Berer, Thomas
    Leiss-Holzinger, Elisabeth
    Burgholzer, Peter
    OPTICA, 2017, 4 (01): : 17 - 22
  • [28] Super-resolution video microscopy of live cells by structured illumination
    Kner, Peter
    Chhun, Bryant B.
    Griffis, Eric R.
    Winoto, Lukman
    Gustafsson, Mats G. L.
    NATURE METHODS, 2009, 6 (05) : 339 - U36
  • [29] SIMcheck: a Toolbox for Successful Super-resolution Structured Illumination Microscopy
    Ball, Graeme
    Demmerle, Justin
    Kaufmann, Rainer
    Davis, Ilan
    Dobbie, Ian M.
    Schermelleh, Lothar
    SCIENTIFIC REPORTS, 2015, 5
  • [30] Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network
    Ahn, Namhyuk
    Kang, Byungkon
    Sohn, Kyung-Ah
    COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 : 256 - 272