Fast and Lightweight Network for Single Frame Structured Illumination Microscopy Super-Resolution

被引:8
|
作者
Cheng, Xi [1 ,2 ]
Li, Jun [1 ,2 ]
Dai, Qiang [3 ]
Fu, Zhenyong [1 ,2 ]
Yang, Jian [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens, Minist Educ, PCA Lab, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[3] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215031, Peoples R China
基金
中国博士后科学基金;
关键词
Lighting; Superresolution; Microscopy; Kernel; Convolution; Task analysis; Feature extraction; Image demoireing; structured illumination microscopy (SIM); superresolution; RESOLUTION;
D O I
10.1109/TIM.2022.3161721
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Structured illumination microscopy (SIM) is an important super-resolution-based microscopy technique that breaks the diffraction limit and enhances optical microscopy systems. With the development of biology and medical engineering, there is a high demand for real-time and robust SIM imaging under extreme low-light and short-exposure environments. Existing SIM techniques typically require multiple structured illumination frames to produce a high-resolution image. In this article, we propose a single-frame SIM (SF-SIM) based on deep learning. Our SF-SIM only needs one shot of a structured illumination frame and generates similar results compared with the traditional SIM systems that typically require 15 shots. In our SF-SIM, we propose a noise estimator that can effectively suppress the noise in the image and enable our method to work in the low-light and short-exposure environment without the need for stacking multiple frames for nonlocal denoising. We also design a bandpass attention module that makes our deep network more sensitive to the change of frequency and enhances the imaging quality. Our proposed SF-SIM is almost 14 times faster than traditional SIM methods when achieving similar results. Therefore, our method is significantly valuable for the development of microbiology and medicine.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Lightweight Attended Multi-Scale Residual Network for Single Image Super-Resolution
    Yan, Yitong
    Xu, Xue
    Chen, Wenhui
    Peng, Xinyi
    IEEE ACCESS, 2021, 9 (09): : 52202 - 52212
  • [32] Experimental Combination of Super-Resolution Optical Fluctuation Imaging with Structured Illumination Microscopy for Large Fields-of-View
    Descloux, Adrien C.
    Grussmayer, Kristin S.
    Navikas, Vytautas
    Mahecic, Dora
    Manley, Suliana
    Radenovic, Aleksandra
    ACS PHOTONICS, 2021, 8 (08) : 2440 - 2449
  • [33] Contextual Transformation Network for Lightweight Remote-Sensing Image Super-Resolution
    Wang, Shunzhou
    Zhou, Tianfei
    Lu, Yao
    Di, Huijun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [34] Super-resolution reconstruction of structured illumination microscopy using deep-learning and sparse deconvolution
    Song, Liangfeng
    Liu, Xin
    Xiong, Zihan
    Ahamed, Mostak
    An, Sha
    Zheng, Juanjuan
    Ma, Ying
    Gao, Peng
    OPTICS AND LASERS IN ENGINEERING, 2024, 174
  • [35] Dynamic super-resolution structured illumination imaging in the living brain
    Turcottea, Raphael
    Liang, Yajie
    Tanimoto, Masashi
    Zhang, Qinrong
    Li, Ziwei
    Koyama, Minoru
    Betzig, Eric
    Ji, Na
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2019, 116 (19) : 9586 - 9591
  • [36] Bilateral Upsampling Network for Single Image Super-Resolution With Arbitrary Scaling Factors
    Zhang, Menglei
    Ling, Qiang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4395 - 4408
  • [37] s-LWSR: Super Lightweight Super-Resolution Network
    Li, Biao
    Wang, Bo
    Liu, Jiabin
    Qi, Zhiquan
    Shi, Yong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 8368 - 8380
  • [38] Lightweight Feature Fusion Network for Single Image Super-Resolution
    Yang, Wenming
    Wang, Wei
    Zhang, Xuechen
    Sun, Shuifa
    Liao, Qingmin
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (04) : 538 - 542
  • [39] A lightweight generative adversarial network for single image super-resolution
    Xinbiao Lu
    Xupeng Xie
    Chunlin Ye
    Hao Xing
    Zecheng Liu
    Changchun Cai
    The Visual Computer, 2024, 40 : 41 - 52
  • [40] A lightweight generative adversarial network for single image super-resolution
    Lu, Xinbiao
    Xie, Xupeng
    Ye, Chunlin
    Xing, Hao
    Liu, Zecheng
    Cai, Changchun
    VISUAL COMPUTER, 2024, 40 (01) : 41 - 52