Fast and Lightweight Network for Single Frame Structured Illumination Microscopy Super-Resolution

被引:8
|
作者
Cheng, Xi [1 ,2 ]
Li, Jun [1 ,2 ]
Dai, Qiang [3 ]
Fu, Zhenyong [1 ,2 ]
Yang, Jian [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens, Minist Educ, PCA Lab, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing 210094, Peoples R China
[3] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215031, Peoples R China
基金
中国博士后科学基金;
关键词
Lighting; Superresolution; Microscopy; Kernel; Convolution; Task analysis; Feature extraction; Image demoireing; structured illumination microscopy (SIM); superresolution; RESOLUTION;
D O I
10.1109/TIM.2022.3161721
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Structured illumination microscopy (SIM) is an important super-resolution-based microscopy technique that breaks the diffraction limit and enhances optical microscopy systems. With the development of biology and medical engineering, there is a high demand for real-time and robust SIM imaging under extreme low-light and short-exposure environments. Existing SIM techniques typically require multiple structured illumination frames to produce a high-resolution image. In this article, we propose a single-frame SIM (SF-SIM) based on deep learning. Our SF-SIM only needs one shot of a structured illumination frame and generates similar results compared with the traditional SIM systems that typically require 15 shots. In our SF-SIM, we propose a noise estimator that can effectively suppress the noise in the image and enable our method to work in the low-light and short-exposure environment without the need for stacking multiple frames for nonlocal denoising. We also design a bandpass attention module that makes our deep network more sensitive to the change of frequency and enhances the imaging quality. Our proposed SF-SIM is almost 14 times faster than traditional SIM methods when achieving similar results. Therefore, our method is significantly valuable for the development of microbiology and medicine.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Temporal focusing microscopy with structured illumination for super-resolution deep imaging
    Isobe, Keisuke
    Mochizuki, Kyohei
    Song, Qiyuan
    Suda, Akira
    Kannari, Fumihiko
    Kawano, Hiroyuki
    Kumagai, Akiko
    Miyawaki, Atsushi
    Midorikawa, Katsumi
    2014 CONFERENCE ON LASERS AND ELECTRO-OPTICS (CLEO), 2014,
  • [42] A lightweight network with bidirectional constraints for single image super-resolution
    Chen, Liangliang
    Guo, Lin
    Cheng, Deqiang
    Kou, Qiqi
    Gao, Rui
    OPTIK, 2021, 239
  • [43] A Lightweight Pyramid Feature Fusion Network for Single Image Super-Resolution Reconstruction
    Liu, Bingzan
    Ning, Xin
    Ma, Shichao
    Lian, Xiaobin
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1575 - 1579
  • [44] Structured illumination ophthalmoscope: super-resolution microscopy on the living human eye
    Schock, Florian
    Best, Gerrit
    Celik, Nil
    Heintzmann, Rainer
    Dithmar, Stefan
    Cremer, Christoph
    PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2022, 380 (2220):
  • [45] Two-photon excitation structured illumination super-resolution microscopy
    Zheng, Wei
    ADVANCED OPTICAL IMAGING TECHNOLOGIES, 2018, 10816
  • [46] Super-resolution reconstruction of structured illumination microscopy based on pixel reassignment
    Liu, Xing
    Fang, Xiang
    Lei, Yunze
    Li, Jiaoyue
    An, Sha
    Zheng, Juanjuan
    Ma, Ying
    Ma, Haiyang
    Zalevsky, Zeev
    Gao, Peng
    APPLIED PHYSICS LETTERS, 2023, 123 (13)
  • [47] Super-Resolution Structured Illumination Microscopy for the Visualization of Interactions between Mitochondria and Lipid Droplets
    He, Ting
    Hu, Xuejuan
    Hu, Kai
    Liu, Jingxin
    Zhang, Jiaming
    Tan, Yadan
    Yang, Xiaokun
    Wang, Hengliang
    Liang, Yifei
    Liu, Shiqian
    Ye, Jianze
    PHOTONICS, 2023, 10 (03)
  • [48] Spectrum-optimized direct image reconstruction of super-resolution structured illumination microscopy
    Gang Wen
    Simin Li
    Yong Liang
    Linbo Wang
    Jie Zhang
    Xiaohu Chen
    Xin Jin
    Chong Chen
    Yuguo Tang
    Hui Li
    PhotoniX, 4
  • [49] A millisecond structured illumination microscope for super-resolution live cell imaging
    Suzuki, Tomu
    Kajimoto, Shinji
    Kitamura, Narufumi
    Takano-Kasuya, Mayumi
    Furusawa, Naoko
    Nakano, Yasushi
    Fukumura, Hiroshi
    Gonda, Kohsuke
    Nakabayashi, Takakazu
    APPLIED PHYSICS EXPRESS, 2020, 13 (04)
  • [50] Ultra-fast super-resolution imaging by time-stretch structured illumination
    Wang, Yuxi
    Guo, Qiang
    Chen, Hongwei
    Chen, Minghua
    Yang, Sigang
    2016 21ST OPTOELECTRONICS AND COMMUNICATIONS CONFERENCE (OECC) HELD JOINTLY WITH 2016 INTERNATIONAL CONFERENCE ON PHOTONICS IN SWITCHING (PS), 2016,