DMF-SIM: Dual-Model Framework for super-resolution reconstruction and denoising in Structured Illumination Microscopy

被引:0
作者
Huo, Yue [1 ]
Deng, Zhi [1 ]
Zhang, Peng [1 ,2 ]
Lu, Zixuan [1 ]
Zhang, Feifan [1 ]
Li, Meiqi [2 ]
Hou, Yiwei [2 ]
Xi, Peng
Huang, Wei [3 ,4 ]
Zhang, Yanning
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710129, Shaanxi, Peoples R China
[2] Peking Univ, Coll Future Technol, Dept Biomed Engn, Beijing 100871, Peoples R China
[3] Yichun Univ, Yichun 336000, Jiangxi, Peoples R China
[4] Nanchang Univ, Dept Comp Sci, Nanchang 330031, Jiangxi, Peoples R China
关键词
Structured illumination microscopy; Super-resolution; Image reconstruction; Denoising; Vision transformer; Channel attention; RESOLUTION;
D O I
10.1016/j.patcog.2025.111865
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Super-Resolution Structured Illumination Microscopy (SR-SIM) is usually challenged by the balance between imaging quality and continuous imaging, especially in low-light imaging conditions, where obtaining a high Signal-to-Noise Ratio (SNR) is even tougher due to the intrinsic mechanism of sensor noise and detection limitations. In more recent studies, a promising solution to overcome this limitation is a combination of traditional methods with deep neural networks. However, the incorporation of extrinsic optical information weakens robustness across different imaging conditions due to complex processing requirements. Additionally, the high computational cost and need for extensive training data limit the overall performance from reaching further improvements. Motivated by the complementary strengths of vision transformers and channel attention mechanisms, in this paper, we propose a Dual-Model Framework in Structured Illumination Microscopy (DMF-SIM) to achieve simultaneous super-resolution reconstruction and denoising by integrating a reconstruction model (SIM-Rec) and a denoising model (SIM-Den). DMF-SIM integrates super-resolution and denoising models by effectively combining vision transformer and channel attention mechanisms, and a substantial performance improvement has been achieved over single-task models. The experiments also demonstrate enhanced image quality and noise reduction across various imaging conditions.
引用
收藏
页数:12
相关论文
共 52 条
[1]  
BAILEY B, 1994, P SOC PHOTO-OPT INS, V2184, P208, DOI 10.1117/12.172101
[2]   Activating More Pixels in Image Super-Resolution Transformer [J].
Chen, Xiangyu ;
Wang, Xintao ;
Zhou, Jiantao ;
Qiao, Yu ;
Dong, Chao .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :22367-22377
[3]   Superresolution structured illumination microscopy reconstruction algorithms: a review [J].
Chen, Xin ;
Zhong, Suyi ;
Hou, Yiwei ;
Cao, Ruijie ;
Wang, Wenyi ;
Li, Dong ;
Dai, Qionghai ;
Kim, Donghyun ;
Xi, Peng .
LIGHT-SCIENCE & APPLICATIONS, 2023, 12 (01)
[4]   ML-SIM: universal reconstruction of structured illumination microscopy images using transfer learning [J].
Christensen, Charles N. ;
Ward, Edward N. ;
Lu, Meng ;
Lio, Pietro ;
Kaminski, Clemens F. .
BIOMEDICAL OPTICS EXPRESS, 2021, 12 (05) :2720-2733
[5]  
Dempsey GT, 2011, NAT METHODS, V8, P1027, DOI [10.1038/NMETH.1768, 10.1038/nmeth.1768]
[6]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[7]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[8]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[9]   Multiscale Vision Transformers [J].
Fan, Haoqi ;
Xiong, Bo ;
Mangalam, Karttikeya ;
Li, Yanghao ;
Yan, Zhicheng ;
Malik, Jitendra ;
Feichtenhofer, Christoph .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :6804-6815
[10]   Implicit Diffusion Models for Continuous Super-Resolution [J].
Gao, Sicheng ;
Liu, Xuhui ;
Zeng, Bohan ;
Xu, Sheng ;
Li, Yanjing ;
Luo, Xiaoyan ;
Liu, Jianzhuang ;
Zhen, Xiantong ;
Zhang, Baochang .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :10021-10030