Fast structured illumination microscopy via transfer learning with correcting

被引:7
作者
Luo, Fan [1 ]
Zeng, Jiaqi [1 ]
Shao, Zongshuo [1 ]
Zhang, Chonglei [1 ]
机构
[1] Shenzhen Univ, Nanophoton Res Ctr Shenzhen Key Lab Microscale Opt, Shenzhen 518000, Peoples R China
关键词
REDUCED NUMBER; RESOLUTION; RECONSTRUCTION; IMAGES;
D O I
10.1016/j.optlaseng.2022.107432
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
In microscopic imaging, structured light illumination technology has emerged as a significant super-resolution imaging technique due to its inherent advantages, including rapid imaging speed and low phototoxicity. However, the conventional super-resolution image reconstruction algorithm is still widely used today, despite its slow calculation speed, difficulty in setting parameters, and unpredictable artifact generation. With the advancement of computer technology, image reconstruction and artifact removal can be accomplished rapidly using deep learning. Nowadays, deep learning training requires a large number of data samples, but obtaining a large number of biological samples under structured light illumination is difficult. This paper proposes a new method based on transfer learning that generates a pre-training network using its own simulation data and trains a correction using a small amount of biological sample data to achieve super-resolution imaging of biological samples. Additionally, it can reconstruct sampled wide-field images from 9 to 3 frames, as well as the trained network, which can quickly reconstruct structure illumination microscopy(SIM).
引用
收藏
页数:9
相关论文
共 36 条
[1]  
Abbe E., 1873, ARCH MICROSC ANATO, V9, P413
[2]   Applications, promises, and pitfalls of deep learning for fluorescence image reconstruction [J].
Belthangady, Chinmay ;
Royer, Loic A. .
NATURE METHODS, 2019, 16 (12) :1215-1225
[3]  
Burke LA., 2007, HUM RESOUR DEV REV, V6, P263, DOI [10.1177/1534484307303035, DOI 10.1177/1534484307303035]
[4]  
Chen WY, 2020, Arxiv, DOI arXiv:1904.04232
[5]   Multi-color live-cell super-resolution volume imaging with multi-angle interference microscopy [J].
Chen, Youhua ;
Liu, Wenjie ;
Zhang, Zhimin ;
Zheng, Cheng ;
Huang, Yujia ;
Cao, Ruizhi ;
Zhu, Dazhao ;
Xu, Liang ;
Zhang, Meng ;
Zhang, Yu-Hui ;
Fan, Jiannan ;
Jin, Luhong ;
Xu, Yingke ;
Kuang, Cuifang ;
Liu, Xu .
NATURE COMMUNICATIONS, 2018, 9
[6]   ML-SIM: universal reconstruction of structured illumination microscopy images using transfer learning [J].
Christensen, Charles N. ;
Ward, Edward N. ;
Lu, Meng ;
Lio, Pietro ;
Kaminski, Clemens F. .
BIOMEDICAL OPTICS EXPRESS, 2021, 12 (05) :2720-2733
[7]   Resolution doubling with a reduced number of image acquisitions [J].
Dong, Siyuan ;
Liao, Jun ;
Guo, Kaikai ;
Bian, Liheng ;
Suo, Jinli ;
Zheng, Guoan .
BIOMEDICAL OPTICS EXPRESS, 2015, 6 (08) :2946-2952
[8]   U-Net: deep learning for cell counting, detection, and morphometry [J].
Falk, Thorsten ;
Mai, Dominic ;
Bensch, Robert ;
Cicek, Oezguen ;
Abdulkadir, Ahmed ;
Marrakchi, Yassine ;
Boehm, Anton ;
Deubner, Jan ;
Jaeckel, Zoe ;
Seiwald, Katharina ;
Dovzhenko, Alexander ;
Tietz, Olaf ;
Dal Bosco, Cristina ;
Walsh, Sean ;
Saltukoglu, Deniz ;
Tay, Tuan Leng ;
Prinz, Marco ;
Palme, Klaus ;
Simons, Matias ;
Diester, Ilka ;
Brox, Thomas ;
Ronneberger, Olaf .
NATURE METHODS, 2019, 16 (01) :67-+
[9]   Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy [J].
Gustafsson, MGL .
JOURNAL OF MICROSCOPY, 2000, 198 (02) :82-87
[10]   Laterally modulated excitation microscopy: Improvement of resolution by using a diffraction grating [J].
Heintzmann, R ;
Cremer, C .
OPTICAL BIOPSIES AND MICROSCOPIC TECHNIQUES III, PROCEEDINGS OF, 1999, 3568 :185-196