GPU-accelerated real-time reconstruction in Python']Python of three-dimensional datasets from structured illumination microscopy with hexagonal patterns

被引:15
作者
Gong, Hai [1 ]
Guo, Wenjun [1 ]
Neil, Mark A. A. [1 ]
机构
[1] Imperial Coll, Dept Phys, Blackett Lab, Prince Consort Rd, London SW7 2AZ, England
来源
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES | 2021年 / 379卷 / 2199期
关键词
structured illumination microscopy; light-sheet microscopy; super-resolution microscopy; fluorescence microscopy; reconstruction algorithm; GPU processing; SHEET FLUORESCENCE MICROSCOPY; EXCITATION MICROSCOPY; LATERAL RESOLUTION; OPTICAL RESOLUTION; PHASE; LIMIT; SUPERRESOLUTION; CELLS;
D O I
10.1098/rsta.2020.0162
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
We present a structured illumination microscopy system that projects a hexagonal pattern by the interference among three coherent beams, suitable for implementation in a light-sheet geometry. Seven images acquired as the illumination pattern is shifted laterally can be processed to produce a super-resolved image that surpasses the diffraction-limited resolution by a factor of over 2 in an exemplar light-sheet arrangement. Three methods of processing data are discussed depending on whether the raw images are available in groups of seven, individually in a stream or as a larger batch representing a three-dimensional stack. We show that imaging axially moving samples can introduce artefacts, visible as fine structures in the processed images. However, these artefacts are easily removed by a filtering operation carried out as part of the batch processing algorithm for three-dimensional stacks. The reconstruction algorithms implemented in Python include specific optimizations for calculation on a graphics processing unit and we demonstrate its operation on experimental data of static objects and on simulated data of moving objects. We show that the software can process over 239 input raw frames per second at 512 x 512 pixels, generating over 34 super-resolved frames per second at 1024 x 1024 pixels. This article is part of the Theo Murphy meeting issue 'Super-resolution structured illumination microscopy (part 1)'.
引用
收藏
页数:17
相关论文
共 46 条
[1]   Two-beam interference lattice lightsheet for structured illumination microscopy [J].
Chang, Bo-Jui ;
Tang, Wei-Chun ;
Liu, Yen-Ting ;
Tsai, Yun-Chi ;
Tsao, Chieh ;
Chen, Peilin ;
Chen, Bi-Chang .
JOURNAL OF PHYSICS D-APPLIED PHYSICS, 2020, 53 (04)
[2]   csiLSFM combines light- sheet fluorescence microscopy and coherent structured illumination for a lateral resolution below 100 nm [J].
Chang, Bo-Jui ;
Meza, Victor Didier Perez ;
Stelzer, Ernst H. K. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2017, 114 (19) :4869-4874
[3]   Lattice light-sheet microscopy: Imaging molecules to embryos at high spatiotemporal resolution [J].
Chen, Bi-Chang ;
Legant, Wesley R. ;
Wang, Kai ;
Shao, Lin ;
Milkie, Daniel E. ;
Davidson, Michael W. ;
Janetopoulos, Chris ;
Wu, Xufeng S. ;
Hammer, John A., III ;
Liu, Zhe ;
English, Brian P. ;
Mimori-Kiyosue, Yuko ;
Romero, Daniel P. ;
Ritter, Alex T. ;
Lippincott-Schwartz, Jennifer ;
Fritz-Laylin, Lillian ;
Mullins, R. Dyche ;
Mitchell, Diana M. ;
Bembenek, Joshua N. ;
Reymann, Anne-Cecile ;
Boehme, Ralph ;
Grill, Stephan W. ;
Wang, Jennifer T. ;
Seydoux, Geraldine ;
Tulu, U. Serdar ;
Kiehart, Daniel P. ;
Betzig, Eric .
SCIENCE, 2014, 346 (6208) :439-+
[4]   Image reconstruction for structured-illumination microscopy with low signal level [J].
Chu, Kaiqin ;
McMillan, Paul J. ;
Smith, Zachary J. ;
Yin, Jie ;
Atkins, Jeniffer ;
Goodwin, Paul ;
Wachsmann-Hogiu, Sebastian ;
Lane, Stephen .
OPTICS EXPRESS, 2014, 22 (07) :8687-8702
[5]   Strategic and practical guidelines for successful structured illumination microscopy [J].
Demmerle, Justin ;
Innocent, Cassandravictoria ;
North, Alison J. ;
Ball, Graeme ;
Mueller, Marcel ;
Miron, Ezequiel ;
Matsuda, Atsushi ;
Dobbie, Ian M. ;
Markaki, Yolanda ;
Schermelleh, Lothar .
NATURE PROTOCOLS, 2017, 12 (05) :988-1010
[6]   Parameter-free image resolution estimation based on decorrelation analysis [J].
Descloux, A. ;
Grussmayer, K. S. ;
Radenovic, A. .
NATURE METHODS, 2019, 16 (09) :918-+
[7]   True optical resolution beyond the Rayleigh limit achieved by standing wave illumination [J].
Frohn, JT ;
Knapp, HF ;
Stemmer, A .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2000, 97 (13) :7232-7236
[8]   Noninvasive Imaging beyond the Diffraction Limit of 3D Dynamics in Thickly Fluorescent Specimens [J].
Gao, Liang ;
Shao, Lin ;
Higgins, Christopher D. ;
Poulton, John S. ;
Peifer, Mark ;
Davidson, Michael W. ;
Wu, Xufeng ;
Goldstein, Bob ;
Betzig, Eric .
CELL, 2012, 151 (06) :1370-1385
[9]  
Gomersall H., 2016, PYFFTW PYTHONIC PYTH
[10]   Three-dimensional resolution doubling in wide-field fluorescence microscopy by structured illumination [J].
Gustafsson, Mats G. L. ;
Shao, Lin ;
Carlton, Peter M. ;
Wang, C. J. Rachel ;
Golubovskaya, Inna N. ;
Cande, W. Zacheus ;
Agard, David A. ;
Sedat, John W. .
BIOPHYSICAL JOURNAL, 2008, 94 (12) :4957-4970