Gigapixel imaging with a novel multi-camera array microscope

被引:14
作者
Thomson, Eric E. [1 ]
Harfouche, Mark [2 ]
Kim, Kanghyun [3 ]
Konda, Pavan C. [3 ]
Seitz, Catherine W. [1 ]
Cooke, Colin [3 ]
Xu, Shiqi [3 ]
Jacobs, Whitney S. [1 ]
Blazing, Robin [1 ]
Chen, Yang [1 ]
Sharma, Sunanda [2 ]
Dunn, Timothy W. [3 ]
Park, Jaehee [2 ]
Horstmeyer, Roarke W. [2 ,3 ]
Naumann, Eva A. [1 ]
机构
[1] Duke Sch Med, Dept Neurobiol, Durham, NC 27710 USA
[2] Ramona Opt Inc, Durham, NC 27701 USA
[3] Duke Univ, Biomed Engn, Durham, NC 27708 USA
来源
ELIFE | 2022年 / 11卷
基金
美国国家科学基金会; 美国国家卫生研究院;
关键词
microscopy; computational optics; computational imaging; behavioral analysis; Physarum polycephalum; Camponotus pennsylvanicus; calcium imaging; C; elegans; D; melanogaster; Zebrafish; STRUCTURED-ILLUMINATION MICROSCOPY; HIGH-RESOLUTION; LIGHT-FIELD; PHYSARUM-POLYCEPHALUM; HIGH-THROUGHPUT; ZEBRAFISH; BEHAVIOR; ELEGANS; PROTEIN; DYNAMICS;
D O I
10.7554/eLife.74988
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
The dynamics of living organisms are organized across many spatial scales. However, current cost-effective imaging systems can measure only a subset of these scales at once. We have created a scalable multi-camera array microscope (MCAM) that enables comprehensive high-resolution recording from multiple spatial scales simultaneously, ranging from structures that approach the cellular scale to large-group behavioral dynamics. By collecting data from up to 96 cameras, we computationally generate gigapixel-scale images and movies with a field of view over hundreds of square centimeters at an optical resolution of 18 mu m. This allows us to observe the behavior and fine anatomical features of numerous freely moving model organisms on multiple spatial scales, including larval zebrafish, fruit flies, nematodes, carpenter ants, and slime mold. Further, the MCAM architecture allows stereoscopic tracking of the z-position of organisms using the overlapping field of view from adjacent cameras. Overall, by removing the bottlenecks imposed by single-camera image acquisition systems, the MCAM provides a powerful platform for investigating detailed biological features and behavioral processes of small model organisms across a wide range of spatial scales.
引用
收藏
页数:47
相关论文
共 108 条
[1]   Two-photon calcium imaging during fictive navigation in virtual environments [J].
Ahrens, Misha B. ;
Huang, Kuo Hua ;
Narayan, Sujatha ;
Mensh, Brett D. ;
Engert, Florian .
FRONTIERS IN NEURAL CIRCUITS, 2013, 7
[2]   Physarum [J].
Alim, Karen ;
Andrew, Natalie ;
Pringle, Anne .
CURRENT BIOLOGY, 2013, 23 (24) :R1082-R1083
[3]   3-D Stacked Image Sensor With Deep Neural Network Computation [J].
Amir, Mohammad Faisal ;
Ko, Jong Hwan ;
Na, Taesik ;
Kim, Duckhwan ;
Mukhopadhyay, Saibal .
IEEE SENSORS JOURNAL, 2018, 18 (10) :4187-4199
[4]   Random access parallel microscopy [J].
Ashraf, Mishal ;
Mohanan, Sharika ;
Sim, Byu Ri ;
Tam, Anthony ;
Rahemipour, Kiamehr ;
Brousseau, Denis ;
Thibault, Simon ;
Corbett, Alexander D. ;
Bub, Gil .
ELIFE, 2021, 10
[5]   A novel approach to the human connectome: Ultra-high resolution mapping of fiber tracts in the brain [J].
Axer, Markus ;
Amunts, Katrin ;
Graessel, David ;
Palm, Christoph ;
Dammers, Juergen ;
Axer, Hubertus ;
Pietrzyk, Uwe ;
Zilles, Karl .
NEUROIMAGE, 2011, 54 (02) :1091-1101
[6]  
Bertinetto L, 2021, Arxiv, DOI arXiv:1606.09549
[7]   Depth discontinuities by pixel-to-pixel stereo [J].
Birchfield, S ;
Tomasi, C .
SIXTH INTERNATIONAL CONFERENCE ON COMPUTER VISION, 1998, :1073-1080
[8]   Elements of a stochastic 3D prediction engine in larval zebrafish prey capture [J].
Bolton, Andrew D. ;
Haesemeyer, Martin ;
Jordi, Josua ;
Schaechtle, Ulrich ;
Saad, Feras A. ;
Mansinghka, Vikash K. ;
Tenenbaum, Joshua B. ;
Engert, Florian .
ELIFE, 2019, 8
[9]   Multiscale gigapixel photography [J].
Brady, D. J. ;
Gehm, M. E. ;
Stack, R. A. ;
Marks, D. L. ;
Kittle, D. S. ;
Golish, D. R. ;
Vera, E. M. ;
Feller, S. D. .
NATURE, 2012, 486 (7403) :386-389
[10]   Parallel cameras [J].
Brady, David J. ;
Pang, Wubin ;
Li, Han ;
Ma, Zhan ;
Tao, Yue ;
Cao, Xun .
OPTICA, 2018, 5 (02) :127-137