Tutorial on compressed ultrafast photography

被引:2
作者
Lai, Yingming [1 ]
Marquez, Miguel [1 ]
Liang, Jinyang [1 ]
机构
[1] Univ Quebec, Inst Natl Rech Sci, Ctr Energie Mat Telecommun, Lab Appl Computat Imaging, Quebec City, PQ, Canada
基金
芬兰科学院; 加拿大创新基金会; 加拿大自然科学与工程研究理事会;
关键词
single-shot computational imaging; coded optical imaging; compressed sensing; streak imaging; image reconstruction techniques; transient biomedical phenomena; PLAY ADMM; RECONSTRUCTION; TEMPERATURE; INVERSE; MICROSCOPY; STREAKING; RECOVERY; NETWORKS; DYNAMICS; TRACKING;
D O I
10.1117/1.JBO.29.S1.S11524
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Significance: Compressed ultrafast photography (CUP) is currently the world's fastest single-shot imaging technique. Through the integration of compressed sensing and streak imaging, CUP can capture a transient event in a single camera exposure with imaging speeds from thousands to trillions of frames per second, at micrometer-level spatial resolutions, and in broad sensing spectral ranges. Aim: This tutorial aims to provide a comprehensive review of CUP in its fundamental methods, system implementations, biomedical applications, and prospect. Approach: A step-by-step guideline to CUP's forward model and representative image reconstruction algorithms is presented with sample codes and illustrations in Matlab and Python. Then, CUP's hardware implementation is described with a focus on the representative techniques, advantages, and limitations of the three key components-the spatial encoder, the temporal shearing unit, and the two-dimensional sensor. Furthermore, four representative biomedical applications enabled by CUP are discussed, followed by the prospect of CUP's technical advancement. Conclusions: CUP has emerged as a state-of-the-art ultrafast imaging technology. Its advanced imaging ability and versatility contribute to unprecedented observations and new applications in biomedicine. CUP holds great promise in improving technical specifications and facilitating the investigation of biomedical processes.
引用
收藏
页数:40
相关论文
共 214 条
[61]   DeepBinaryMask: Learning a binary mask for video compressive sensing [J].
Iliadis, Michael ;
Spinoulas, Leonidas ;
Katsaggelos, Aggelos K. .
DIGITAL SIGNAL PROCESSING, 2020, 96
[62]   Deep fully-connected networks for video compressive sensing [J].
Iliadis, Michael ;
Spinoulas, Leonidas ;
Katsaggelos, Aggelos K. .
DIGITAL SIGNAL PROCESSING, 2018, 72 :9-18
[63]   PASSIVE CURRENT FLOW AND MORPHOLOGY IN THE TERMINAL ARBORIZATION OF THE POSTERIOR PITUITARY [J].
JACKSON, MB .
JOURNAL OF NEUROPHYSIOLOGY, 1993, 69 (03) :692-702
[64]   Luminescence nanothermometry [J].
Jaque, Daniel ;
Vetrone, Fiorenzo .
NANOSCALE, 2012, 4 (15) :4301-4326
[65]   Accurately tracking single-cell movement trajectories in microfluidic cell sorting devices [J].
Jeong, Jenny ;
Frohberg, Nicholas J. ;
Zhou, Enlu ;
Sulchek, Todd ;
Qiu, Peng .
PLOS ONE, 2018, 13 (02)
[66]   Weighted multi-scale denoising via adaptive multi-channel fusion for compressed ultrafast photography [J].
Jin, Chengzhi ;
Qi, Dalong ;
Yao, Jiali ;
He, Yilin ;
Ding, Pengpeng ;
Guo, Zihan ;
Huang, Zhengqi ;
He, Yu ;
Yao, Yunhua ;
Wang, Zhiyong ;
Sun, Zhenrong ;
Zhang, Shian .
OPTICS EXPRESS, 2022, 30 (17) :31157-31170
[67]   Single-shot real-time imaging of ultrafast light springs [J].
Jin, Chengzhi ;
Qi, Dalong ;
Yao, Yunhua ;
Cao, Fengyan ;
Deng, Li ;
Xu, Shixiang ;
Sun, Zhenrong ;
Zhang, Shian .
SCIENCE CHINA-PHYSICS MECHANICS & ASTRONOMY, 2021, 64 (12)
[68]   Spatio-temporal-spectral imaging of non-repeatable dissipative soliton dynamics [J].
Jing, Joseph C. ;
Wei, Xiaoming ;
Wang, Lihong V. .
NATURE COMMUNICATIONS, 2020, 11 (01)
[69]  
Kaitao Z., 2023, High Power Laser Part. Beams, V35
[70]   Temperature-Dependent Exciton and Trap-Related Photoluminescence of CdTe Quantum Dots Embedded in a NaCl Matrix: Implication in Thermometry [J].
Kalytchuk, Sergii ;
Zhovtiuk, Olga ;
Kershaw, Stephen V. ;
Zboril, Radek ;
Rogach, Andrey L. .
SMALL, 2016, 12 (04) :466-476