Tutorial on compressed ultrafast photography

被引:0
作者
Lai, Yingming [1 ]
Marquez, Miguel [1 ]
Liang, Jinyang [1 ]
机构
[1] Univ Quebec, Inst Natl Rech Sci, Ctr Energie Mat Telecommun, Lab Appl Computat Imaging, Quebec City, PQ, Canada
基金
芬兰科学院; 加拿大自然科学与工程研究理事会; 加拿大创新基金会;
关键词
single-shot computational imaging; coded optical imaging; compressed sensing; streak imaging; image reconstruction techniques; transient biomedical phenomena; PLAY ADMM; RECONSTRUCTION; TEMPERATURE; INVERSE; MICROSCOPY; STREAKING; RECOVERY; NETWORKS; DYNAMICS; TRACKING;
D O I
10.1117/1.JBO.29.S1.S11524
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Significance: Compressed ultrafast photography (CUP) is currently the world's fastest single-shot imaging technique. Through the integration of compressed sensing and streak imaging, CUP can capture a transient event in a single camera exposure with imaging speeds from thousands to trillions of frames per second, at micrometer-level spatial resolutions, and in broad sensing spectral ranges. Aim: This tutorial aims to provide a comprehensive review of CUP in its fundamental methods, system implementations, biomedical applications, and prospect. Approach: A step-by-step guideline to CUP's forward model and representative image reconstruction algorithms is presented with sample codes and illustrations in Matlab and Python. Then, CUP's hardware implementation is described with a focus on the representative techniques, advantages, and limitations of the three key components-the spatial encoder, the temporal shearing unit, and the two-dimensional sensor. Furthermore, four representative biomedical applications enabled by CUP are discussed, followed by the prospect of CUP's technical advancement. Conclusions: CUP has emerged as a state-of-the-art ultrafast imaging technology. Its advanced imaging ability and versatility contribute to unprecedented observations and new applications in biomedicine. CUP holds great promise in improving technical specifications and facilitating the investigation of biomedical processes.
引用
收藏
页数:40
相关论文
共 214 条
  • [1] An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems
    Afonso, Manya V.
    Bioucas-Dias, Jose M.
    Figueiredo, Mario A. T.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (03) : 681 - 695
  • [2] Wigner functions in optics: describing beams as ray bundles and pulses as particle ensembles
    Alonso, Miguel A.
    [J]. ADVANCES IN OPTICS AND PHOTONICS, 2011, 3 (04): : 272 - 365
  • [3] [Anonymous], 2014, Foundations and Trends in Optimization, DOI DOI 10.1561/2400000003
  • [4] Stochastic Properties of Spontaneous Synaptic Transmission at Individual Active Zones
    Astacio, Herson
    Vasin, Alexander
    Bykhovskaia, Maria
    [J]. JOURNAL OF NEUROSCIENCE, 2022, 42 (06) : 1001 - 1019
  • [5] Multitasking Shared Aperture Enabled with Multiband Digital Coding Metasurface
    Bai, Guo Dong
    Ma, Qian
    Iqbal, Shahid
    Bao, Lei
    Jing, Hong Bo
    Zhang, Lei
    Wu, Hao Tian
    Wu, Rui Yuan
    Zhang, Hao Chi
    Yang, Cheng
    Cui, Tie Jun
    [J]. ADVANCED OPTICAL MATERIALS, 2018, 6 (21):
  • [6] Quantitative 3D mapping of fluidic temperatures within microchannel networks using fluorescence lifetime imaging
    Benninger, RKP
    Koç, Y
    Hofmann, O
    Requejo-Isidro, J
    Neil, MAA
    French, PMW
    deMello, AJ
    [J]. ANALYTICAL CHEMISTRY, 2006, 78 (07) : 2272 - 2278
  • [7] A new TwIST: Two-step iterative shrinkage/thresholding algorithms for image restoration
    Bioucas-Dias, Jose M.
    Figueiredo, Mario A. T.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (12) : 2992 - 3004
  • [8] Distributed optimization and statistical learning via the alternating direction method of multipliers
    Boyd S.
    Parikh N.
    Chu E.
    Peleato B.
    Eckstein J.
    [J]. Foundations and Trends in Machine Learning, 2010, 3 (01): : 1 - 122
  • [9] Boyd S., 2004, Convex Optimization, DOI [10.1017/CBO9780511804441, DOI 10.1017/CBO9780511804441]
  • [10] Near-optimal signal recovery from random projections: Universal encoding strategies?
    Candes, Emmanuel J.
    Tao, Terence
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (12) : 5406 - 5425