Computational periscopy with an ordinary digital camera

被引:154
|
作者
Saunders, Charles [1 ]
Murray-Bruce, John [1 ]
Goyal, Vivek K. [1 ]
机构
[1] Boston Univ, Dept Elect & Comp Engn, Boston, MA 02215 USA
关键词
PHOTON; RECONSTRUCTION; OCCLUSION; ALGORITHM; IMAGES;
D O I
10.1038/s41586-018-0868-6
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Computing the amounts of light arriving from different directions enables a diffusely reflecting surface to play the part of a mirror in a periscope-that is, perform non-line-of-sight imaging around an obstruction. Because computational periscopy has so far depended on light-travel distances being proportional to the times of flight, it has mostly been performed with expensive, specialized ultrafast optical systems(1-12). Here we introduce a two-dimensional computational periscopy technique that requires only a single photograph captured with an ordinary digital camera. Our technique recovers the position of an opaque object and the scene behind (but not completely obscured by) the object, when both the object and scene are outside the line of sight of the camera, without requiring controlled or time-varying illumination. Such recovery is based on the visible penumbra of the opaque object having a linear dependence on the hidden scene that can be modelled through ray optics. Non-line-of-sight imaging using inexpensive, ubiquitous equipment may have considerable value in monitoring hazardous environments, navigation and detecting hidden adversaries.
引用
收藏
页码:472 / +
页数:6
相关论文
共 50 条
  • [1] MULTI-DEPTH COMPUTATIONAL PERISCOPY WITH AN ORDINARY CAMERA
    Saunders, Charles
    Bose, Rishabh
    Murray-Bruce, John
    Goyal, Vivek K.
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 9299 - 9303
  • [2] Fast Computational Periscopy in Challenging Ambient Light Conditions through Optimized Preconditioning
    Saunders, Charles
    Goyal, Vivek K.
    2021 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2021,
  • [3] Computational photography with plenoptic camera and light field capture: tutorial
    Lam, Edmund Y.
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2015, 32 (11) : 2021 - 2032
  • [4] Definition of spectrum by colors metamerism using images of plants by ordinary camera
    Ye, Shiping
    Nedzved, O.
    Nedzved, A.
    Chen, Chaoxiang
    OPTICS AND LASERS IN ENGINEERING, 2024, 178
  • [5] Evaluation and benchmarking of a pixel-shifting camera for superresolution lensless digital holography
    Li, Yan
    Lilley, Francis
    Burton, David
    Lalor, Michael
    APPLIED OPTICS, 2010, 49 (09) : 1643 - 1650
  • [6] Characterization of the reference wave in a compact digital holographic camera
    Park, I. S.
    Middleton, R. J. C.
    Coggrave, C. R.
    Ruiz, P. D.
    Coupland, J. M.
    APPLIED OPTICS, 2018, 57 (01) : A235 - A241
  • [7] Algorithm for haze determination using digital camera images
    Wong, C. J.
    MatJafri, M. Z.
    Abdullah, K.
    Lim, H. S.
    Hashim, S. A.
    ATMOSPHERIC PROPAGATION V, 2008, 6951
  • [8] Seeing elements by visible-light digital camera
    Zhao, Wenyang
    Sakurai, Kenji
    SCIENTIFIC REPORTS, 2017, 7
  • [9] Computational Super-Resolution Imaging With a Sparse Rotational Camera Array
    Zhang, Yifei
    Li, Tianren
    Zhang, Yu
    Chen, Peirong
    Qu, Yufu
    Wei, Zhenzhong
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 : 425 - 434
  • [10] Computational model for detector timing effects in Compton-camera based prompt-gamma imaging for proton radiotherapy
    Maggi, Paul
    Peterson, Steve
    Panthi, Rajesh
    Mackin, Dennis
    Yang, Hao
    He, Zhong
    Beddar, Sam
    Polf, Jerimy
    PHYSICS IN MEDICINE AND BIOLOGY, 2020, 65 (12)