Photometric Stereo in a Scattering Medium

被引:23
|
作者
Murez, Zak [1 ]
Treibitz, Tali [2 ]
Ramamoorthi, Ravi [1 ]
Kriegman, David J. [1 ]
机构
[1] Univ Calif San Diego, Dept Comp Sci & Engn, 9500 Gilman Dr, La Jolla, CA 92093 USA
[2] Univ Haifa, Charney Sch Marine Sci, Dept Marine Technol, IL-3498838 Haifa, Israel
基金
美国国家科学基金会;
关键词
Photometric stereo; scattering medium; fluorescence; SHAPE; LIGHT;
D O I
10.1109/TPAMI.2016.2613862
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Photometric stereo is widely used for 3D reconstruction. However, its use in scattering media such as water, biological tissue and fog has been limited until now, because of forward scattered light from both the source and object, as well as light scattered back from the medium (backscatter). Here we make three contributions to address the key modes of light propagation, under the common single scattering assumption for dilute media. First, we show through extensive simulations that single-scattered light from a source can be approximated by a point light source with a single direction. This alleviates the need to handle light source blur explicitly. Next, we model the blur due to scattering of light from the object. We measure the object point-spread function and introduce a simple deconvolution method. Finally, we show how imaging fluorescence emission where available, eliminates the backscatter component and increases the signal-to-noise ratio. Experimental results in a water tank, with different concentrations of scattering media added, show that deconvolution produces higher-quality 3D reconstructions than previous techniques, and that when combined with fluorescence, can produce results similar to that in clear water even for highly turbid media.
引用
收藏
页码:1880 / 1891
页数:12
相关论文
共 50 条
  • [21] A new approach to photometric stereo
    Torreao, JRA
    PATTERN RECOGNITION LETTERS, 1999, 20 (05) : 535 - 540
  • [22] Learning to Minify Photometric Stereo
    Li, Junxuan
    Robles-Kelly, Antonio
    You, Shaodi
    Matsushita, Yasuyuki
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7560 - 7568
  • [23] INTEGRATING STEREO AND PHOTOMETRIC STEREO TO MONITOR THE DEVELOPMENT OF GLAUCOMA
    LEE, S
    BRADY, M
    IMAGE AND VISION COMPUTING, 1991, 9 (01) : 39 - 44
  • [24] Surface reflectance and normal estimation from photometric stereo
    Yang, Qingxiong
    Ahuja, Narendra
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2012, 116 (07) : 793 - 802
  • [25] Multispectral Photometric Stereo Using Intrinsic Image Decomposition
    Hamaen, Koumei
    Miyazaki, Daisuke
    Hiura, Shinsaku
    FRONTIERS OF COMPUTER VISION, 2020, 1212 : 289 - 304
  • [26] Deep Learning Methods for Calibrated Photometric Stereo and Beyond
    Ju, Yakun
    Lam, Kin-Man
    Xie, Wuyuan
    Zhou, Huiyu
    Dong, Junyu
    Shi, Boxin
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (11) : 7154 - 7172
  • [27] A Direct Differential Approach to Photometric Stereo with Perspective Viewing
    Mecca, Roberto
    Tankus, Ariel
    Wetzler, Aaron
    Bruckstein, Alfred M.
    SIAM JOURNAL ON IMAGING SCIENCES, 2014, 7 (02): : 579 - 612
  • [28] Analysis of Surface Parametrizations for Modern Photometric Stereo Modeling
    Mecca, Roberto
    Rodola, Emanuele
    Cremers, Daniel
    TWELFTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION, 2015, 9534
  • [29] Overcoming Shadows in 3-Source Photometric Stereo
    Hernandez, Carlos
    Vogiatzis, George
    Cipolla, Roberto
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (02) : 419 - 426
  • [30] Evaluating the effect of diffuse light on photometric stereo reconstruction
    Angelopoulou, Maria E.
    Petrou, Maria
    MACHINE VISION AND APPLICATIONS, 2014, 25 (01) : 199 - 210