Near Field Photometric Stereo with Point Light Sources

被引:58
|
作者
Mecca, Roberto [1 ]
Wetzler, Aaron [2 ]
Bruckstein, Alfred M. [2 ]
Kimmel, Ron [2 ]
机构
[1] Ist Italiano Tecnol, I-16163 Genoa, Italy
[2] Technion Israel Inst Technol, Dept Comp Sci, IL-32000 Haifa, Israel
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2014年 / 7卷 / 04期
关键词
photometric stereo; quasi-linear PDEs; well-posedness; weak solution; perspective view; light attenuations; upwind scheme; semi-Lagrangian scheme; SHAPE; GRADIENT; SURFACE; IMAGE; RECONSTRUCTION; INTEGRABILITY; PROJECTION;
D O I
10.1137/140968100
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Shape recovery of an object based on shading variations resulting from different light sources has recently been reconsidered. Improvements have been made that allow for the photometric stereo approach to serve as a competitive alternative to other shape reconstruction methods. However, most photometric stereo methods tend to ignore factors that are relevant in practical applications. The setup considered in this paper tackles photometric stereo reconstruction in the case of a specific near-field imaging. This means that both the camera and the light sources are close to the imaged object, where close can be loosely considered as a setup having similar distances between lights, camera, and object. The known challenges that characterize the problem involve perspective viewing geometry, point light sources, and images that may include shadowed regions. Here, we pay special attention to the question of how to faithfully model these aspects and at the same time design an efficient and robust numerical solver. We present a mathematical formulation that integrates the above assumptions into a single coherent model based on quasi-linear PDEs. The well-posedness is proved showing uniqueness of a weak (i.e., Lipschitz continuous) solution. The surface reconstruction in our near-field scenario can then be executed efficiently in linear time. The merging strategy of the irradiance equations provided for each light source allows us to consider a characteristic expansion model which enables the direct computation of the surface. We evaluate several types of light attenuation models with a nonuniform albedo and noise on synthetic data. We also demonstrate the proposed method on surface reconstruction of real data using three images, each one taken with a different light source by a working prototype. We demonstrate the accuracy of the proposed method compared to other methods that ignore the near- field setup and assume distant, parallel beam light sources.
引用
收藏
页码:2732 / 2770
页数:39
相关论文
共 50 条
  • [21] Indoor Scene Reconstruction Using Near-Light Photometric Stereo
    Liao, Jingtang
    Buchholz, Bert
    Thiery, Jean-Marc
    Bauszat, Pablo
    Eisemann, Elmar
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (03) : 1089 - 1101
  • [22] A CNN Based Approach for the Point-Light Photometric Stereo Problem
    Fotios Logothetis
    Roberto Mecca
    Ignas Budvytis
    Roberto Cipolla
    International Journal of Computer Vision, 2023, 131 : 101 - 120
  • [23] Calibration of Photometric Stereo point light source based on standard block
    Yang, Yang
    Wang, Xianglong
    Fan, Hao
    Qin, Xukun
    Jian, Muwei
    Dong, Junyu
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2022, 2022, 12177
  • [24] Polarisation photometric stereo
    Atkinson, Gary A.
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 160 : 158 - 167
  • [25] Specular-Free Residual Minimization for Photometric Stereo with Unknown Light Sources
    Migita, Tsuyoshi
    Sogawa, Kazuhiro
    Shakunaga, Takeshi
    ADVANCES IN IMAGE AND VIDEO TECHNOLOGY, PT I, 2011, 7087 : 178 - 189
  • [26] 3D face reconstructions from photometric stereo using near infrared and visible light
    Hansen, Mark F.
    Atkinson, Gary A.
    Smith, Lyndon N.
    Smith, Melvyn L.
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2010, 114 (08) : 942 - 951
  • [27] Evaluating the effect of diffuse light on photometric stereo reconstruction
    Angelopoulou, Maria E.
    Petrou, Maria
    MACHINE VISION AND APPLICATIONS, 2014, 25 (01) : 199 - 210
  • [28] Symmetric-light Photometric Stereo
    Minami, Kazuma
    Santo, Hiroaki
    Okura, Fumio
    Matsushita, Yasuyuki
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 317 - 325
  • [29] PHOTOMETRIC STEREO UNDER UNKNOWN LIGHT SOURCES USING ROBUST SVD WITH MISSING DATA
    Miyazaki, Daisuke
    Ikeuchi, Katsushi
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 4057 - 4060
  • [30] Backscatter Compensated Photometric Stereo with 3 Sources
    Tsiotsios, Chourmouzios
    Angelopoulou, Maria E.
    Kim, Tae-Kyun
    Davison, Andrew J.
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 2259 - 2266