Near Field Photometric Stereo with Point Light Sources

被引:58
|
作者
Mecca, Roberto [1 ]
Wetzler, Aaron [2 ]
Bruckstein, Alfred M. [2 ]
Kimmel, Ron [2 ]
机构
[1] Ist Italiano Tecnol, I-16163 Genoa, Italy
[2] Technion Israel Inst Technol, Dept Comp Sci, IL-32000 Haifa, Israel
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2014年 / 7卷 / 04期
关键词
photometric stereo; quasi-linear PDEs; well-posedness; weak solution; perspective view; light attenuations; upwind scheme; semi-Lagrangian scheme; SHAPE; GRADIENT; SURFACE; IMAGE; RECONSTRUCTION; INTEGRABILITY; PROJECTION;
D O I
10.1137/140968100
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Shape recovery of an object based on shading variations resulting from different light sources has recently been reconsidered. Improvements have been made that allow for the photometric stereo approach to serve as a competitive alternative to other shape reconstruction methods. However, most photometric stereo methods tend to ignore factors that are relevant in practical applications. The setup considered in this paper tackles photometric stereo reconstruction in the case of a specific near-field imaging. This means that both the camera and the light sources are close to the imaged object, where close can be loosely considered as a setup having similar distances between lights, camera, and object. The known challenges that characterize the problem involve perspective viewing geometry, point light sources, and images that may include shadowed regions. Here, we pay special attention to the question of how to faithfully model these aspects and at the same time design an efficient and robust numerical solver. We present a mathematical formulation that integrates the above assumptions into a single coherent model based on quasi-linear PDEs. The well-posedness is proved showing uniqueness of a weak (i.e., Lipschitz continuous) solution. The surface reconstruction in our near-field scenario can then be executed efficiently in linear time. The merging strategy of the irradiance equations provided for each light source allows us to consider a characteristic expansion model which enables the direct computation of the surface. We evaluate several types of light attenuation models with a nonuniform albedo and noise on synthetic data. We also demonstrate the proposed method on surface reconstruction of real data using three images, each one taken with a different light source by a working prototype. We demonstrate the accuracy of the proposed method compared to other methods that ignore the near- field setup and assume distant, parallel beam light sources.
引用
收藏
页码:2732 / 2770
页数:39
相关论文
共 50 条
  • [31] A Direct Differential Approach to Photometric Stereo with Perspective Viewing
    Mecca, Roberto
    Tankus, Ariel
    Wetzler, Aaron
    Bruckstein, Alfred M.
    SIAM JOURNAL ON IMAGING SCIENCES, 2014, 7 (02): : 579 - 612
  • [32] Overcoming Shadows in 3-Source Photometric Stereo
    Hernandez, Carlos
    Vogiatzis, George
    Cipolla, Roberto
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (02) : 419 - 426
  • [33] NEAR-FIELD NEURAL RENDERING GUIDED BY SINGLE-SHOT PHOTOMETRIC STEREO
    Reddy, Joshna Manoj
    Fredrick, Tony
    Khan, Salman S.
    Mitra, Kaushik
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 3905 - 3909
  • [34] Orthogonal Illuminations in Two Light-Source Photometric Stereo
    Kozera, Ryszard
    Prokopenya, Alexander
    COMPUTER INFORMATION SYSTEMS AND INDUSTRIAL MANAGEMENT, CISIM 2016, 2016, 9842 : 402 - 415
  • [35] From Intensity Profile to Surface Normal: Photometric Stereo for Unknown Light Sources and Isotropic Reflectances
    Lu, Feng
    Matsushita, Yasuyuki
    Sato, Imari
    Okabe, Takahiro
    Sato, Yoichi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (10) : 1999 - 2012
  • [36] A Single-Lobe Photometric Stereo Approach for Heterogeneous Material
    Mecca, Roberto
    Queau, Yvain
    Logothetis, Fotios
    Cipolla, Roberto
    SIAM JOURNAL ON IMAGING SCIENCES, 2016, 9 (04): : 1858 - 1888
  • [37] Conjugate Gradient in Noisy Photometric Stereo
    Kozera, Ryszard
    Okulicka-Dluzewska, Felicja
    COMPUTER VISION AND GRAPHICS, ICCVG 2014, 2014, 8671 : 338 - +
  • [38] 3D Face Reconstruction using Color Photometric Stereo with Uncalibrated Near Point Lights
    Chen, Zhang
    Ji, Yu
    Zhou, Mingyuan
    Kang, Sing Bing
    Yu, Jingyi
    2020 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2020,
  • [39] Task-Specific Near-Field Photometric Stereo for Measuring Metal Surface Texture
    Jian, ZhenXiong
    Wang, Xi
    Zhang, XinQuan
    Su, Rong
    Ren, MingJun
    Zhu, LiMin
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (04) : 6019 - 6029
  • [40] Photometric Stereo Under Non-uniform Light Intensities and Exposures
    Cho, Donghyeon
    Matsushita, Yasuyuki
    Tai, Yu-Wing
    Kweon, Inso
    COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 170 - 186