Incorporating Lambertian Priors Into Surface Normals Measurement

被引:31
作者
Ju, Yakun [1 ]
Jian, Muwei [2 ,3 ]
Guo, Shaoxiang [1 ]
Wang, Yingyu [1 ]
Zhou, Huiyu [4 ]
Dong, Junyu [1 ]
机构
[1] Ocean Univ China, Dept Comp Sci & Technol, Qingdao 266100, Peoples R China
[2] Linyi Univ, Sch Informat Sci & Engn, Linyi 276000, Shandong, Peoples R China
[3] Shandong Univ Finance & Econ, Sch Comp Sci & Technol, Jinan 250014, Peoples R China
[4] Univ Leicester, Dept Informat, Leicester LE1 7RH, Leics, England
基金
中国国家自然科学基金;
关键词
Deep neural networks; non-Lambertian; photo-metric stereo; prior fusion; surface normal measurement; PHOTOMETRIC STEREO; REFLECTANCE; SHAPE; RECONSTRUCTION;
D O I
10.1109/TIM.2021.3096282
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The goal of photometric stereo is to measure the precise surface normal of a 3-D object from observations with various shading cues. However, non-Lambertian surfaces influence the measurement accuracy due to irregular shading cues. Despite deep neural networks being used to simulate the performance of non-Lambertian surfaces, the error in specularities, shadows, and crinkle regions is hard to be reduced. To address this challenge, we here propose a photometric stereo network that incorporates Lambertian priors to better measure the surface normal. In this article, we use the initial normal under the Lambertian assumption as prior information to refine the normal measurement, instead of solely applying the observed shading cues to deriving the surface normal. Our method uses the Lambertian information to reparameterize the network weights and the powerful fitting ability of deep neural networks to correct these errors caused by general reflectance properties. Our explorations include: the Lambertian priors: 1) reduce the learning hypothesis space, making our method learn mapping in the same surface normal space and improving the accuracy of learning and 2) provides the differential features' learning, improving the surfaces' reconstruction of details. Extensive experiments verify the effectiveness of the proposed Lamhertian prior photometric stereo network in accurate surface normal measurement, on the challenging benchmark dataset.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] A Survey of Photometric Stereo Techniques
    Ackermann, Jens
    Goesele, Michael
    [J]. FOUNDATIONS AND TRENDS IN COMPUTER GRAPHICS AND VISION, 2013, 9 (3-4): : 149 - 254
  • [2] Alldrin Neil, 2008, COMPUTER VISION PATT
  • [3] Alldrin NG, 2007, IEEE I CONF COMP VIS, P417
  • [4] Chabert C-F, 2006, ACM SIGGRAPH 2006 SK
  • [5] On Differential Photometric Reconstruction for Unknown, Isotropic BRDFs
    Chandraker, Manmohan
    Bai, Jiamin
    Ramamoorthi, Ravi
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (12) : 2941 - 2955
  • [6] Chandraker Manmohan., 2007, IEEE Int'l Conf. on Computer Vision and Pattern Recognition, P1, DOI DOI 10.1109/CVPR.2007.383288
  • [7] Self-calibrating Deep Photometric Stereo Networks
    Chen, Guanying
    Han, Kai
    Shi, Boxin
    Matsushita, Yasuyuki
    Wong, Kwan-Yee K.
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 8731 - 8739
  • [8] PS-FCN: A Flexible Learning Framework for Photometric Stereo
    Chen, Guanying
    Han, Kai
    Wong, Kwan-Yee K.
    [J]. COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 : 3 - 19
  • [9] A Microfacet-based Reflectance Model for Photometric Stereo with Highly Specular Surfaces
    Chen, Lixiong
    Zheng, Yinqiang
    Shi, Boxin
    Subpa-Asa, Art
    Sato, Imari
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 3181 - 3189
  • [10] Chen T., 2006, 2006 IEEE COMP SOC C, P1825