In-situ 3D reconstruction of worn surface topography via optimized photometric stereo

被引:12
作者
Wang, Qinghua [1 ]
Wang, Shuo [1 ]
Li, Bo [1 ]
Zhu, Ke [1 ]
Wu, Tonghai [1 ,2 ]
机构
[1] Xi An Jiao Tong Univ, Key Lab, Educ Minist Modern Design & Rotor Bearing Syst, Xian 710049, Shaanxi, Peoples R China
[2] Xian Jinghui Informat Technol Co Ltd, Xian, Peoples R China
基金
国家重点研发计划; 中国博士后科学基金; 中国国家自然科学基金;
关键词
Worn surface topography; Photometric stereo; Fused convolutional neural network; Regularized surface reconstruction; WEAR;
D O I
10.1016/j.measurement.2021.110679
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Since worn surfaces contain rich information of the wear mechanisms, in-situ measurements of surface topography can characterize ongoing wear degradation in machines. With the help of photometric stereo vision, threedimensional (3D) topography of worn surfaces is obtained with a monocular microscope. However, the accuracy of the reconstructed surfaces remains low due to the non-Lambertian reflections of worn surfaces and noise in the image acquisition equipment. To address this issue, an optimized photometric stereo approach is proposed for the improvement of worn surface reconstruction. To accommodate the non-Lambertian reflections, a multi branch network is constructed to estimate normal vectors from both the photometric images and the incident illumination directions. The estimated normal vectors are adopted to reconstruct worn surface topography by embedding prior knowledge. With this design, the overall distortion caused by image noise is effectively suppressed. The proposed method is verified by comparing with the Laser Scanning Confocal Microscopy (LSCM). As the main result, over 88% similarity on the worn surface roughness can be obtained.
引用
收藏
页数:10
相关论文
共 34 条
[1]   Photometric Stereo: An Overview [J].
Argyriou, Vasileios ;
Petrou, Maria .
ADVANCES IN IMAGING AND ELECTRON PHYSICS, VOL 156, 2009, 156 :1-54
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]   PS-FCN: A Flexible Learning Framework for Photometric Stereo [J].
Chen, Guanying ;
Han, Kai ;
Wong, Kwan-Yee K. .
COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 :3-19
[4]   Numerical Simulation of Rough Surface with Crossed Texture [J].
Chui, Mingwei ;
Feng, Youqian ;
Wang, Wei ;
Li, Peilin ;
Li, Zhengchao .
MECHATRONICS AND INDUSTRIAL INFORMATICS, PTS 1-4, 2013, 321-324 :196-+
[5]   A METHOD FOR ENFORCING INTEGRABILITY IN SHAPE FROM SHADING ALGORITHMS [J].
FRANKOT, RT ;
CHELLAPPA, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1988, 10 (04) :439-451
[6]   HESSENBERG-SCHUR METHOD FOR THE PROBLEM AX+XB=C [J].
GOLUB, GH ;
NASH, S ;
VANLOAN, C .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1979, 24 (06) :909-913
[7]   Regularized Reconstruction of a Surface from its Measured Gradient Field Algorithms for Spectral, Tikhonov, Constrained, and Weighted Regularization [J].
Harker, Matthew ;
O'Leary, Paul .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2015, 51 (01) :46-70
[8]   Learned Multi-Patch Similarity [J].
Hartmann, Wilfried ;
Galliani, Silvano ;
Havlena, Michal ;
Van Gool, Luc ;
Schindler, Konrad .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1595-1603
[9]   Photometric Stereo Using Sparse Bayesian Regression for General Diffuse Surfaces [J].
Ikehata, Satoshi ;
Wipf, David ;
Matsushita, Yasuyuki ;
Aizawa, Kiyoharu .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (09) :1816-1831
[10]  
Kingma D.P., 2017, COMPUTER SCI