Three Birds, One Stone: Unified Laser-Based 3-D Reconstruction Across Different Media

被引:31
作者
Gu, Changjun [1 ,2 ,3 ]
Cong, Yang [1 ,2 ]
Sun, Gan [1 ,2 ]
机构
[1] Chinese Acad Sci, Shenyang Inst Automat, Inst Robot, State Key Lab Robot, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, Inst Intelligent Mfg, State Key Lab Robot, Shenyang 110016, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
Laser-based scanner; pose optimization; refractive geometry calibration; underwater refractive 3-D reconstruction; underwater vision; SINGLE CAMERA; UNDERWATER; CALIBRATION; MODEL;
D O I
10.1109/TIM.2020.3039641
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The laser-based 3-D reconstruction is crucial for autonomous manipulation and resource exploration in both the air and underwater scenarios, due to its accurate precision and robustness to disturbances. However, most current laser-based 3-D reconstruction sensors cannot be applied across different media without recalibration directly, e.g., air, air -> glass -> air, and air -> glass -> water, which is called killing three birds with one stone. This is because the variation of the medium density could change the sensor calibration parameters and further make the sensor suffer from a systematic geometric bias. To address these challenges, a unified laser-based 3-D reconstruction method is proposed in order that the laser-based scanner could be used across different media without recalibration, where we first explicitly model the refraction of the underwater vision systems and transform it across different media into a unified sensor reference frame. More specifically, an underwater refractive camera calibration model is designed to calibrate the orientation and position of the refractive interface, which can improve the accuracy of underwater reconstruction for the laser-based scanner, and we then present a refractive pose estimation model with a unified sensor reference frame, which can help the sensor to be applied across different scenarios directly. For the experiments, we validate the performance of our method on our underwater 3-D scanner prototype. Several reconstruction results on different objects and scenarios demonstrate the effectiveness of our proposed method and the practicality of our designed sensor.
引用
收藏
页数:12
相关论文
共 40 条
[1]  
Agrawal A, 2012, PROC CVPR IEEE, P3346, DOI 10.1109/CVPR.2012.6248073
[2]   Generation of High-resolution Three-dimensional Reconstructions of the Seafloor in Color using a Single Camera and Structured Light [J].
Bodenmann, Adrian ;
Thornton, Blair ;
Ura, Tamaki .
JOURNAL OF FIELD ROBOTICS, 2017, 34 (05) :833-851
[3]  
Castillon M., 2019, SENSORS-BASEL, V19, P1
[4]   Refractive Two-View Reconstruction for Underwater 3D Vision [J].
Chadebecq, Francois ;
Vasconcelos, Francisco ;
Lacher, Rene ;
Maneas, Efthymios ;
Desjardins, Adrien ;
Ourselin, Sebastien ;
Vercauteren, Tom ;
Stoyanov, Danail .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (05) :1101-1117
[5]   Refractive Structure-from-Motion Through a Flat Refractive Interface [J].
Chadebecq, Francois ;
Vasconcelos, Francisco ;
Dwyer, George ;
Lacher, Rene ;
Ourselin, Sebastien ;
Vercauteren, Tom ;
Stoyanov, Danail .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5325-5333
[6]   A Closed-Form Solution to Single Underwater Camera Calibration Using Triple Wavelength Dispersion and Its Application to Single Camera 3D Reconstruction [J].
Chen, Xida ;
Yang, Yee-Hong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (09) :4553-4561
[7]   Novel event analysis for human-machine collaborative underwater exploration [J].
Cong, Yang ;
Fan, Baojie ;
Hou, Dongdong ;
Fan, Huijie ;
Liu, Kaizhou ;
Luo, Jiebo .
PATTERN RECOGNITION, 2019, 96
[8]   What Can Be Transferred: Unsupervised Domain Adaptation for Endoscopic Lesions Segmentation [J].
Dong, Jiahua ;
Cong, Yang ;
Sun, Gan ;
Zhong, Bineng ;
Xu, Xiaowei .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :4022-4031
[9]   Semantic-Transferable Weakly-Supervised Endoscopic Lesions Segmentation [J].
Dong, Jiahua ;
Cong, Yang ;
Sun, Gan ;
Hou, Dongdong .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :10711-10720
[10]  
Ferreira R, 2005, LECT NOTES COMPUT SC, V3522, P102