Efficient light bar extraction in 3D reconstruction techniques invited

被引:0
作者
Song, Limei [1 ,2 ]
Tong, Yu [1 ,2 ]
Li, Jinyi [1 ,2 ]
Wang, Yuanhang [1 ,2 ]
机构
[1] School of Control Science and Engineering, Tiangong University, Tianjin
[2] Key Laboratory of Intelligent Control of Electrical Equipment, Tiangong University, Tianjin
来源
Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering | 2024年 / 53卷 / 09期
基金
中国国家自然科学基金;
关键词
3D reconstruction; laser scanning; lightbar extraction; multi-view point cloud;
D O I
10.3788/IRLA20240312
中图分类号
学科分类号
摘要
Objective As an advanced measurement tool, 3D reconstruction technology has demonstrated significant application advantages in a number of key areas such as biomedicine, aerospace, and industrial manufacturing due to its unique non-contact nature, efficient data processing capability, and ability to provide in-depth multidimensional analysis. However, as the application of the technology continues, the existing light bar extraction methods face the dual challenges of slow reconstruction speed and large accuracy errors when dealing with objects with complex geometries and under variable environmental noise conditions. These challenges not only affect the accuracy of 3D reconstruction results, but also constrain the efficiency of data processing, limiting the potential application of 3D scanning technology in a wider range of scenarios. In order to overcome the limitations of existing techniques and enhance the overall performance of 3D scanning technology, proposes an efficient light bar extraction method based on 3D reconstruction (ELE-3D). The ELE-3D method is developed with the goal of achieving a significant speed-up of the light bar extraction process, while at the same time guaranteeing or even improving the accuracy and reliability of the 3D reconstruction. Specifically, the ELE-3D method aims to accurately extract the centerline of the light bar through advanced image processing techniques and methodic optimisation, effectively reduce noise interference and increase data processing speed. Methods The ELE-3D method is optimized for its limitations in dealing with complex-shaped objects and noise interference through an in-depth analysis of the shortcomings of existing light strip extraction techniques. The method first uses the Sobel operator to perform edge enhancement to improve the contrast and clarity of the edges. Subsequently, binarization is performed based on the maximum gray value of the image to effectively separate the laser stripes from the background noise. Noise filters with area and aspect ratio thresholds are then applied to refine the extraction process, ensuring that only the most relevant features are preserved. It adjusts the laser strip projection ratio to significantly reduce computational demands. Finally, the ELE-3D method adopts a sub-pixel technique for accurate centerline extraction of the segmented region (Fig.1). Results and Discussions In the comprehensive experimental analysis of the ELE-3D method, first compare the extraction speed and effect of the ELE-3D method with the traditional Gray-gravity method and Steger method in light bar centerline extraction by efficiency test, which shows that the ELE-3D method significantly outperforms the other two methods by an average time consuming of 64.2 ms, demonstrating excellent extraction speed and stability. (Fig.2-3, Tab.1-2). Then, in the robustness validation experiment, we added Gaussian noise of different intensities to the standard image, and the ELE-3D method can maintain high accuracy in centerline extraction even in a high noise environment, showing stronger anti-interference ability compared with the traditional methods (Fig.4). Finally, in the 3D reconstruction accuracy experiments, the ELE-3D method scanned a standard ball, a doll and a mannequin from multiple viewpoints, and the complex shapes and details were clearly captured by the generated point cloud data, which verified the validity and reliability of the ELE-3D method in practical applications (Fig.5-7, Tab.3-4). Taken together, these experimental results show that the ELE-3D method performs well in terms of efficiency, robustness and accuracy, providing solid technical support for the advancement of 3D scanning technology. Conclusions The experimental results show that the ELE-3D method has improved the light bar extraction speed by 89.0% compared to the traditional Steger method and by 85.3% compared to the Gray-gravity method, and the running time is stable, showing high efficiency and stability. In terms of robustness, the ELE-3D method can maintain high extraction accuracy under different noise levels, showing good anti-noise performance. Through the multi-view point cloud 3D reconstruction experiments, the ELE-3D method is able to capture rich details on different test objects, such as standard balls, dolls, and mannequins, which proves its high efficiency and accuracy in scanning complex shapes and surfaces. These results not only prove the feasibility of the ELE-3D method, but also lay the foundation for future applications in a wider range of fields, which indicates that the ELE-3D method has a broad application prospect in the field of 3D scanning. © 2024 Chinese Society of Astronautics. All rights reserved.
引用
收藏
相关论文
共 50 条
[41]   Progress and Prospect of 3D Reconstruction Based on Light Field Cameras [J].
Liu Y.-X. ;
Zhang L. ;
Ai H.-B. ;
Xu B. ;
Sun Y.-S. ;
Fan Z.-L. .
Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (07) :1774-1792
[42]   3D Object Reconstruction using structured light and neural networks [J].
Espinal, Juan ;
Ornelas, Manuel ;
Puga, Hector J. ;
Carpio, Juan M. ;
Apolinar Munoz, J. .
2010 IEEE ELECTRONICS, ROBOTICS AND AUTOMOTIVE MECHANICS CONFERENCE (CERMA 2010), 2010, :74-79
[43]   A Novel 3D Reconstruction Approach by Dynamic (de)focused Light [J].
Lertrusdachakul, Intuon ;
Fougerolle, Yohan D. ;
Laligant, Olivier .
IMAGE PROCESSING: MACHINE VISION APPLICATIONS III, 2010, 7538
[44]   Structured Light-Based 3D Reconstruction System for Plants [J].
Thuy Tuong Nguyen ;
Slaughter, David C. ;
Max, Nelson ;
Maloof, Julin N. ;
Sinha, Neelima .
SENSORS, 2015, 15 (08) :18587-18612
[45]   Fast and robust laser stripe extraction for 3D reconstruction in industrial environments [J].
Usamentiaga, Ruben ;
Molleda, Julio ;
Garcia, Daniel F. .
MACHINE VISION AND APPLICATIONS, 2012, 23 (01) :179-196
[46]   ROBUST KEY FRAME EXTRACTION FOR 3D RECONSTRUCTION FROM VIDEO STREAMS [J].
Ahmed, Mirza Tahir ;
Dailey, Matthew N. ;
Landabaso, Jose Luis ;
Herrero, Nicolas .
VISAPP 2010: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 1, 2010, :231-236
[47]   Fast and robust laser stripe extraction for 3D reconstruction in industrial environments [J].
Rubén Usamentiaga ;
Julio Molleda ;
Daniel F. García .
Machine Vision and Applications, 2012, 23 :179-196
[48]   Holo-extraction of information from paper drawings for 3D reconstruction [J].
Chen, KZ ;
Zhang, XW ;
Ou, ZY ;
Feng, XA .
COMPUTER-AIDED DESIGN, 2002, 34 (09) :665-677
[49]   3D Reconstruction and Volume Estimation of Food using Stereo Vision Techniques [J].
Konstantakopoulos, Fotis ;
Georga, Eleni, I ;
Fotiadis, Dimitrios, I .
2021 IEEE 21ST INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOENGINEERING (IEEE BIBE 2021), 2021,
[50]   3D reconstruction techniques of human coronary bifurcations for shear stress computations [J].
Gijsen, Frank J. H. ;
Schuurbiers, Johan C. H. ;
van de Giessen, Alina G. ;
Schaap, Michiel ;
van der Steen, Anton F. W. ;
Wentzel, Jolanda J. .
JOURNAL OF BIOMECHANICS, 2014, 47 (01) :39-43