Multi-View Jujube Tree Trunks Stereo Reconstruction Based on UAV Remote Sensing Imaging Acquisition System

被引:4
作者
Ling, Shunkang [1 ]
Li, Jingbin [1 ]
Ding, Longpeng [1 ]
Wang, Nianyi [2 ]
机构
[1] Shihezi Univ, Coll Mech & Elect Engn, Shihezi 832003, Peoples R China
[2] Xi An Jiao Tong Univ, Coll Software Engn, Xian 710049, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 04期
基金
中国国家自然科学基金;
关键词
3D reconstruction; deep learning; multi-view stereo; remote sensing; feature extraction;
D O I
10.3390/app14041364
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
High-quality agricultural multi-view stereo reconstruction technology is the key to precision and informatization in agriculture. Multi-view stereo reconstruction methods are an important part of 3D vision technology. In the multi-view stereo 3D reconstruction method based on deep learning, the effect of feature extraction directly affects the accuracy of reconstruction. Aiming at the actual problems in orchard fruit tree reconstruction, this paper designs an improved multi-view stereo structure based on the combination of remote sensing and artificial intelligence to realize the accurate reconstruction of jujube tree trunks. Firstly, an automatic key frame extraction method is proposed for the DSST target tracking algorithm to quickly recognize and extract high-quality data. Secondly, a composite U-Net feature extraction network is designed to enhance the reconstruction accuracy, while the DRE-Net feature extraction enhancement network improved by the parallel self-attention mechanism enhances the reconstruction completeness. Comparison tests show different levels of improvement on the Technical University of Denmark (DTU) dataset compared to other deep learning-based methods. Ablation test on the self-constructed dataset, the MVSNet + Co U-Net + DRE-Net_SA method proposed in this paper improves 20.4% in Accuracy, 12.8% in Completion, and 16.8% in Overall compared to the base model, which verifies the real effectiveness of the scheme.
引用
收藏
页数:18
相关论文
共 37 条
[1]   Large-Scale Data for Multiple-View Stereopsis [J].
Aanaes, Henrik ;
Jensen, Rasmus Ramsbol ;
Vogiatzis, George ;
Tola, Engin ;
Dahl, Anders Bjorholm .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2016, 120 (02) :153-168
[2]  
Arik SO, 2021, AAAI CONF ARTIF INTE, V35, P6679
[3]  
Campbell NDF, 2008, LECT NOTES COMPUT SC, V5302, P766, DOI 10.1007/978-3-540-88682-2_58
[4]   RC-MVSNet: Unsupervised Multi-View Stereo with Neural Rendering [J].
Chang, Di ;
Bozic, Aljaz ;
Zhang, Tong ;
Yan, Qingsong ;
Chen, Yingcong ;
Susstrunk, Sabine ;
Niessner, Matthias .
COMPUTER VISION, ECCV 2022, PT XXXI, 2022, 13691 :665-680
[5]   Semisupervised Few-Shot Remote Sensing Image Classification Based on KNN Distance Entropy [J].
Chao, Xuewei ;
Li, Yang .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :8798-8805
[6]   Point-Based Multi-View Stereo Network [J].
Chen, Rui ;
Han, Songfang ;
Xu, Jing ;
Su, Hao .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :1538-1547
[7]  
Conroy T. L., 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision, P392, DOI 10.1109/ICCV.1999.791247
[8]   Adaptive Color Attributes for Real-Time Visual Tracking [J].
Danelljan, Martin ;
Khan, Fahad Shahbaz ;
Felsberg, Michael ;
van de Weijer, Joost .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :1090-1097
[9]  
De Zarza I., 2023, Procedia Computer Science, P553, DOI 10.1016/j.procs.2023.10.040
[10]   Massively Parallel Multiview Stereopsis by Surface Normal Diffusion [J].
Galliani, Silvano ;
Lasinger, Katrin ;
Schindler, Konrad .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :873-881