Fast reconstruction method of three-dimension model based on dual RGB-D cameras for peanut plant

被引:25
作者
Liu, Yadong [1 ]
Yuan, Hongbo [1 ]
Zhao, Xin [1 ]
Fan, Caihu [1 ]
Cheng, Man [1 ]
机构
[1] Hebei Agr Univ, Coll Mech & Elect Engn, Baoding 071001, Peoples R China
基金
中国国家自然科学基金;
关键词
Peanut plant; Three-dimensional model; Point cloud; Coordinate transformation; Kinect v2; CALIBRATION; THROUGHPUT; KINECT; REGISTRATION; AGRICULTURE; CHALLENGES; ACCURACY; IMAGES;
D O I
10.1186/s13007-023-00998-z
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
BackgroundPlant shape and structure are important factors in peanut breeding research. Constructing a three-dimension (3D) model can provide an effective digital tool for comprehensive and quantitative analysis of peanut plant structure. Fast and accurate are always the goals of the plant 3D model reconstruction research.ResultsWe proposed a 3D reconstruction method based on dual RGB-D cameras for the peanut plant 3D model quickly and accurately. The two Kinect v2 were mirror symmetry placed on both sides of the peanut plant, and the point cloud data obtained were filtered twice to remove noise interference. After rotation and translation based on the corresponding geometric relationship, the point cloud acquired by the two Kinect v2 was converted to the same coordinate system and spliced into the 3D structure of the peanut plant. The experiment was conducted at various growth stages based on twenty potted peanuts. The plant traits' height, width, length, and volume were calculated through the reconstructed 3D models, and manual measurement was also carried out during the experiment processing. The accuracy of the 3D model was evaluated through a synthetic coefficient, which was generated by calculating the average accuracy of the four traits. The test result showed that the average accuracy of the reconstructed peanut plant 3D model by this method is 93.42%. A comparative experiment with the iterative closest point (ICP) algorithm, a widely used 3D modeling algorithm, was additionally implemented to test the rapidity of this method. The test result shows that the proposed method is 2.54 times faster with approximated accuracy compared to the ICP method.ConclusionsThe reconstruction method for the 3D model of the peanut plant described in this paper is capable of rapidly and accurately establishing a 3D model of the peanut plant while also meeting the modeling requirements for other species' breeding processes. This study offers a potential tool to further explore the 3D model for improving traits and agronomic qualities of plants.
引用
收藏
页数:16
相关论文
共 64 条
[1]   Using depth cameras to extract structural parameters to assess the growth state and yield of cauliflower crops [J].
Andujar, Dionisio ;
Ribeiro, Angela ;
Fernandez-Quintanilla, Cesar ;
Dorado, Jose .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2016, 122 :67-73
[2]   Field-based robotic phenotyping of sorghum plant architecture using stereo vision [J].
Bao, Yin ;
Tang, Lie ;
Breitzman, Matthew W. ;
Fernandez, Maria G. Salas ;
Schnable, Patrick S. .
JOURNAL OF FIELD ROBOTICS, 2019, 36 (02) :397-415
[3]   Real-time 3D unstructured environment reconstruction utilizing VR and Kinect-based immersive teleoperation for agricultural field robots [J].
Chen, Yi ;
Zhang, Baohua ;
Zhou, Jun ;
Wang, Kai .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 175
[4]   On the use of depth camera for 3D phenotyping of entire plants [J].
Chene, Yann ;
Rousseau, David ;
Lucidarme, Philippe ;
Bertheloot, Jessica ;
Caffier, Valerie ;
Morel, Philippe ;
Belin, Etienne ;
Chapeau-Blondeau, Francois .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2012, 82 :122-127
[5]   Evaluation of low-cost depth cameras for agricultural applications [J].
Condotta, Isabella C. F. S. ;
Brown-Brandl, Tami M. ;
Pitla, Santosh K. ;
Stinn, John P. ;
Silva-Miranda, Kesia O. .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 173
[6]   PocketPlant3D: Analysing canopy structure using a smartphone [J].
Confalonieri, Roberto ;
Paleari, Livia ;
Foi, Marco ;
Movedi, Ermes ;
Vesely, Fosco M. ;
Thoelke, William ;
Agape, Cristina ;
Borlini, Giulia ;
Ferri, Irene ;
Massara, Federico ;
Motta, Roberto ;
Ravasi, Riccardo A. ;
Tartarini, Sofia ;
Zoppolato, Camilla ;
Baia, Luca M. ;
Brumana, Andrea ;
Colombo, Davide ;
Curatolo, Antonio ;
Fauda, Valerio ;
Gaia, Denise ;
Gerosa, Andrea ;
Ghilardi, Antonio ;
Grassi, Enrico ;
Magarini, Andrea ;
Novelli, Francesco ;
Garcia, Fatima B. Perez ;
Graziosi, Andrea Rota ;
Salvan, Michele ;
Tadiello, Tommaso ;
Rossini, Laura .
BIOSYSTEMS ENGINEERING, 2017, 164 :1-12
[7]   Cell to whole-plant phenotyping: the best is yet to come [J].
Dhondt, Stijn ;
Wuyts, Nathalie ;
Inze, Dirk .
TRENDS IN PLANT SCIENCE, 2013, 18 (08) :433-444
[8]   Scandinavian perspectives on plant gene technology: applications, policies and progress [J].
Eriksson, Dennis ;
Brinch-Pedersen, Henrik ;
Chawade, Aakash ;
Holme, Inger B. ;
Hvoslef-Eide, Trine A. K. ;
Ritala, Anneli ;
Teeri, Teemu H. ;
Thorstensen, Tage .
PHYSIOLOGIA PLANTARUM, 2018, 162 (02) :219-238
[9]   3D Maize Plant Reconstruction Based on Georeferenced Overlapping LiDAR Point Clouds [J].
Garrido, Miguel ;
Paraforos, Dimitris S. ;
Reiser, David ;
Vazquez Arellano, Manuel ;
Griepentrog, Hans W. ;
Valero, Constantino .
REMOTE SENSING, 2015, 7 (12) :17077-17096
[10]   Assessing the Performance of RGB-D Sensors for 3D Fruit Crop Canopy Characterization under Different Operating and Lighting Conditions [J].
Gene-Mola, Jordi ;
Llorens, Jordi ;
Rosell-Polo, Joan R. ;
Gregorio, Eduard ;
Arno, Jaume ;
Solanelles, Francesc ;
Martinez-Casasnovas, Jose A. ;
Escola, Alexandre .
SENSORS, 2020, 20 (24) :1-21