Improved 3D point cloud segmentation for accurate phenotypic analysis of cabbage plants using deep learning and clustering algorithms

被引:29
作者
Guo, Ruichao [1 ]
Xie, Jilong [1 ]
Zhu, Jiaxi [1 ]
Cheng, Ruifeng [2 ]
Zhang, Yi [2 ]
Zhang, Xihai [1 ]
Gong, Xinjing [1 ]
Zhang, Ruwen [1 ]
Wang, Hao [1 ]
Meng, Fanfeng [1 ]
机构
[1] Northeast Agr Univ, Coll Elect & Informat, Harbin 150030, Peoples R China
[2] Chinese Acad Agr Sci, Inst Environm & Sustainable Dev Agr, Beijing 100080, Peoples R China
关键词
Plant phenotype; Point cloud; ASAP-PointNet; DBSCAN; Semantic segmentation;
D O I
10.1016/j.compag.2023.108014
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
Plant phenotyping is essential for understanding and managing plant growth and development. 3D point clouds provide a better understanding of plant 3D structures. Point cloud segmentation is the basis for studying the 3D structure of plants through 3D point clouds, and accurate point cloud segmentation is crucial for extracting relevant phenotypic parameters. In this study, cabbage was used as an example, and a plant point cloud segmentation method combining deep learning algorithms and clustering algorithms was proposed. Specifically, a cabbage point cloud dataset was constructed using a 3D scanning platform. The ASAP attention module was incorporated into the PointNet++ model, resulting in the improved ASAP-PointNet model. Superior semantic segmentation performance on the cabbage point cloud dataset was demonstrated by this model. The workflow of the DBSCAN algorithm was also optimized, which exhibited enhanced performance in organ-level plant point cloud segmentation experiments. Subsequently, five phenotypic features were extracted. The experimental results revealed that an accuracy of 0.95 and an intersection over union (IoU) of 0.86 for semantic segmentation were achieved by the ASAP-PointNet model. The correlation coefficients between the four phenotype parameters (plant height, leaf length, leaf width, and leaf area) and their corresponding measured values were 0.96, 0.91, 0.95, and 0.94, respectively. An automated data analysis, from plant 3D point clouds to phenotypic parameters, is enabled by the proposed method, which serves as a valuable reference for plant phenotype research.
引用
收藏
页数:12
相关论文
共 67 条
[1]   Automatic segmentation of stem and leaf components and individual maize plants in field terrestrial LiDAR data using convolutional neural networks [J].
Ao, Zurui ;
Wu, Fangfang ;
Hu, Saihan ;
Sun, Ying ;
Guo, Yanjun ;
Guo, Qinghua ;
Xin, Qinchuan .
CROP JOURNAL, 2022, 10 (05) :1239-1250
[2]   A photometric stereo-based 3D imaging system using computer vision and deep learning for tracking plant growth [J].
Bernotas, Gytis ;
Scorza, Livia C. T. ;
Hansen, Mark F. ;
Hales, Ian J. ;
Halliday, Karen J. ;
Smith, Lyndon N. ;
Smith, Melvyn L. ;
McCormick, Alistair J. .
GIGASCIENCE, 2019, 8 (05)
[3]  
Cao H., 2020, arXiv
[4]   Individual Tree Crown Segmentation Directly from UAV-Borne LiDAR Data Using the PointNet of Deep Learning [J].
Chen, Xinxin ;
Jiang, Kang ;
Zhu, Yushi ;
Wang, Xiangjun ;
Yun, Ting .
FORESTS, 2021, 12 (02) :1-22
[5]   Geometric attentional dynamic graph convolutional neural networks for point cloud analysis [J].
Cui, Yiming ;
Liu, Xin ;
Liu, Hongmin ;
Zhang, Jiyong ;
Zare, Alina ;
Fan, Bin .
NEUROCOMPUTING, 2021, 432 :300-310
[6]   Tensor-based classification and segmentation of three-dimensional point clouds for organ-level plant phenotyping and growth analysis [J].
Elnashef, Bashar ;
Filin, Sagi ;
Lati, Ran Nisim .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2019, 156 :51-61
[7]   An automated approach for wood-leaf separation from terrestrial LIDAR point clouds using the density based clustering algorithm DBSCAN [J].
Ferrara, Roberto ;
Virdis, Salvatore G. P. ;
Ventura, Andrea ;
Ghisu, Tiziano ;
Duce, Pierpaolo ;
Pellizzaro, Grazia .
AGRICULTURAL AND FOREST METEOROLOGY, 2018, 262 :434-444
[8]   Macrophenology: insights into the broad-scale patterns, drivers, and consequences of phenology [J].
Gallinat, Amanda S. ;
Ellwood, Elizabeth R. ;
Heberling, J. Mason ;
Miller-Rushing, Abraham J. ;
Pearse, William D. ;
Primack, Richard B. .
AMERICAN JOURNAL OF BOTANY, 2021, 108 (11) :2112-2126
[9]   Three dimensional apple tree organs classification and yield estimation algorithm based on multi-features fusion and support vector machine [J].
Ge, Luzhen ;
Zou, Kunlin ;
Zhou, Hang ;
Yu, Xiaowei ;
Tan, Yuzhi ;
Zhang, Chunlong ;
Li, Wei .
INFORMATION PROCESSING IN AGRICULTURE, 2022, 9 (03) :431-442
[10]  
Girardeau-Montaut Daniel., 2016, CloudCompare, V11