An unsupervised semantic segmentation network for wood-leaf separation in 3D point clouds

被引:0
作者
Zhong, Yijun [1 ]
Qin, Jiaohua [1 ]
Liu, Shuai [1 ]
Ma, Zhenyan [1 ,2 ]
Liu, Exian [1 ]
Fan, Hui [1 ]
机构
[1] Cent South Univ Forestry & Technol, Changsha 410004, Peoples R China
[2] Hirosaki Univ, Hirosaki, 0368561, Japan
关键词
Point clouds; Wood-leaf separation; Semantic segmentation; Unsupervised learning; Deep learning; TERRESTRIAL LIDAR; CLASSIFICATION;
D O I
10.1016/j.plaphe.2025.100064
中图分类号
S3 [农学(农艺学)];
学科分类号
0901 ;
摘要
Separating wood and leaf components in tree point clouds is one of the key tasks for achieving automated forest inventory and management. To obtain accurate wood-leaf separation results, traditional methods typically rely on large amounts of annotated point cloud data to train supervised semantic segmentation networks. However, point wise annotation is not only extremely labor-intensive but also time-consuming and costly, which greatly limits the widespread application and adoption of supervised learning methods in wood-leaf separation tasks. To eliminate the dependence on annotated point clouds, this study explores the feasibility of wood-leaf separation under completely unsupervised conditions. To this end, we propose an unsupervised semantic segmentation network that is capable of directly extracting wood and leaf components in 3D point clouds. The network adopts a sparse convolutional neural network as the backbone and incorporates two custom-designed modules: the dual point attention (DPA) module and the point cloud feature convolutional integrator (PFCI) module, for enhanced feature fusion and extraction. Semantic classification is then achieved by generating pseudolabels via super point clustering. Based on large-scale public datasets containing coniferous and broadleaf forests, in addition to our self-constructed dataset, our proposed network achieved an overall accuracy (oAcc) of 67.583%, a mean classification accuracy (mAcc) of 50.249%, and a mean intersection over union (mIoU) of 38.512%, and in wood and leaf separation at the tree level, it attained an oAcc of 80.856%, a mAcc of 64.013%, and a mIoU of 49.695%. Across both the forest and tree scenarios, our network outperforms the current state-of-the-art methods, namely, GrowSP and PointDC. Ablation experiments further confirm that each of the proposed modules contributes significantly to improving the segmentation accuracy, and in addition, our segmentation network demonstrates strong robustness even under high occlusion rates and exhibits excellent generalization capability.
引用
收藏
页数:13
相关论文
共 51 条
[1]   Non-destructive tree volume estimation through quantitative structure modelling: Comparing UAV laser scanning with terrestrial LIDAR [J].
Brede, Benjamin ;
Calders, Kim ;
Lau, Alvaro ;
Raumonen, Pasi ;
Bartholomeus, Harm M. ;
Herold, Martin ;
Kooistra, Lammert .
REMOTE SENSING OF ENVIRONMENT, 2019, 233
[2]   An improved optimum-path forest clustering algorithm for remote sensing image segmentation [J].
Chen, Siya ;
Sun, Tieli ;
Yang, Fengqin ;
Sun, Hongguang ;
Guan, Yu .
COMPUTERS & GEOSCIENCES, 2018, 112 :38-46
[3]   Individual Tree Crown Segmentation Directly from UAV-Borne LiDAR Data Using the PointNet of Deep Learning [J].
Chen, Xinxin ;
Jiang, Kang ;
Zhu, Yushi ;
Wang, Xiangjun ;
Yun, Ting .
FORESTS, 2021, 12 (02) :1-22
[4]   PointDC: Unsupervised Semantic Segmentation of 3D Point Clouds via Cross-modal Distillation and Super-Voxel Clustering [J].
Chen, Zisheng ;
Xu, Hongbin ;
Chen, Weitao ;
Zhou, Zhipeng ;
Xiao, Haihong ;
Sun, Baigui ;
Xie, Xuansong ;
Kang, Wenxiong .
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, :14244-14253
[5]  
Cicek O., 2016, Medical Image Computing and Computer-Assisted Intervention, V9901, P424, DOI [DOI 10.1007/978-3-319-46723-8_49, DOI 10.1007/978-3-319-46723-849]
[6]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[7]   ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes [J].
Dai, Angela ;
Chang, Angel X. ;
Savva, Manolis ;
Halber, Maciej ;
Funkhouser, Thomas ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2432-2443
[8]   MDC-Net: a multi-directional constrained and prior assisted neural network for wood and leaf separation from terrestrial laser scanning [J].
Dai, Wenxia ;
Jiang, Yiheng ;
Zeng, Wen ;
Chen, Ruibo ;
Xu, Yongyang ;
Zhu, Ningning ;
Xiao, Wen ;
Dong, Zhen ;
Guan, Qingfeng .
INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2023, 16 (01) :1224-1245
[9]   Weighing trees with lasers: advances, challenges and opportunities [J].
Disney, M. I. ;
Vicari, M. Boni ;
Burt, A. ;
Calders, K. ;
Lewis, S. L. ;
Raumonen, P. ;
Wilkes, P. .
INTERFACE FOCUS, 2018, 8 (02)
[10]   CenterNet: Keypoint Triplets for Object Detection [J].
Duan, Kaiwen ;
Bai, Song ;
Xie, Lingxi ;
Qi, Honggang ;
Huang, Qingming ;
Tian, Qi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :6568-6577