Deep 3D point cloud classification and segmentation network based on GateNet

被引:12
作者
Liu, Hui [1 ]
Tian, Shuaihua [1 ]
机构
[1] Beijing Univ Civil Engn & Architecture, Sch Elect & Informat Engn, Dept Automat, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Machine vision; 3D point cloud; GateNet; SENet; Attention mechanism;
D O I
10.1007/s00371-023-02826-w
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the gradual growth of deep learning in machine vision, efficient extraction of 3D point clouds becomes significant. The raw data of the 3D point cloud are sparse, disordered, and immersed in noise, which makes it difficult to classify and segment. Whether 3D point clouds can be classified and segmented or not, the local feature is an essential ingredient. Therefore, this paper proposes a GateNet-based PointNet++ network (G-PointNet++). G-PointNet++ extracts local features more accurately than PointNet++ by suppressing irrelevant features and emphasizing important features. Meanwhile, it refines the feature adaptively. Besides, the SENet and attention mechanism are introduced into PointNet++. G-PointNet++ was evaluated on the public ModelNet dataset, ShapeNet dataset, and S3DIS dataset, and its effectiveness in classification and segmentation tasks was verified. In the classification task, G-PointNet++ achieves an overall classification accuracy (OA) of 95.5% on ModelNet10 and 93.3% on ModelNet40. In the segmentation task, the mIoU of G-PointNet++ reaches 85.5% on ShapeNet. These experiments show that G-PointNet++ achieves better performance and saves more time than PointNet++, and its overall accuracy is higher than that of PCT network on ModeNet40.
引用
收藏
页码:971 / 981
页数:11
相关论文
共 33 条
[1]   Lidar Point Cloud Compression, Processing and Learning for Autonomous Driving [J].
Abbasi, Rashid ;
Bashir, Ali Kashif ;
Alyamani, Hasan J. ;
Amin, Farhan ;
Doh, Jaehyeok ;
Chen, Jianwen .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (01) :962-979
[2]  
[Anonymous], 2018, arXiv
[3]  
[Anonymous], 2015, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
[4]   Pointwise Convolutional Neural Networks [J].
Binh-Son Hua ;
Minh-Khoi Tran ;
Yeung, Sai-Kit .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :984-993
[5]  
Chang Angel X., 2015, arXiv
[6]   DDGCN: graph convolution network based on direction and distance for point cloud learning [J].
Chen, Lifang ;
Zhang, Qian .
VISUAL COMPUTER, 2023, 39 (03) :863-873
[7]  
Cheraghian A, 2019, PROCEEDINGS OF MVA 2019 16TH INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS (MVA), DOI [10.23919/mva.2019.8758063, 10.23919/MVA.2019.8758063]
[8]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[9]   PCT: Point cloud transformer [J].
Guo, Meng-Hao ;
Cai, Jun-Xiong ;
Liu, Zheng-Ning ;
Mu, Tai-Jiang ;
Martin, Ralph R. ;
Hu, Shi-Min .
COMPUTATIONAL VISUAL MEDIA, 2021, 7 (02) :187-199
[10]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/CVPR.2018.00745, 10.1109/TPAMI.2019.2913372]