DCFNet：Dual-Channel Feature Fusion of Real Scene for Point Cloud Semantic Segmentation

被引：0
作者：
Sun, Liujie [1 ]
Zhu, Yaoda [1 ]
Wang, Wenju [1 ]
机构：
[1] College of Communication and Art Design, Shanghai University of Science and Technology, Shanghai
来源：
Computer Engineering and Applications | 2024年 / 60卷 / 12期
关键词：
attention mechanism; deep learning; dual-channel feature fusion; point cloud semantic segmentation;
D O I：
10.3778/j.issn.1002-8331.2305-0290
中图分类号：
学科分类号：
摘要：
The point cloud of the real scene not only has the spatial geometric information of the point cloud, but also has the color information of the 3D object. The existing network cannot effectively use the local features and spatial geometric feature information of the real scene. Therefore, a dual-channel feature fusion of real scene for point cloud semantic segmentation DCFNet can be used for indoor and outdoor scene semantic segmentation in different scenarios. More specifically, in order to solve the problem that the color information of the point cloud in the real scene cannot be fully extracted, the method uses two input channels, and the channel adopts the same feature extraction network structure. The input of the upper channel is the complete RGB color and point cloud coordinate information, and the channel mainly focuses on the scene features of complex objects, while the lower channel only inputs the point cloud coordinate information. This channel mainly focuses on the spatial geometric characteristics of the point cloud. In each channel, in order to better extract local and global information and improve network performance, the inter-layer fusion module and the Transformer channel feature expansion module are introduced. At the same time, the existing 3D point cloud semantic segmentation methods lack of attention to the relationship between local features and global features, which leads to poor segmentation results for complex scenes. In this paper, the features extracted from the upper and lower channels are fused by the DCFFS (dual-channel feature fusion segmentation) module, and the semantic segmentation of the real scene is performed. The experimental results show that the mean intersection over union (MIOU) of the proposed DCFNet segmentation method on the S3DIS Area5 indoor scene dataset and the STPLS3D outdoor scene dataset reaches 71.18% and 48.87% respectively. The mean average precision (MACC) and overall accuracy (OACC) reach 77.01% and 86.91% respectively, achieving high-precision point cloud semantic segmentation in real scenes. © 2024 Journal of Computer Engineering and Applications Beijing Co., Ltd.; Science Press. All rights reserved.
引用
收藏
页码：160 / 169
页数：9
相关论文
共 30 条
[11]  
SU H, MAJI S, KALOGERAKIS E, Et al., Multi-view convolutional neural networks for 3D shape recognition, IEEE International Conference on Computer Vision, pp. 945-953, (2015)
[12]  
ABOU ZEID K, SCHULT J, HERMANS A, Et al., Point2Vec for self- supervised representation learning on point clouds [J], (2023)
[13]  
LE T, DUAN Y., PointGrid: a deep network for 3D shape understanding, 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9204-9214, (2018)
[14]  
TANG H, LIU Z, ZHAO S, Et al., Searching efficient 3D architectures with sparse point-voxel convolution, European Conference on Computer Vision, pp. 685-702, (2020)
[15]  
HOU Y N, ZHU X G, MA Y X, Et al., Point-to-voxel knowledge distillation for LiDAR semantic segmentation, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8469-8478, (2022)
[16]  
QI C R, SU H, MO K C, Et al., PointNet: deep learning on point sets for 3D classification and segmentation, 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 77-85, (2017)
[17]  
WANG W, YU R, HUANG Q, Et al., SGPN: similarity group proposal network for 3D point cloud instance segmentation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2569-2578, (2018)
[18]  
QI C R, YI L, SU H, Et al., PointNet++ deep hierarchical feature learning on point sets in a metric space, Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 5105-5114, (2017)
[19]  
MA Y, GUO Y, LEI Y, Et al., 3DMAX-Net: a multi-scale spatial contextual network for 3D point cloud semantic segmentation, 2018 24th International Conference on Pattern Recognition (ICPR), pp. 1560-1566, (2018)
[20]  
WU W, QI Z, LI F X., PointConv: deep convolutional networks on 3D point clouds, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 9613-9622, (2019)
123