Semantic segmentation of point clouds by fusing dual attention mechanism and dynamic graph convolution

被引:0
作者
Yang, Jun [1 ,2 ]
Zhang, Chen [1 ]
机构
[1] School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou
[2] Faculty of Geomatics, Lanzhou Jiaotong University, Lanzhou
来源
Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics | 2024年 / 50卷 / 10期
基金
中国国家自然科学基金;
关键词
3D point cloud; attention mechanism; deep learning; dynamic graph convolution; semantic segmentation;
D O I
10.13700/j.bh.1001-5965.2022.0775
中图分类号
学科分类号
摘要
The existing semantic segmentation methods of 3D point clouds based on deep learning usually ignore the profound semantic information between neighboring points when extracting local features and fail to consider the useful information in other neighboring features when aggregating local neighboring features. To solve these problems, a semantic segmentation algorithm of 3D point clouds fusing dual attention mechanism and dynamic graph convolution neural network (DGCNN) was proposed. Firstly, edge features were constructed by dynamic graph convolution operation, and the relative distance between the center point and the neighboring points was input to the kernel point convolution operation to obtain enhanced edge features, further strengthening the relationship between the center point and the neighboring points. Secondly, the spatial attention module was introduced to establish the dependence between neighboring points, and the similar feature points were intercorrelated, so as to extract profound context information in the local neighborhood and enrich the geometric features of neighboring points. Finally, the channel attention module was introduced when local neighboring features were aggregated. By giving different weights to different channels, the purpose of enhancing useful channels and suppressing useless channels was achieved, so as to improve the accuracy of semantic segmentation. The experimental results on the S3DIS dataset and SemanticKITTI dataset show that the semantic segmentation accuracy of this algorithm has reached 66.0% and 59.4%, respectively. Compared with other classical network models, this algorithm has achieved a better point cloud segmentation effect. © 2024 Beijing University of Aeronautics and Astronautics (BUAA). All rights reserved.
引用
收藏
页码:2984 / 2994
页数:10
相关论文
共 50 条
  • [31] DFAMNet: dual fusion attention multi-modal network for semantic segmentation on LiDAR point clouds
    Mingjie Li
    Gaihua Wang
    Minghao Zhu
    Chunzheng Li
    Hong Liu
    Xuran Pan
    Qian Long
    Applied Intelligence, 2024, 54 : 3169 - 3180
  • [32] GRAPH CNN WITH RADIUS DISTANCE FOR SEMANTIC SEGMENTATION OF HISTORICAL BUILDINGS TLS POINT CLOUDS
    Morbidoni, C.
    Pierdicca, R.
    Quattrini, R.
    Frontoni, E.
    ISPRS TC IV 3RD BIM/GIS INTEGRATION WORKSHOP AND 15TH 3D GEOINFO CONFERENCE 2020, 2020, 44-4 (W1): : 95 - 102
  • [33] Feature fusion network based on attention mechanism for 3D semantic segmentation of point clouds
    Zhou, Heng
    Fang, Zhijun
    Gao, Yongbin
    Huang, Bo
    Zhong, Cengsi
    Shang, Ruoxi
    PATTERN RECOGNITION LETTERS, 2020, 133 : 327 - 333
  • [34] A Speaker Recognition Method Based on Dynamic Convolution with Dual Attention Mechanism
    Luo, Yuan
    Zhu, Kuilin
    Wang, Wenhao
    Lin, Ziyao
    ENGINEERING LETTERS, 2023, 31 (02) : 825 - 832
  • [35] Dual attention-based deep learning network for multi-class object semantic segmentation of tunnel point clouds
    Ji, Ankang
    Zhang, Limao
    Fan, Hongqin
    Xue, Xiaolong
    Dou, Yudan
    AUTOMATION IN CONSTRUCTION, 2023, 156
  • [36] Dual hierarchical attention-enhanced transfer learning for semantic segmentation of point clouds in building scene understanding
    Zhang, Limao
    Wei, Zeyang
    Xiao, Zhonghua
    Ji, Ankang
    Wu, Beibei
    AUTOMATION IN CONSTRUCTION, 2024, 168
  • [37] Spatial Attention-Based Kernel Point Convolution Network for Semantic Segmentation of Transmission Corridor Scenarios in Airborne Laser Scanning Point Clouds
    Zhou, Fangrong
    Wen, Gang
    Ma, Yi
    Pan, Hao
    Wang, Guofang
    Wang, Yifan
    ELECTRONICS, 2024, 13 (22)
  • [38] Point attention network for point cloud semantic segmentation
    Ren, Dayong
    Wu, Zhengyi
    Li, Jiawei
    Yu, Piaopiao
    Guo, Jie
    Wei, Mingqiang
    Guo, Yanwen
    SCIENCE CHINA-INFORMATION SCIENCES, 2022, 65 (09)
  • [39] Dynamic attention network for semantic segmentation
    Wu, Fei
    Chen, Feng
    Jing, Xiao-Yuan
    Hu, Chang-Hui
    Ge, Qi
    Ji, Yimu
    NEUROCOMPUTING, 2020, 384 (384) : 182 - 191
  • [40] Point attention network for point cloud semantic segmentation
    Dayong Ren
    Zhengyi Wu
    Jiawei Li
    Piaopiao Yu
    Jie Guo
    Mingqiang Wei
    Yanwen Guo
    Science China Information Sciences, 2022, 65