Semantic segmentation for large-scale point clouds based on hybrid attention and dynamic fusion

被引:6
|
作者
Zhou, Ce [1 ]
Shu, Zhaokun [2 ]
Shi, Li [2 ]
Ling, Qiang [1 ]
机构
[1] Univ Sci & Technol China, Hefei 230027, Anhui, Peoples R China
[2] Anhui JiangHuai Automobile Grp CO Ltd, Hefei 230601, Peoples R China
关键词
Hybrid attention; Dynamic fusion; Point cloud; Semantic segmentation; PRIORS;
D O I
10.1016/j.patcog.2024.110798
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates the semantic segmentation problem for large-scale point clouds. Recent segmentation methods usually employ an encoder-decoder architecture. However, these methods may not effectively extract neighboring information in the encoder. Additionally, they typically use nearest neighbor interpolation and skip connections in the decoder, overlooking the semantic gap between encoder and decoder features. To resolve these issues, we propose HADF-Net, which consists of a Hybrid Attention Encoder (HAE), an Edge Dynamic Fusion module (EDF), and a Dynamic Cross-attention Decoder (DCD). HAE leverages the distinctive properties of geometric and semantic relations to aggregate local features at different stages. EDF aims to alleviate information loss during decoder upsampling by dynamically integrating the neighboring information. DCD employs an enhanced fusion mechanism with spatial-wise cross-attention to bridge the semantic gap between encoder and decoder features. Experimental results on 4 datasets demonstrate that our HADF-Net achieves superior performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [11] Semantic segmentation of large-scale point clouds based on dilated nearest neighbors graph
    Wang, Lei
    Wu, Jiaji
    Liu, Xunyu
    Ma, Xiaoliang
    Cheng, Jun
    COMPLEX & INTELLIGENT SYSTEMS, 2022, 8 (05) : 3833 - 3845
  • [12] RAAFNet: Reverse Attention Adaptive Fusion Network for Large-Scale Point Cloud Semantic Segmentation
    Wang, Kai
    Zhang, Huanhuan
    MATHEMATICS, 2024, 12 (16)
  • [13] Dense Dual-Branch Cross Attention Network for Semantic Segmentation of Large-Scale Point Clouds
    Luo, Ziwei
    Zeng, Ziyin
    Tang, Wei
    Wan, Jie
    Xie, Zhong
    Xu, Yongyang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 16
  • [14] EDGE-CONVOLUTION POINT NET FOR SEMANTIC SEGMENTATION OF LARGE-SCALE POINT CLOUDS
    Contreras, Jhonatan
    Denzler, Joachim
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 5236 - 5239
  • [15] BEMF-Net: Semantic Segmentation of Large-Scale Point Clouds via Bilateral Neighbor Enhancement and Multi-Scale Fusion
    Ji, Hao
    Yang, Sansheng
    Jiang, Zhipeng
    Zhang, Jianjun
    Guo, Shuhao
    Li, Gaorui
    Zhong, Saishang
    Liu, Zheng
    Xie, Zhong
    REMOTE SENSING, 2023, 15 (22)
  • [16] Active Spatio-Fine Enhancement Network for Semantic Segmentation of Large-Scale Point Clouds
    Chen, Xijiang
    Wang, Zihao
    Zhao, Bufan
    Qin, Mengjiao
    Han, Xianquan
    Ozdemir, Emirhan
    IEEE SENSORS JOURNAL, 2024, 24 (22) : 37358 - 37379
  • [17] Building semantic segmentation from large-scale point clouds via primitive recognition
    Romanengo, Chiara
    Cabiddu, Daniela
    Pittaluga, Simone
    Mortara, Michela
    GRAPHICAL MODELS, 2025, 136
  • [18] CSFNet: Cross-Modal Semantic Focus Network for Semantic Segmentation of Large-Scale Point Clouds
    Luo, Yang
    Han, Ting
    Liu, Yujun
    Su, Jinhe
    Chen, Yiping
    Li, Jinyuan
    Wu, Yundong
    Cai, Guorong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [19] DFAMNet: dual fusion attention multi-modal network for semantic segmentation on LiDAR point clouds
    Li, Mingjie
    Wang, Gaihua
    Zhu, Minghao
    Li, Chunzheng
    Liu, Hong
    Pan, Xuran
    Long, Qian
    APPLIED INTELLIGENCE, 2024, 54 (04) : 3169 - 3180
  • [20] UnrollingNet: An attention-based deep learning approach for the segmentation of large-scale point clouds of tunnels
    Zhang, Zhaoxiang
    Ji, Ankang
    Wang, Kunyu
    Zhang, Limao
    AUTOMATION IN CONSTRUCTION, 2022, 142