Semantic segmentation for large-scale point clouds based on hybrid attention and dynamic fusion

被引:6
|
作者
Zhou, Ce [1 ]
Shu, Zhaokun [2 ]
Shi, Li [2 ]
Ling, Qiang [1 ]
机构
[1] Univ Sci & Technol China, Hefei 230027, Anhui, Peoples R China
[2] Anhui JiangHuai Automobile Grp CO Ltd, Hefei 230601, Peoples R China
关键词
Hybrid attention; Dynamic fusion; Point cloud; Semantic segmentation; PRIORS;
D O I
10.1016/j.patcog.2024.110798
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates the semantic segmentation problem for large-scale point clouds. Recent segmentation methods usually employ an encoder-decoder architecture. However, these methods may not effectively extract neighboring information in the encoder. Additionally, they typically use nearest neighbor interpolation and skip connections in the decoder, overlooking the semantic gap between encoder and decoder features. To resolve these issues, we propose HADF-Net, which consists of a Hybrid Attention Encoder (HAE), an Edge Dynamic Fusion module (EDF), and a Dynamic Cross-attention Decoder (DCD). HAE leverages the distinctive properties of geometric and semantic relations to aggregate local features at different stages. EDF aims to alleviate information loss during decoder upsampling by dynamically integrating the neighboring information. DCD employs an enhanced fusion mechanism with spatial-wise cross-attention to bridge the semantic gap between encoder and decoder features. Experimental results on 4 datasets demonstrate that our HADF-Net achieves superior performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Weakly Supervised Large-Scale Point Cloud Semantic Segmentation Based on Dual Consistency Constraints and Uncertainty-Aware Fusion
    Zhou, Ce
    Ling, Qiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [32] FAR-Net: Semantic Segmentation of Large-Scale Point Clouds Based on Feature Aggregation and Recoding for Aerial Computing
    Zhang, Jianlong
    Chen, Huangwei
    Wang, Bin
    Fang, Guangzu
    Zhou, Yang
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (06): : 5217 - 5227
  • [33] Context-Aware Network for Semantic Segmentation Toward Large-Scale Point Clouds in Urban Environments
    Liu, Chun
    Zeng, Doudou
    Akbar, Akram
    Wu, Hangbin
    Jia, Shoujun
    Xu, Zeran
    Yue, Han
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [34] Mining local geometric structure for large-scale 3D point clouds semantic segmentation
    Shao, Yuyuan
    Tong, Guofeng
    Peng, Hao
    NEUROCOMPUTING, 2022, 500 : 191 - 202
  • [35] DFAMNet: dual fusion attention multi-modal network for semantic segmentation on LiDAR point clouds
    Mingjie Li
    Gaihua Wang
    Minghao Zhu
    Chunzheng Li
    Hong Liu
    Xuran Pan
    Qian Long
    Applied Intelligence, 2024, 54 : 3169 - 3180
  • [36] Feature Fusion Network Based on Hybrid Attention for Semantic Segmentation
    Xie Xinchen
    Li, Chen
    Tian, Lihua
    2022 IEEE WORLD AI IOT CONGRESS (AIIOT), 2022, : 9 - 14
  • [37] Radial Transformer for Large-Scale Outdoor LiDAR Point Cloud Semantic Segmentation
    He, Xiang
    Li, Xu
    Ni, Peizhou
    Xu, Wang
    Xu, Qimin
    Liu, Xixiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [38] STSD:A large-scale benchmark for semantic segmentation of subway tunnel point cloud
    Cui, Hao
    Li, Jian
    Mao, Qingzhou
    Hu, Qingwu
    Dong, Cuijun
    Tao, Yiwen
    TUNNELLING AND UNDERGROUND SPACE TECHNOLOGY, 2024, 150
  • [39] VPFNET: A Scale-Adaptive Voxel Point Fusion Network for Semantic Segmentation of Point Clouds
    Wang, Xiaoyang
    Cui, Kaining
    Wang, Lu
    Liu, Zhenfei
    Yu, Bingxin
    He, Yuhong
    Cheng, Jun
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT X, 2025, 15040 : 75 - 88
  • [40] Dual fusion network for semantic segmentation of point clouds *
    Lu, Jian
    Guo, Huihui
    Jia, Xurui
    Wu, Jiatong
    Chen, Xiaogai
    OPTICS AND LASERS IN ENGINEERING, 2024, 177