Semantic segmentation for large-scale point clouds based on hybrid attention and dynamic fusion

被引:6
|
作者
Zhou, Ce [1 ]
Shu, Zhaokun [2 ]
Shi, Li [2 ]
Ling, Qiang [1 ]
机构
[1] Univ Sci & Technol China, Hefei 230027, Anhui, Peoples R China
[2] Anhui JiangHuai Automobile Grp CO Ltd, Hefei 230601, Peoples R China
关键词
Hybrid attention; Dynamic fusion; Point cloud; Semantic segmentation; PRIORS;
D O I
10.1016/j.patcog.2024.110798
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper investigates the semantic segmentation problem for large-scale point clouds. Recent segmentation methods usually employ an encoder-decoder architecture. However, these methods may not effectively extract neighboring information in the encoder. Additionally, they typically use nearest neighbor interpolation and skip connections in the decoder, overlooking the semantic gap between encoder and decoder features. To resolve these issues, we propose HADF-Net, which consists of a Hybrid Attention Encoder (HAE), an Edge Dynamic Fusion module (EDF), and a Dynamic Cross-attention Decoder (DCD). HAE leverages the distinctive properties of geometric and semantic relations to aggregate local features at different stages. EDF aims to alleviate information loss during decoder upsampling by dynamically integrating the neighboring information. DCD employs an enhanced fusion mechanism with spatial-wise cross-attention to bridge the semantic gap between encoder and decoder features. Experimental results on 4 datasets demonstrate that our HADF-Net achieves superior performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Region-Based Edge Convolutions With Geometric Attributes for the Semantic Segmentation of Large-Scale 3-D Point Clouds
    Contreras, Jhonatan
    Sickert, Sven
    Denzler, Joachim
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 2598 - 2609
  • [42] TOWARDS ACCURATE INSTANCE SEGMENTATION IN LARGE-SCALE LIDAR POINT CLOUDS
    Xiang, Binbin
    Peters, Torben
    Kontogianni, Theodora
    Vetterli, Frawa
    Puliti, Stefano
    Astrup, Rasmus
    Schindler, Konrad
    GEOSPATIAL WEEK 2023, VOL. 10-1, 2023, : 605 - 612
  • [43] Semantic segmentation of point clouds by fusing dual attention mechanism and dynamic graph convolution
    Yang, Jun
    Zhang, Chen
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2024, 50 (10): : 2984 - 2994
  • [44] Semantic Segmentation of Large-Scale Outdoor Point Clouds by Encoder-Decoder Shared MLPs with Multiple Losses
    Rim, Beanbonyka
    Lee, Ahyoung
    Hong, Min
    REMOTE SENSING, 2021, 13 (16)
  • [45] GAF-Net: Geometric Contextual Feature Aggregation and Adaptive Fusion for Large-Scale Point Cloud Semantic Segmentation
    Zhou, Ce
    Ling, Qiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [46] Automated semantic segmentation of bridge components from large-scale point clouds using a weighted superpoint graph
    Yang, Xiaofei
    Castillo, Enrique del Rey
    Zou, Yang
    Wotherspoon, Liam
    Tan, Yi
    AUTOMATION IN CONSTRUCTION, 2022, 142
  • [47] DCNet: Large-Scale Point Cloud Semantic Segmentation With Discriminative and Efficient Feature Aggregation
    Yin, Fukun
    Huang, Zilong
    Chen, Tao
    Luo, Guozhong
    Yu, Gang
    Fu, Bin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (08) : 4083 - 4095
  • [48] PointNAT: Large-Scale Point Cloud Semantic Segmentation via Neighbor Aggregation With Transformer
    Zeng, Ziyin
    Qiu, Huan
    Zhou, Jian
    Dong, Zhen
    Xiao, Jinsheng
    Li, Bijun
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 18
  • [49] Pipeline for Semantic Segmentation of Large Railway Point Clouds
    Gabrielidis, Hugo
    Gatti, Filippo
    Vialle, Stephane
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2024, PT I, 2025, 15346 : 167 - 179
  • [50] Large-Scale Unsupervised Semantic Segmentation
    Gao, Shanghua
    Li, Zhong-Yu
    Yang, Ming-Hsuan
    Cheng, Ming-Ming
    Han, Junwei
    Torr, Philip
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) : 7457 - 7476