Uncertainty-Aware Point-Cloud Semantic Segmentation for Unstructured Roads

被引:4
|
作者
Liu, Pengfei [1 ,2 ]
Yu, Guizhen [1 ,2 ]
Wang, Zhangyu [3 ,4 ]
Zhou, Bin [3 ,4 ]
Ming, Ruotong [5 ]
Jin, Chunhua [6 ]
机构
[1] Beihang Univ, Sch Transportat Sci & Engn, Beijing 100191, Peoples R China
[2] Minist Ind & Informat Technol, Key Lab Autonomous Transportat Technol Special Ve, Beijing 100191, Peoples R China
[3] Beihang Univ, Res Inst Frontier Sci, Beijing 100191, Peoples R China
[4] Beihang Univ, Hefei Innovat Res Inst, Hefei 230012, Peoples R China
[5] Chongqing Univ, Chongqing Univ Univ Cincinnati Joint Co op Inst, Chongqing 400044, Peoples R China
[6] Beijing Informat Sci & Technol Univ, Res Inst Artificial Intelligence, Beijing 100192, Peoples R China
基金
中国国家自然科学基金;
关键词
Uncertainty; Semantic segmentation; Roads; Sensors; Semantics; Estimation; Convolution; Point cloud; semantic segmentation; uncertainty estimation; unstructured roads; LANE-DETECTION; CLASSIFICATION; NAVIGATION;
D O I
10.1109/JSEN.2023.3266802
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Semantic segmentation is one of the fundamental elements for achieving effective and safe autonomous driving. However, due to the irregular boundaries and variable illumination of unstructured roads, applying it in these scenarios is confronted with great challenges. To address these problems, a novel point-cloud semantic segmentation framework for unstructured roads is proposed. It contains three sections: spherical projection, an uncertainty-aware semantic segmentation network, and postprocessing. First, point cloud will be projected to the range image, which can be processed by the 2-D convolution network. Then, the uncertainty-aware semantic segmentation network is constructed. It consists of context-aware attention (CAA) module and direction attention up-sampling (DAU) module, which can improve the performance for the segmentation of unstructured roads. In addition, a Gaussian mixture model (GMM) is introduced at the end of the network to predict the result with uncertainty, indicating the confidence level of the output. Finally, the segmentation result is refined during the postprocessing to help filter the noise points. Experimental data from mine sites were collected to validate the performance for unstructured roads. In addition, the proposed method was evaluated on the public unstructured dataset RELLIS-3-D. The experiments show that the proposed architecture achieved 74.9% and 40.4% mIoU, which performs better than comparison methods. Additionally, the network is more robust to noisy data by achieving improvements of 4.6%-7.6% under different levels of noise data.
引用
收藏
页码:15071 / 15080
页数:10
相关论文
共 50 条
  • [31] pCTFusion: Point Convolution-Transformer Fusion with Semantic Aware Loss for Outdoor LiDAR Point Cloud Segmentation
    Kuriyal A.
    Kumar V.
    Lohani B.
    SN Computer Science, 5 (3)
  • [32] FAT: FIELD-AWARE TRANSFORMER FOR 3D POINT CLOUD SEMANTIC SEGMENTATION
    Zhou, Junjie
    Xiong, Yongping
    Chiu, Chinwai
    Liu, Fangyu
    Gong, Xiangyang
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 660 - 664
  • [33] DCARN: Deep Context Aware Recurrent Neural Network for Semantic Segmentation of Large Scale Unstructured 3D Point Cloud
    Saba Mehmood
    Muhammad Shahzad
    Muhammad Moazam Fraz
    Neural Processing Letters, 2023, 55 : 881 - 904
  • [34] A Novel Local-Global Graph Convolutional Method for Point Cloud Semantic Segmentation
    Du, Zijin
    Ye, Hailiang
    Cao, Feilong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) : 4798 - 4812
  • [35] Radial Transformer for Large-Scale Outdoor LiDAR Point Cloud Semantic Segmentation
    He, Xiang
    Li, Xu
    Ni, Peizhou
    Xu, Wang
    Xu, Qimin
    Liu, Xixiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [36] OPOCA: One Point One Class Annotation for LiDAR Point Cloud Semantic Segmentation
    Huang, Weijie
    Zou, Pufan
    Xia, Yan
    Wen, Chenglu
    Zang, Yu
    Wang, Cheng
    Zhou, Guoqing
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 10
  • [37] Weather-aware autopilot: Domain generalization for point cloud semantic segmentation in diverse weather scenarios
    Du, Jing
    Zelek, John
    Li, Jonathan
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 218 : 204 - 219
  • [38] Local and Global Structure for Urban ALS Point Cloud Semantic Segmentation With Ground-Aware Attention
    Jiang, Tengping
    Wang, Yongjun
    Liu, Shan
    Cong, Yangzi
    Dai, Lei
    Sun, Jian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [39] PTS-Map: Probabilistic Terrain State Map for Uncertainty-Aware Traversability Mapping in Unstructured Environments
    Kim, Dong-Wook
    Son, E-In
    Kim, Chan
    Hwang, Ji-Hoon
    Seo, Seung-Woo
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (02): : 1257 - 1264
  • [40] Uncertainty-aware domain alignment for anatomical structure segmentation
    Bian, Cheng
    Yuan, Chenglang
    Wang, Jiexiang
    Li, Meng
    Yang, Xin
    Yu, Shuang
    Ma, Kai
    Yuan, Jin
    Zheng, Yefeng
    MEDICAL IMAGE ANALYSIS, 2020, 64