Uncertainty-Aware Point-Cloud Semantic Segmentation for Unstructured Roads

被引:5
作者
Liu, Pengfei [1 ,2 ]
Yu, Guizhen [1 ,2 ]
Wang, Zhangyu [3 ,4 ]
Zhou, Bin [3 ,4 ]
Ming, Ruotong [5 ]
Jin, Chunhua [6 ]
机构
[1] Beihang Univ, Sch Transportat Sci & Engn, Beijing 100191, Peoples R China
[2] Minist Ind & Informat Technol, Key Lab Autonomous Transportat Technol Special Ve, Beijing 100191, Peoples R China
[3] Beihang Univ, Res Inst Frontier Sci, Beijing 100191, Peoples R China
[4] Beihang Univ, Hefei Innovat Res Inst, Hefei 230012, Peoples R China
[5] Chongqing Univ, Chongqing Univ Univ Cincinnati Joint Co op Inst, Chongqing 400044, Peoples R China
[6] Beijing Informat Sci & Technol Univ, Res Inst Artificial Intelligence, Beijing 100192, Peoples R China
基金
中国国家自然科学基金;
关键词
Uncertainty; Semantic segmentation; Roads; Sensors; Semantics; Estimation; Convolution; Point cloud; semantic segmentation; uncertainty estimation; unstructured roads; LANE-DETECTION; CLASSIFICATION; NAVIGATION;
D O I
10.1109/JSEN.2023.3266802
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Semantic segmentation is one of the fundamental elements for achieving effective and safe autonomous driving. However, due to the irregular boundaries and variable illumination of unstructured roads, applying it in these scenarios is confronted with great challenges. To address these problems, a novel point-cloud semantic segmentation framework for unstructured roads is proposed. It contains three sections: spherical projection, an uncertainty-aware semantic segmentation network, and postprocessing. First, point cloud will be projected to the range image, which can be processed by the 2-D convolution network. Then, the uncertainty-aware semantic segmentation network is constructed. It consists of context-aware attention (CAA) module and direction attention up-sampling (DAU) module, which can improve the performance for the segmentation of unstructured roads. In addition, a Gaussian mixture model (GMM) is introduced at the end of the network to predict the result with uncertainty, indicating the confidence level of the output. Finally, the segmentation result is refined during the postprocessing to help filter the noise points. Experimental data from mine sites were collected to validate the performance for unstructured roads. In addition, the proposed method was evaluated on the public unstructured dataset RELLIS-3-D. The experiments show that the proposed architecture achieved 74.9% and 40.4% mIoU, which performs better than comparison methods. Additionally, the network is more robust to noisy data by achieving improvements of 4.6%-7.6% under different levels of noise data.
引用
收藏
页码:15071 / 15080
页数:10
相关论文
共 44 条
[1]   3D-MiniNet: Learning a 2D Representation From Point Clouds for Fast and Efficient 3D LIDAR Semantic Segmentation [J].
Alonso, Inigo ;
Riazuelo, Luis ;
Montesano, Luis ;
Murillo, Ana C. .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (04) :5432-5439
[2]   Eff-UNet: A Novel Architecture for Semantic Segmentation in Unstructured Environment [J].
Baheti, Bhakti ;
Innani, Shubham ;
Gajre, Suhas ;
Talbar, Sanjay .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :1473-1481
[3]   (AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Network [J].
Cheng, Ran ;
Razani, Ryan ;
Taghavi, Ehsan ;
Li, Enxu ;
Liu, Bingbing .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :12542-12551
[4]  
Choi S, 2018, IEEE INT CONF ROBOT, P6915
[5]  
Cortinhal Tiago, 2020, Advances in Visual Computing. 15th International Symposium, ISVC 2020. Proceedings. Lecture Notes in Computer Science (LNCS 12510), P207, DOI 10.1007/978-3-030-64559-5_16
[6]   UPPER AND LOWER PROBABILITIES INDUCED BY A MULTIVALUED MAPPING [J].
DEMPSTER, AP .
ANNALS OF MATHEMATICAL STATISTICS, 1967, 38 (02) :325-&
[7]   HARadNet: Anchor-free target detection for radar point clouds using hierarchical attention and multi-task learning [J].
Dubey, Anand ;
Santra, Avik ;
Fuchs, Jonas ;
Luebke, Maximilian ;
Weigel, Robert ;
Lurz, Fabian .
MACHINE LEARNING WITH APPLICATIONS, 2022, 8
[8]  
Gal Y, 2016, PR MACH LEARN RES, V48
[9]   Lightweight Probabilistic Deep Networks [J].
Gast, Jochen ;
Roth, Stefan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3369-3378
[10]   GA-Nav: Efficient Terrain Segmentation for Robot Navigation in Unstructured Outdoor Environments [J].
Guan, Tianrui ;
Kothandaraman, Divya ;
Chandra, Rohan ;
Sathyamoorthy, Adarsh Jagan ;
Weerakoon, Kasun ;
Manocha, Dinesh .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03) :8138-8145