Deep learning-based semantic segmentation of three-dimensional point cloud: a comprehensive review

被引:8
作者
Singh, Dheerendra Pratap [1 ]
Yadav, Manohar [1 ]
机构
[1] Motilal Nehru Natl Inst Technol Allahabad, Geog Informat Syst GIS Cell, Prayagraj 211004, India
关键词
LiDAR; Point cloud; image; Deep learning; semantic segmentation; 3D OBJECT RECOGNITION; NEURAL-NETWORK; LIDAR DATA; CLASSIFICATION; FUSION; NET; DATASET;
D O I
10.1080/01431161.2023.2297177
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Point cloud has emerged as the most popular three-dimensional (3D) data format in recent years for several scientific and industrial applications. Point cloud semantic segmentation has piqued the researcher's interest, which is a crucial stage in 3D analysis and scene comprehension. Deep learning-based processing is more feasible to increase the availability of point cloud acquisition tools that is LiDAR systems at the user end. The point cloud learning achieves tremendous success in object detection, object categorization, and semantic segmentation. To summarize the recent works with chronological development, comprehensive review of projection-, voxel-, and direct point-based point cloud semantic segmentation methods is performed from various perspectives. The commonly used point cloud benchmark datasets with their characteristics are discussed, and they are used for the performance analysis and comparison of several state-of-the-art segmentation methods. The quantitative performance analysis of these deep learning models summarizes the trend of semantic segmentation of point clouds. In the context of point cloud semantic segmentation, the various methods have specific roles. Based on the review of methods working and their performance analysis, it is concluded that the projection-based methods prioritize efficiency, which is ideal in unavailability of high-performance computing system. Voxel-based methods capture overall context, serving well in 3D object classification. Point-based approaches excel in fine details and efficiency, suited for tasks like 3D semantic segmentation. Choosing the suitable method depends on the task, data, and resources. KPConv and DGCNN are popular choices, especially for precision and adaptability to point density. However, method performance varies, underlining the need for tailored selection. Hybrid approaches, combining method strengths, promise superior results.
引用
收藏
页码:532 / 586
页数:55
相关论文
共 175 条
[21]   PTANet: Triple Attention Network for point cloud semantic segmentation [J].
Cheng, Haozhe ;
Lu, Jian ;
Luo, Maoxin ;
Liu, Wei ;
Zhang, Kaibing .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 102
[22]   Cascaded Non-local Neural Network for Point Cloud Semantic Segmentation [J].
Cheng, Mingmei ;
Hui, Le ;
Xie, Jin ;
Yang, Jian ;
Kong, Hui .
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, :8447-8452
[23]   Semantic Point Cloud Mapping of LiDAR Based on Probabilistic Uncertainty Modeling for Autonomous Driving [J].
Cho, Sungjin ;
Kim, Chansoo ;
Park, Jaehyun ;
Sunwoo, Myoungho ;
Jo, Kichun .
SENSORS, 2020, 20 (20) :1-25
[24]   The DGPF-Test on Digital Airborne Camera Evaluation - Overview and Test Design [J].
Cramer, Michael .
PHOTOGRAMMETRIE FERNERKUNDUNG GEOINFORMATION, 2010, (02) :73-82
[25]   ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scans [J].
Dai, Angela ;
Ritchie, Daniel ;
Bokeloh, Martin ;
Reed, Scott ;
Sturm, Juergen ;
Niessner, Matthias .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4578-4587
[26]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[27]   ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes [J].
Dai, Angela ;
Chang, Angel X. ;
Savva, Manolis ;
Halber, Maciej ;
Funkhouser, Thomas ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2432-2443
[28]   Deep Learning for LiDAR Point Cloud Classification in Remote Sensing [J].
Diab, Ahmed ;
Kashef, Rasha ;
Shaker, Ahmed .
SENSORS, 2022, 22 (20)
[29]   Know What Your Neighbors Do: 3D Semantic Segmentation of Point Clouds [J].
Engelmann, Francis ;
Kontogianni, Theodora ;
Schult, Jonas ;
Leibe, Bastian .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT III, 2019, 11131 :395-409
[30]   SCF-Net: Learning Spatial Contextual Features for Large-Scale Point Cloud Segmentation [J].
Fan, Siqi ;
Dong, Qiulei ;
Zhu, Fenghua ;
Lv, Yisheng ;
Ye, Peijun ;
Wang, Fei-Yue .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :14499-14508