Boundary-Aware graph Markov neural network for semiautomated object segmentation from point clouds

被引:7
作者
Luo, Huan [1 ,2 ]
Zheng, Quan [1 ,2 ]
Fang, Lina [3 ]
Guo, Yingya [1 ,2 ]
Guo, Wenzhong [1 ,2 ]
Wang, Cheng [4 ]
Li, Jonathan [5 ,6 ]
机构
[1] Fuzhou Univ, Coll Comp Sci & Big Data, Fuzhou 350108, FJ, Peoples R China
[2] Fuzhou Univ, Fujian Prov Key Lab Network Comp & Intelligent In, Fuzhou 350108, FJ, Peoples R China
[3] Fuzhou Univ, Acad Digital China Fujian, Fuzhou 350108, FJ, Peoples R China
[4] Xiamen Univ, Sch Informat, Fujian Key Lab Sensing & Comp Smart Cities, Xiamen 361005, FJ, Peoples R China
[5] Univ Waterloo, Dept Geog & Environm Management, Waterloo, ON N2L 3G1, Canada
[6] Univ Waterloo, Dept Syst Design Engn, Waterloo, ON N2L 3G1, Canada
基金
中国国家自然科学基金;
关键词
Point Cloud; 3D Object Segmentation; Boundary Constraint; Graph Neural Network; Markov Random Field;
D O I
10.1016/j.jag.2021.102564
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Due to the advantages of 3D point clouds over 2D optical images, the related researches on scene understanding in 3D point clouds have been increasingly attracting wide attention from academy and industry. However, many 3D scene understanding methods largely require abundant supervised information for training a data-driven model. The acquisition of such supervised information relies on manual annotations which are laborious and arduous. Therefore, to mitigate such manual efforts for annotating training samples, this paper studies a unified neural network to segment 3D objects out of point clouds interactively. Particularly, to improve the segmentation performance on the accurate object segmentation, the boundary information of 3D objects in point clouds are encoded as a boundary energy term in the Markov Random Field (MRF) model. Moreover, the MRF model with the boundary energy term is naturally integrated with the Graphical Neural Network (GNN) to obtain a compact representation for generating the boundary-preserved 3D objects. The proposed method is evaluated on two point clouds datasets obtained from different types of laser scanning systems, i.e. terrestrial laser scanning system and mobile laser scanning system. Comparative experiments show that the proposed method is superior and effective in 3D objects segmentation in different point-cloud scenarios.
引用
收藏
页数:9
相关论文
共 45 条
[1]   Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN plus [J].
Acuna, David ;
Ling, Huan ;
Kar, Amlan ;
Fidler, Sanja .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :859-868
[2]  
Ahmed SM, 2018, IEEE INT C INT ROBOT, P7350, DOI 10.1109/IROS.2018.8593910
[3]   Creating a virtual reality environment with a fusion of sUAS and TLS point-clouds [J].
Bolkas, Dimitrios ;
Chiampi, Jeffrey ;
Chapman, John ;
Pavill, Vincent F. .
INTERNATIONAL JOURNAL OF IMAGE AND DATA FUSION, 2020, 11 (02) :136-161
[4]   Fast approximate energy minimization via graph cuts [J].
Boykov, Y ;
Veksler, O ;
Zabih, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (11) :1222-1239
[5]   Annotating Object Instances with a Polygon-RNN [J].
Castrejon, Lluis ;
Kundu, Kaustav ;
Urtasun, Raquel ;
Fidler, Sanja .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :4485-4493
[6]   Boundary-Preserving Mask R-CNN [J].
Cheng, Tianheng ;
Wang, Xinggang ;
Huang, Lichao ;
Liu, Wenyu .
COMPUTER VISION - ECCV 2020, PT XIV, 2020, 12359 :660-676
[7]   Mean shift: A robust approach toward feature space analysis [J].
Comaniciu, D ;
Meer, P .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (05) :603-619
[8]  
Geiger A, 2012, PROC CVPR IEEE, P3354, DOI 10.1109/CVPR.2012.6248074
[9]  
Golovinskiy Aleksey, 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops, P39, DOI 10.1109/ICCVW.2009.5457721
[10]  
Gong JY, 2021, AAAI CONF ARTIF INTE, V35, P1424