Graph-PBN: Graph-based parallel branch network for efficient point cloud learning

被引:6
作者
Zhang, Cheng [1 ]
Chen, Hao [1 ]
Wan, Haocheng [1 ]
Yang, Ping [1 ]
Wu, Zizhao [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Media & Design, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud learning; Graph convolutional networks; Attention mechanism; SEGMENTATION;
D O I
10.1016/j.gmod.2021.101120
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In recent years, approaches based on graph convolutional networks (GCNs) have achieved state-of-the-art performance in point cloud learning. The typical pipeline of GCNs is modeled as a two-stage learning process: graph construction and feature learning. We argue that such process exhibits low efficiency because a high percentage of the total time is consumed during the graph construction process when a large amount of sparse data are required to be accessed rather than on actual feature learning. To alleviate this problem, we propose a graph based parallel branch network (Graph-PBN) that introduces a parallel branch structure to point cloud learning in this study. In particular, Graph-PBN is composed of two branches: the PointNet branch and the GCN branch. PointNet exhibits advantages in memory access and computational cost, while GCN behaves better in local context modeling. The two branches are combined in our architecture to utilize the potential of PointNet and GCN fully, facilitating the achievement of efficient and accurate recognition results. To better aggregate the features of each node in GCN, we investigate a novel operator, called EAGConv, to augment their local context by fully utilizing geometric and semantic features in a local graph. We conduct experiments on several benchmark datasets, and experiment results validate the significant performance of our method compared with other stateof-the-art approaches. Our code will be made publicly available at https://github.com/zhangcheng828/Graph-PBN.
引用
收藏
页数:9
相关论文
共 46 条
[1]  
Armeni Iro, 2017, Dataset for 3D Indoor Scene Understanding Using Mobile
[2]   Point Convolutional Neural Networks by Extension Operators [J].
Atzmon, Matan ;
Maron, Haggai ;
Lipman, Yaron .
ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (04)
[3]   Large-Scale Machine Learning with Stochastic Gradient Descent [J].
Bottou, Leon .
COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, :177-186
[4]   SnapNet: 3D point cloud semantic labeling with 2D deep segmentation networks [J].
Boulch, Alexandre ;
Guerry, Yids ;
Le Saux, Bertrand ;
Audebert, Nicolas .
COMPUTERS & GRAPHICS-UK, 2018, 71 :189-198
[5]  
Chang A.X. M., 2015, Comput. Sci.
[6]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[7]   Exploring Spatial Context for 3D Semantic Segmentation of Point Clouds [J].
Engelmann, Francis ;
Kontogianni, Theodora ;
Hermans, Alexander ;
Leibe, Bastian .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :716-724
[8]   PCT: Point cloud transformer [J].
Guo, Meng-Hao ;
Cai, Jun-Xiong ;
Liu, Zheng-Ning ;
Mu, Tai-Jiang ;
Martin, Ralph R. ;
Hu, Shi-Min .
COMPUTATIONAL VISUAL MEDIA, 2021, 7 (02) :187-199
[9]  
Himeur C.-E., 2020, PCEDNET LIGHTWEIGHT
[10]   Recurrent Slice Networks for 3D Segmentation of Point Clouds [J].
Huang, Qiangui ;
Wang, Weiyue ;
Neumann, Ulrich .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2626-2635