SAPCNet: symmetry-aware point cloud completion network

被引:1
作者
Xue, Yazhang [1 ]
Wang, Guoqi [1 ]
Fan, Xin [1 ]
Yu, Long [2 ]
Tian, Shengwei [1 ]
Zhang, Huang [1 ]
机构
[1] Xinjiang Univ, Coll Software, Urumqi, Peoples R China
[2] Xinjiang Univ, Network Ctr, Urumqi, Peoples R China
关键词
point cloud completion; symmetry-aware transformer; structural similarity; seed;
D O I
10.1117/1.JEI.33.5.053031
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In fields such as autonomous driving and 3D object reconstruction, complete 3D point cloud data is crucial. Existing methods often directly reconstruct complete point clouds from partial ones, overlooking the structural similarities within the point cloud data. To tackle this challenge, we introduce SAPCNet, an innovative network architecture that leverages the symmetry and structural similarities of point clouds to infer missing parts from known parts. We assume that incomplete point clouds share topological similarities with their symmetric counterparts. Through a feature-position pair extractor, we extract the center point and its features, which are then fused into an existing proxy. With our proposed symmetry-aware transformer, we analyze these features to accurately predict the positions of symmetric point proxies. In addition, we introduce a fine-seed generator to bridge the gap between the predicted missing point cloud and the original input point cloud, ensuring that the reconstructed point cloud maintains the geometric structure and visual characteristics consistent with the original data. Through a series of qualitative and quantitative evaluations, SAPCNet demonstrates outstanding performance across multiple datasets. (c) 2024 SPIE and IS&T
引用
收藏
页数:16
相关论文
共 61 条
[1]   FinerPCN: High fidelity point cloud completion network using pointwise convolution [J].
Chang, Yakun ;
Jung, Cheolkon ;
Xu, Yuanquan .
NEUROCOMPUTING, 2021, 460 :266-276
[2]   AziNorm: Exploiting the Radial Symmetry of Point Cloud for Azimuth-Normalized 3D Perception [J].
Chen, Shaoyu ;
Wang, Xinggang ;
Cheng, Tianheng ;
Zhang, Wenqiang ;
Zhang, Qian ;
Huang, Chang ;
Liu, Wenyu .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :6377-6386
[3]   Classification of Pancreatic Cystic Neoplasms Based on Multimodality Images [J].
Chen, Weixiang ;
Ji, Hongchen ;
Feng, Jianjiang ;
Liu, Rong ;
Yu, Yi ;
Zhou, Ruiquan ;
Zhou, Jie .
MACHINE LEARNING IN MEDICAL IMAGING: 9TH INTERNATIONAL WORKSHOP, MLMI 2018, 2018, 11046 :161-169
[4]   AnchorFormer: Point Cloud Completion from Discriminative Nodes [J].
Chen, Zhikai ;
Long, Fuchen ;
Qiu, Zhaofan ;
Yao, Ting ;
Zhou, Wengang ;
Luo, Jiebo ;
Mei, Tao .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :13581-13590
[5]   3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction [J].
Choy, Christopher B. ;
Xu, Danfei ;
Gwak, Jun Young ;
Chen, Kevin ;
Savarese, Silvio .
COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 :628-644
[6]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[7]   DcTr: Noise-robust point cloud completion by dual-channel transformer with cross-attention [J].
Fei, Ben ;
Yang, Weidong ;
Ma, Lipeng ;
Chen, Wen-Ming .
PATTERN RECOGNITION, 2023, 133
[8]   VAPCNet: Viewpoint-Aware 3D Point Cloud Completion [J].
Fu, Zhiheng ;
Wang, Longguang ;
Xu, Lian ;
Wang, Zhiyong ;
Laga, Hamid ;
Guo, Yulan ;
Boussaid, Farid ;
Bennamoun, Mohammed .
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, :12074-12084
[9]   Vision meets robotics: The KITTI dataset [J].
Geiger, A. ;
Lenz, P. ;
Stiller, C. ;
Urtasun, R. .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11) :1231-1237
[10]   Learning a Predictable and Generative Vector Representation for Objects [J].
Girdhar, Rohit ;
Fouhey, David F. ;
Rodriguez, Mikel ;
Gupta, Abhinav .
COMPUTER VISION - ECCV 2016, PT VI, 2016, 9910 :484-499