Global and Uniform Point Cloud Completion With Density-Sensitive Transformer for Small-Scale 3-D Object Reconstruction

被引:2
作者
Sun, Junhua [1 ]
Guo, Rong [1 ]
Zhang, Jie [2 ]
机构
[1] Beihang Univ, Sch Instrumentat & Optoelect Engn, Beijing 100191, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Key Lab Knowledge Automat Ind Proc, Minist Educ, Beijing 100083, Peoples R China
关键词
Point cloud compression; Transformers; Generators; Decoding; Feature extraction; Encoding; Data models; Aero-engine; component inspection; density uniformity; global structure; point cloud completion; transformer;
D O I
10.1109/TII.2024.3393565
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Incompleteness and irregularity are inherent challenges in 3-D point clouds, which hinder point-cloud-based 3-D object or scene understanding, especially for complicated industrial scenarios. Previous point cloud completion methods typically suffer from the nonuniform density of the restored point cloud. In this article, we proposed a global and uniform point cloud completion algorithm via a density-sensitive transformer for reconstructing complete and fine-grained 3-D small-scale industrial components. We first designed a position and feature encoding module to aggregate discriminative point cloud features. Then, we constructed a density-sensitive transformer structure with a coarse point cloud generator that allowed for recovering the global structure and uniform local details of the 3-D object. The experimental results on a real-world industrial component dataset and a public multiobject dataset demonstrated that our method achieved state-of-the-art performance with the former CD-l1 of 8.17 x 10(-3), avg-NUC of 0.61 and the latter CD-l1 of 5.33 x 10(-3), avg-NUC of 0.74. Our method better balanced the global point cloud integrity and density uniformity in a coarse-to-fine pipeline, which benefited high-quality 3-D object reconstruction. The method has been applied to practical aero-engine component reconstruction in the real-world scenario.
引用
收藏
页码:10499 / 10509
页数:11
相关论文
共 29 条
[1]  
Chang Angel X, 2015, Technical Report
[2]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[3]   Vision meets robotics: The KITTI dataset [J].
Geiger, A. ;
Lenz, P. ;
Stiller, C. ;
Urtasun, R. .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11) :1231-1237
[4]   PCT: Point cloud transformer [J].
Guo, Meng-Hao ;
Cai, Jun-Xiong ;
Liu, Zheng-Ning ;
Mu, Tai-Jiang ;
Martin, Ralph R. ;
Hu, Shi-Min .
COMPUTATIONAL VISUAL MEDIA, 2021, 7 (02) :187-199
[5]   Context-Based Coherent Surface Completion [J].
Harary, Gur ;
Tal, Ayellet ;
Grinspun, Eitan .
ACM TRANSACTIONS ON GRAPHICS, 2014, 33 (01)
[6]   Shape Completion from a Single RGBD Image [J].
Li, Dongping ;
Shao, Tianjia ;
Wu, Hongzhi ;
Zhou, Kun .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2017, 23 (07) :1809-1822
[7]   ProxyFormer: Proxy Alignment Assisted Point Cloud Completion with Missing Part Sensitive Transformer [J].
Li, Shanshan ;
Gao, Pan ;
Tan, Xiaoyang ;
Wei, Mingqiang .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :9466-9475
[8]   Deformable Shape Completion with Graph Convolutional Autoencoders [J].
Litany, Or ;
Bronstein, Alex ;
Bronstein, Michael ;
Makadia, Ameesh .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1886-1895
[9]   Variational Relational Point Completion Network [J].
Pan, Liang ;
Chen, Xinyi ;
Cai, Zhongang ;
Zhang, Junzhe ;
Zhao, Haiyu ;
Yi, Shuai ;
Liu, Ziwei .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8520-8529
[10]   Learning quadrangulated patches for 3D shape parameterization and completion [J].
Sarkar, Kripasindhu ;
Varanasi, Kiran ;
Stricker, Didier .
PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2017, :383-392