A Novel GAN-Based Point Cloud Completion Network for 3D Object Enhancement

被引:0
作者
Peng, Kun [1 ]
Li, Shanke [1 ]
Hui, Fei [2 ]
Mu, Ke-nan [2 ]
机构
[1] Changan Univ, Sch Informat Engn, Xian 710064, Peoples R China
[2] Changan Univ, Sch Elect & Control Engn, Xian 710064, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Feature extraction; Training; Three-dimensional displays; Shape; Generators; Robustness; Predictive models; Interpolation; Computational efficiency; Point cloud completion; generative adversarial network; self-attention; VISION;
D O I
10.1109/LSP.2025.3577120
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Three-dimensional (3D) point clouds are essential for representing traffic scenes in autonomous driving, yet incompletion often occurs due to sensor angle limitations and signal occlusions. Point cloud completion focuses on generating the missing parts of incomplete point cloud shapes, but still shows limitations in preserving and restoring the details of the shapes. To address these challenges, we propose a novel point cloud completion method, termed PCC-GAN, which leverages an improved generative adversarial network to predict and correct missing portions of point clouds. The proposed architecture features two primary components: a generator and a discriminator. The generator includes a feature extension module that uses local feature interpolation to learn and refine the input point cloud features, thereby enhancing learning efficiency. Meanwhile, the discriminator employs a self-attention mechanism to capture long-range dependencies and extract detailed contextual information, allowing it to evaluate the local accuracy of the generated features effectively. The performance of the PCC-GAN model is assessed using public datasets, and its robustness is tested across point cloud sets with varying levels of missing proportion. Results indicate that PCC-GAN significantly improves the shape reconstruction of lidar point clouds, demonstrating strong predictive capabilities and robustness.
引用
收藏
页码:2499 / 2503
页数:5
相关论文
共 38 条
[1]   Learning 3D Shape Latent for Point Cloud Completion [J].
Chen, Zhikai ;
Long, Fuchen ;
Qiu, Zhaofan ;
Yao, Ting ;
Zhou, Wengang ;
Luo, Jiebo ;
Mei, Tao .
IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 :8717-8729
[2]   Adaptive Nonrigid Inpainting of Three-Dimensional Point Cloud Geometry [J].
Dinesh, Chinthaka ;
Bajic, Ivan, V ;
Cheung, Gene .
IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (06) :878-882
[3]   Symmetry-based 3D shape completion for fruit localisation for harvesting robots [J].
Ge, Yuanyue ;
Xiong, Ya ;
From, Pal J. .
BIOSYSTEMS ENGINEERING, 2020, 197 :188-202
[4]   Vision meets robotics: The KITTI dataset [J].
Geiger, A. ;
Lenz, P. ;
Stiller, C. ;
Urtasun, R. .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11) :1231-1237
[5]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[6]   Live Semantic 3D Perception for Immersive Augmented Reality [J].
Han, Lei ;
Zheng, Tian ;
Zhu, Yinheng ;
Xu, Lan ;
Fang, Lu .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (05) :2012-2022
[7]   Render4Completion: Synthesizing Multi-View Depth Maps for 3D Shape Completion [J].
Hu, Tao ;
Han, Zhizhong ;
Shrivastava, Abhinav ;
Zwicker, Matthias .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :4114-4122
[8]   PF-Net: Point Fractal Network for 3D Point Cloud Completion [J].
Huang, Zitian ;
Yu, Yikuan ;
Xu, Jiawen ;
Ni, Feng ;
Le, Xinyi .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :7659-7667
[9]  
Kazhdan Michael, 2006, P 4 EUR S GEOM PROC, V7, P2, DOI DOI 10.5555/1281957.1281965
[10]   Euler spiral for shape completion [J].
Kimia, BB ;
Frankel, I ;
Popescu, AM .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2003, 54 (1-2) :157-180