Outdoor large-scene 3D point cloud reconstruction based on transformer

被引:1
作者
Tang, Fangzhou [1 ]
Zhang, Shuting [1 ]
Zhu, Bocheng [1 ]
Sun, Junren [1 ,2 ]
机构
[1] Peking Univ, Sch Elect, Beijing, Peoples R China
[2] China Univ Min & Technol Beijing, Sch Artificial Intelligence, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
LiDAR; point cloud; transformer; reconstruction; autonomous driving; SUPERRESOLUTION; INTERPOLATION;
D O I
10.3389/fphy.2024.1474797
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
3D point clouds collected by low-channel light detection and ranging (LiDAR) are relatively sparse compared to high-channel LiDAR, which is considered costly. To address this, an outdoor large-scene point cloud reconstruction (LSPCR) technique based on transformer is proposed in this study. The LSPCR approach first projects the original sparse 3D point cloud onto a 2D range image; then, it enhances the resolution in the vertical direction of the 2D range image before converting the high-resolution range image back to a 3D point cloud as the final reconstructed point cloud data. Experiments were performed on the real-world KITTI dataset, and the results show that LSPCR achieves an average accuracy improvement of over 60% compared to non-deep-learning algorithms; it also achieves better performance compared to the latest deep-learning algorithms. Therefore, LSPCR is an effective solution for sparse point cloud reconstruction and addresses the challenges associated with high-resolution LiDAR point clouds.
引用
收藏
页数:8
相关论文
共 50 条
[21]   Radial Transformer for Large-Scale Outdoor LiDAR Point Cloud Semantic Segmentation [J].
He, Xiang ;
Li, Xu ;
Ni, Peizhou ;
Xu, Wang ;
Xu, Qimin ;
Liu, Xixiang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
[22]   FAT: FIELD-AWARE TRANSFORMER FOR 3D POINT CLOUD SEMANTIC SEGMENTATION [J].
Zhou, Junjie ;
Xiong, Yongping ;
Chiu, Chinwai ;
Liu, Fangyu ;
Gong, Xiangyang .
2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, :660-664
[23]   Campus3D: A Photogrammetry Point Cloud Benchmark for Hierarchical Understanding of Outdoor Scene [J].
Li, Xinke ;
Li, Chongshou ;
Tong, Zekun ;
Lim, Andrew ;
Yuan, Junsong ;
Wu, Yuwei ;
Tang, Jing ;
Huang, Raymond .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :238-246
[24]   Multiview 3D Sensing and Analysis for High Quality Point Cloud Reconstruction [J].
Satnik, Andrej ;
Izquierdo, Ebroul ;
Orjesek, Richard .
TENTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2017), 2018, 10696
[25]   Multiview 3D Reconstruction and Human Point Cloud Classification [J].
Nasab, Sarah Ershadi ;
Kasaei, Shohreh ;
Sanaei, Esmaeil ;
Ossia, Ali ;
Mobini, Majid .
2014 22ND IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE), 2014, :1119-1124
[26]   Local Transformer Network on 3D Point Cloud Semantic Segmentation [J].
Wang, Zijun ;
Wang, Yun ;
An, Lifeng ;
Liu, Jian ;
Liu, Haiyang .
INFORMATION, 2022, 13 (04)
[27]   Transformer Enhanced Hierarchical 3D Point Cloud Semantic Segmentation [J].
Liu, Yaohua ;
Ma, Yue ;
Xu, Min .
2ND INTERNATIONAL CONFERENCE ON APPLIED MATHEMATICS, MODELLING, AND INTELLIGENT COMPUTING (CAMMIC 2022), 2022, 12259
[28]   Towards 3D LiDAR-based semantic scene understanding of 3D point cloud sequences: The SemanticKITTI Dataset [J].
Behley, Jens ;
Garbade, Martin ;
Milioto, Andres ;
Quenzel, Jan ;
Behnke, Sven ;
Gall, Juergen ;
Stachniss, Cyrill .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2021, 40 (8-9) :959-967
[29]   KPTr: Key point transformer for LiDAR-based 3D object detection [J].
Cao, Jie ;
Peng, Yiqiang ;
Wei, Hongqian ;
Mo, Lingfan ;
Fan, Likang ;
Wang, Longfei .
MEASUREMENT, 2025, 242
[30]   Point-voxel dual stream transformer for 3d point cloud learning [J].
Zhao, Tianmeng ;
Zeng, Hui ;
Zhang, Baoqing ;
Fan, Bin ;
Li, Chen .
VISUAL COMPUTER, 2024, 40 (08) :5323-5339