Diffusion Transformer for point cloud registration: digital modeling of cultural heritage

被引:0
作者
An, Li [1 ]
Zhou, Pengbo [2 ]
Zhou, Mingquan [1 ]
Wang, Yong [1 ]
Geng, Guohua [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian 710127, Peoples R China
[2] Beijing Normal Univ, Sch Arts & Commun, Beijing 100875, Peoples R China
来源
HERITAGE SCIENCE | 2024年 / 12卷 / 01期
关键词
Point cloud registration; Diffusion transformer; Cultural heritage; Digital modeling; BINARY SHAPE CONTEXT;
D O I
10.1186/s40494-024-01314-1
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
Digital modeling is an essential means for preserving and passing down historical culture within cultural heritage. Point cloud registration technology, by aligning point cloud data captured from multiple perspectives, enhances the accuracy of reconstructing the complex structures of artifacts and buildings and provides a reliable digital foundation for their protection, exhibition, and research. Due to the challenges posed by complex morphology, noise, and missing data when processing cultural heritage data, this paper proposes a point cloud registration method based on the Diffusion Transformer (PointDT). Compared to traditional methods, the Diffusion Transformer can better capture both the global features and local structures of point cloud data, more accurately capturing the geometric and semantic information of the target point cloud, thereby achieving precise digital reconstruction. In this study, we trained our method using indoor datasets such as 3DMatch and large-scale outdoor datasets like KITTI, and validated it on various cultural heritage datasets, including those of the Terracotta Warriors and heritage buildings. The results demonstrate that this method not only significantly improves accuracy but also shows advantages in computational efficiency.
引用
收藏
页数:12
相关论文
共 38 条
[1]   BUFFER: Balancing Accuracy, Efficiency, and Generalizability in Point Cloud Registration [J].
Ao, Sheng ;
Hu, Qingyong ;
Wang, Hanyun ;
Xu, Kai ;
Guo, Yulan .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :1255-1264
[2]   D3Feat: Joint Learning of Dense Detection and Description of 3D Local Features [J].
Bai, Xuyang ;
Luo, Zixin ;
Zhou, Lei ;
Fu, Hongbo ;
Quan, Long ;
Tai, Chiew-Lan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :6358-6366
[3]  
BESL PJ, 1992, P SOC PHOTO-OPT INS, V1611, P586, DOI 10.1117/12.57955
[4]   SharpGConv: A Novel Graph Method With Plug-and-Play Sharpening Convolution for Point Cloud Registration [J].
Cao, Feilong ;
Wang, Lingpeng ;
Ye, Hailiang .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) :7095-7105
[5]   Deep Global Registration [J].
Choy, Christopher ;
Dong, Wei ;
Koltun, Vladlen .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2511-2520
[6]   Fully Convolutional Geometric Features [J].
Choy, Christopher ;
Park, Jaesik ;
Koltun, Vladlen .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8957-8965
[8]   PPF-FoldNet: Unsupervised Learning of Rotation Invariant 3D Local Descriptors [J].
Deng, Haowen ;
Birdal, Tolga ;
Ilic, Slobodan .
COMPUTER VISION - ECCV 2018, PT V, 2018, 11209 :620-638
[9]   PPFNet: Global Context Aware Local Features for Robust 3D Point Matching [J].
Deng, Haowen ;
Birdal, Tolga ;
Ilie, Slobodan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :195-205
[10]   Registration of large-scale terrestrial laser scanner point clouds: A review and benchmark [J].
Dong, Zhen ;
Liang, Fuxun ;
Yang, Bisheng ;
Xu, Yusheng ;
Zang, Yufu ;
Li, Jianping ;
Wang, Yuan ;
Dai, Wenxia ;
Fan, Hongchao ;
Hyyppa, Juha ;
Stilla, Uwe .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 163 :327-342