Wave-PCT: Wavelet point cloud transformer for point cloud quality assessment

被引:0
作者
Guo, Ziyou [1 ]
Huang, Zhen [2 ]
Gong, Wenyong [2 ]
Wu, Tieru [1 ]
机构
[1] Jilin Univ, Sch Artificial Intelligence, Changchun, Peoples R China
[2] Jinan Univ, Dept Math, Guangzhou, Peoples R China
关键词
No-reference quality assessment; Wavelets; Transformer; Point cloud;
D O I
10.1016/j.eswa.2024.125039
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Point cloud representation for real-world objects has seen a surge in interest recently, finding widespread applications in augmented reality, virtual reality, and autonomous driving. However, the process of acquiring, compressing, transmitting, and processing point cloud data often introduces unwanted distortions, highlighting the need for effective no-reference quality assessment methods for distorted point clouds. In this paper, we propose a Wavelet Point Cloud Transformer (Wave-PCT) method to assess the quality of point clouds without reference data. We start by performing patch sampling on a source point cloud, generating an extensive set of patches from the point cloud. These point cloud patches and their 2D projection images are processed using wavelets to produce multiscale local spectral features; moreover, we also extract global features of these patches using Pointnet++. Finally, a self-attention module is performed to fuse these local and global features, resulting in a distortion-sensitive quality score metric. We evaluate the Wave-PCT method on several point cloud quality assessment datasets using various metrics, and the experimental results indicate that the proposed framework exhibits outstanding and reliable performance when compared to various point cloud quality assessment methods.
引用
收藏
页数:9
相关论文
共 55 条
  • [1] Abdi H., 2007, ENCYCL MEASSTAT, V2, P508
  • [2] Alexiou E, 2020, IEEE INT CONF MULTI, DOI 10.1109/icmew46912.2020.9106005
  • [3] Alexiou E, 2018, IEEE INT CON MULTI
  • [4] Alexiou Evangelos, 2019, INT WORKSHOP QUALITY
  • [5] Genuage: visualize and analyze multidimensional single-molecule point cloud data in virtual reality
    Blanc, Thomas
    El Beheiry, Mohamed
    Caporal, Clement
    Masson, Jean-Baptiste
    Hajj, Bassam
    [J]. NATURE METHODS, 2020, 17 (11) : 1100 - +
  • [6] Rendering massive indoor point clouds in virtual reality
    Casado-Coscolla, Alvaro
    Sanchez-Belenguer, Carlos
    Wolfart, Erik
    Sequeira, Vitor
    [J]. VIRTUAL REALITY, 2023, 27 (03) : 1859 - 1874
  • [7] Metro:: Measuring error on simplified surfaces
    Cignoni, P
    Rocchini, C
    Scopigno, R
    [J]. COMPUTER GRAPHICS FORUM, 1998, 17 (02) : 167 - 174
  • [8] Diffusion wavelets
    Coifman, Ronald R.
    Maggioni, Mauro
    [J]. APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2006, 21 (01) : 53 - 94
  • [9] Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review
    Cui, Yaodong
    Chen, Ren
    Chu, Wenbo
    Chen, Long
    Tian, Daxin
    Li, Ying
    Cao, Dongpu
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (02) : 722 - 739
  • [10] Defferrard M, 2016, ADV NEUR IN, V29