Point Cloud Quality Assessment: Dataset Construction and Learning-based No-reference Metric

被引:39
作者
Liu, Yipeng [1 ]
Yang, Qi [1 ]
Xu, Yiling [1 ]
Yang, Le [2 ]
机构
[1] Shanghai Jiao Tong Univ, Cooperat Medianet Innovat Ctr, Dongchuan Rd 800, Shanghai, Peoples R China
[2] Univ Canterbury, Dept Elect & Comp Engn, Christchurch 8041, New Zealand
基金
中国国家自然科学基金;
关键词
Blind quality assessment; point cloud; large-scale dataset; sparse convolution; learning-based metric; IMAGE; HISTOGRAMS; ERROR;
D O I
10.1145/3550274
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Full-reference (FR) point cloud quality assessment (PCQA) has achieved impressive progress in recent years. However, in many cases, obtaining the reference point clouds is difficult, so no-reference (NR) metrics have become a research hotspot. Few researches about NR-PCQA are carried out due to the lack of a large-scale PCQA dataset. In this article, we first build a large-scale PCQA dataset named LS-PCQA, which includes 104 reference point clouds and more than 22,000 distorted samples. In the dataset, each reference point cloud is augmented with 31 types of impairments (e.g., Gaussian noise, contrast distortion, local missing, and compression loss) at 7 distortion levels. Besides, each distorted point cloud is assigned with a pseudo-quality score as its substitute of Mean Opinion Score. Inspired by the hierarchical perception system and considering the intrinsic attributes of point clouds, we propose a NR metric ResSCNN based on sparse convolutional neural network (CNN) to accurately estimate the subjective quality of point clouds. We conduct several experiments to evaluate the performance of the proposed NR metric. The results demonstrate that ResSCNN exhibits the state-of-the-art performance among all the existing NR-PCQA metrics and even outperforms some FR metrics. The dataset presented in this work will be made publicly accessible at http://smt.sjtu.edu.cn. The source code for the proposed ResSCNN can be found at https://github.com/lyp22/ResSCNN.
引用
收藏
页数:26
相关论文
共 73 条
  • [1] PointXR: A toolbox for visualization and subjective evaluation of point clouds in virtual reality
    Alexiou, Evangelos
    Yang, Nanyang
    Ebrahimi, Touradj
    [J]. 2020 TWELFTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2020,
  • [2] Alexiou E, 2020, IEEE INT CONF MULTI, DOI 10.1109/icmew46912.2020.9106005
  • [3] Alexiou E, 2018, IEEE INT CON MULTI
  • [4] [Anonymous], Image Video Quality Assessment at LIVELaboratory for Image Video Engineering
  • [5] [Anonymous], MPEG STATIC OBJECT S
  • [6] MULTI-HIERARCHICAL INDEPENDENT CORRELATION FILTERS FOR VISUAL TRACKING
    Bai, Shuai
    He, Zhiqun
    Dong, Yuan
    Bai, Hongliang
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [7] Boyat K., 2015, Signal Image Process. Int. J., V6, P53, DOI [10.5121/sipij.2015.6205, DOI 10.5121/SIPIJ.2015.6205]
  • [8] 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks
    Choy, Christopher
    Gwak, JunYoung
    Savarese, Silvio
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3070 - 3079
  • [9] Metro:: Measuring error on simplified surfaces
    Cignoni, P
    Rocchini, C
    Scopigno, R
    [J]. COMPUTER GRAPHICS FORUM, 1998, 17 (02) : 167 - 174
  • [10] Deformation-Based 3D Facial Expression Representation
    Demisse, Girum G.
    Aouada, Djamila
    Ottersten, Bjorn
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2018, 14 (01)