Point Cloud Quality Assessment: Dataset Construction and Learning-based No-reference Metric

被引:39
|
作者
Liu, Yipeng [1 ]
Yang, Qi [1 ]
Xu, Yiling [1 ]
Yang, Le [2 ]
机构
[1] Shanghai Jiao Tong Univ, Cooperat Medianet Innovat Ctr, Dongchuan Rd 800, Shanghai, Peoples R China
[2] Univ Canterbury, Dept Elect & Comp Engn, Christchurch 8041, New Zealand
基金
中国国家自然科学基金;
关键词
Blind quality assessment; point cloud; large-scale dataset; sparse convolution; learning-based metric; IMAGE; HISTOGRAMS; ERROR;
D O I
10.1145/3550274
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Full-reference (FR) point cloud quality assessment (PCQA) has achieved impressive progress in recent years. However, in many cases, obtaining the reference point clouds is difficult, so no-reference (NR) metrics have become a research hotspot. Few researches about NR-PCQA are carried out due to the lack of a large-scale PCQA dataset. In this article, we first build a large-scale PCQA dataset named LS-PCQA, which includes 104 reference point clouds and more than 22,000 distorted samples. In the dataset, each reference point cloud is augmented with 31 types of impairments (e.g., Gaussian noise, contrast distortion, local missing, and compression loss) at 7 distortion levels. Besides, each distorted point cloud is assigned with a pseudo-quality score as its substitute of Mean Opinion Score. Inspired by the hierarchical perception system and considering the intrinsic attributes of point clouds, we propose a NR metric ResSCNN based on sparse convolutional neural network (CNN) to accurately estimate the subjective quality of point clouds. We conduct several experiments to evaluate the performance of the proposed NR metric. The results demonstrate that ResSCNN exhibits the state-of-the-art performance among all the existing NR-PCQA metrics and even outperforms some FR metrics. The dataset presented in this work will be made publicly accessible at http://smt.sjtu.edu.cn. The source code for the proposed ResSCNN can be found at https://github.com/lyp22/ResSCNN.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] A No-reference Quality Assessment Metric for Point Cloud Based on Captured Video Sequences
    Fan, Yu
    Zhang, Zicheng
    Sun, Wei
    Min, Xiongkuo
    Liu, Ning
    Zhou, Quan
    He, Jun
    Wang, Qiyuan
    Zhai, Guangtao
    2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2022,
  • [2] No-Reference Learning-Based and Human Visual-Based Image Quality Assessment Metric
    Charrier, Christophe
    Saadane, Abdelhakim
    Fernandez-Maloigne, Christine
    IMAGE ANALYSIS AND PROCESSING (ICIAP 2017), PT II, 2017, 10485 : 245 - 257
  • [3] A No-Reference Video Quality Assessment Metric Based On ROI
    Jia, Lixiu
    Zhong, Xuefei
    Tu, Yan
    Niu, Wenjuan
    IMAGE QUALITY AND SYSTEM PERFORMANCE XII, 2015, 9396
  • [4] Evaluation of point cloud features for no-reference visual quality assessment
    Smitskamp, Gwennan
    Viola, Irene
    Cesar, Pablo
    2023 15TH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE, QOMEX, 2023, : 147 - 152
  • [5] No-Reference Point Cloud Quality Assessment via Domain Adaptation
    Yang, Qi
    Liu, Yipeng
    Chen, Siheng
    Xu, Yiling
    Sun, Jun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 21147 - 21156
  • [6] Learning no-reference quality metric by examples
    Tong, HH
    Li, MJ
    Zhang, HJ
    Zhang, CS
    He, JR
    Ma, WY
    11TH INTERNATIONAL MULTIMEDIA MODELLING CONFERENCE, PROCEEDINGS, 2005, : 247 - 254
  • [7] No-Reference Point Cloud Quality Assessment Through Structure Sampling and Clustering Based on Graph
    Wu, Xinqiang
    He, Zhouyan
    Jiang, Gangyi
    Yu, Mei
    Song, Yang
    Luo, Ting
    IEEE TRANSACTIONS ON BROADCASTING, 2025, 71 (01) : 307 - 322
  • [8] A Deep Learning-Based No-Reference Quality Metric for High-Definition Images Compressed With HEVC
    Xiang, Jie
    Tohidypour, Hamid Reza
    Wang, Yixiao
    Nasiopoulos, Panos
    Pourazad, Mahsa T.
    IEEE TRANSACTIONS ON BROADCASTING, 2023, 69 (03) : 779 - 789
  • [9] MM-PCQA: Multi-Modal Learning for No-reference Point Cloud Quality Assessment
    Zhang, Zicheng
    Sun, Wei
    Min, Xiongkuo
    Wang, Qiyuan
    He, Jun
    Zhou, Quan
    Zhai, Guangtao
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 1759 - 1767
  • [10] Dynamic Hypergraph Convolutional Network for No-Reference Point Cloud Quality Assessment
    Chen, Wu
    Jiang, Qiuping
    Zhou, Wei
    Xu, Long
    Lin, Weisi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) : 10479 - 10493