Jointly learning perceptually heterogeneous features for blind 3D video quality assessment

被引:10
作者
Wang, Yongfang [1 ,2 ]
Shuai, Yuan [1 ]
Zhu, Yun [1 ]
Zhang, Jian [3 ]
An, Ping [1 ,2 ]
机构
[1] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[3] Univ Technol Sydney, Global Big Data Technol Ctr, Sydney, NSW 2007, Australia
关键词
Blind quality metric; Binocular spatio-temporal internal generative mechanism; Multi-channel natural video statistics; AdaBoosting radial basis function (RBF) neural network; SIMILARITY; IMAGES;
D O I
10.1016/j.neucom.2018.12.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D videos quality assessment (3D-VQA) is essential to various 3D video processing applications. However, it has not been well investigated on how to make use of perceptual multi-channel video information to improve 3D-VQA under different distortion categories and degrees, especially under asymmetrical distortions. In the paper, we propose a new blind 3D-VQA metric by jointly learning perceptually heterogeneous features. Firstly, a binocular spatio-temporal internal generative mechanism (BST-IGM) is proposed to decompose the views of 3D video into multi-channel videos. Then, we extract perceptually heterogeneous features by proposed multi-channel natural video statistics (MNVS) model, which are characterized 3D video information. Furthermore, a robust AdaBoosting Radial Basis Function (RBF) neural network is utilized to map the features to the overall quality of 3D video. On two benchmark databases, the extensive evaluations demonstrate that the proposed algorithm significantly outperforms several state-of-the-art quality metrics in term of prediction accuracy and robustness. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:298 / 304
页数:7
相关论文
共 32 条
  • [1] Appina B, 2017, INT CONF ACOUST SPEE, P2012, DOI 10.1109/ICASSP.2017.7952509
  • [2] Chang Y. I., 2003, TECHNICAL REPORT, P75
  • [3] Full-reference quality assessment of stereopairs accounting for rivalry
    Chen, Ming-Jun
    Su, Che-Chun
    Kwon, Do-Kyoung
    Cormack, Lawrence K.
    Bovik, Alan C.
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2013, 28 (09) : 1143 - 1155
  • [4] The free-energy principle: a unified brain theory?
    Friston, Karl J.
    [J]. NATURE REVIEWS NEUROSCIENCE, 2010, 11 (02) : 127 - 138
  • [5] Stereoscopic Video Quality Assessment Using Binocular Energy
    Galkandage, Chathura
    Calic, Janko
    Dogan, Safak
    Guillemaut, Jean-Yves
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2017, 11 (01) : 102 - 112
  • [6] Hasan M, 2014, P ASE BIG DATA SOCIA, P27
  • [7] An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks
    Huang, GB
    Saratchandran, P
    Sundararajan, N
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (06): : 2284 - 2292
  • [8] No-Reference Quality Assessment for Multiply-Distorted Images in Gradient Domain
    Li, Qiaohong
    Lin, Weisi
    Fang, Yuming
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2016, 23 (04) : 541 - 545
  • [9] No-reference stereopair quality assessment based on singular value decomposition
    Liu, Lixiong
    Yang, Bing
    Huang, Hua
    [J]. NEUROCOMPUTING, 2018, 275 : 1823 - 1835
  • [10] Blind image quality assessment by relative gradient statistics and adaboosting neural network
    Liu, Lixiong
    Hua, Yi
    Zhao, Qingjie
    Huang, Hua
    Bovik, Alan Conrad
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2016, 40 : 1 - 15