VIRTUAL REALITY VIDEO QUALITY ASSESSMENT BASED ON 3D CONVOLUTIONAL NEURAL NETWORKS

被引:0
|
作者
Wu, Pei [1 ]
Ding, Wenxin [1 ]
You, Zhixiang [1 ]
An, Ping [1 ]
机构
[1] Shanghai Univ, Minist Educ, Key Lab Adv Display & Syst Applicat, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Virtual Reality (VR); panoramic video; Video Quality Assessment (VQA); 3D Convolutional Neural Network;
D O I
10.1109/icip.2019.8803023
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
As a new medium, Virtual Reality (VR) has attracted widespread attentions and research interests. More and more researchers have built their VR image/video database and devise related algorithms. However, the existing methods of VR video quality assessment are not very effective, and one of the most important reasons is that the database is not suitable. To this end, this paper proposes an efficient VR quality assessment method on self-built database. Firstly, we establish a VR video quality assessment database with subjective scores, and add the projection format to the production of the database. Secondly, the database is proved to be valid by using some traditional image quality assessment metrics. Lastly, we design a 3D convolutional neural network to predict the VR video quality without reference VR video. Meanwhile, taking the pre-processed VR video patches as input, different quality score strategy is applied to get the final score. The experimental results surface that the network we designed has good results, and the performance is improved after the weight calculation combined with the projection format.
引用
收藏
页码:3187 / 3191
页数:5
相关论文
共 50 条
  • [1] 3D Panoramic Virtual Reality Video Quality Assessment Based on 3D Convolutional Neural Networks
    Yang, Jiachen
    Liu, Tianlin
    Jiang, Bin
    Song, Houbing
    Lu, Wen
    IEEE ACCESS, 2018, 6 : 38669 - 38682
  • [2] Stereoscopic video quality assessment based on 3D convolutional neural networks
    Yang, Jiachen
    Zhu, Yinghao
    Ma, Chaofan
    Lu, Wen
    Meng, Qinggang
    NEUROCOMPUTING, 2018, 309 : 83 - 93
  • [3] No-Reference Video Quality Assessment With 3D Shearlet Transform and Convolutional Neural Networks
    Li, Yuming
    Po, Lai-Man
    Cheung, Chun-Ho
    Xu, Xuyuan
    Feng, Litong
    Yuan, Fang
    Cheung, Kwok-Wai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (06) : 1044 - 1057
  • [4] Video-based surgical skill assessment using 3D convolutional neural networks
    Isabel Funke
    Sören Torge Mees
    Jürgen Weitz
    Stefanie Speidel
    International Journal of Computer Assisted Radiology and Surgery, 2019, 14 : 1217 - 1225
  • [5] Full-Reference Video Quality Assessment Using Deep 3D Convolutional Neural Networks
    Dendi, Sathya Veera Reddy
    Krishnappa, Gokul
    Channappayya, Sumohana S.
    2019 25TH NATIONAL CONFERENCE ON COMMUNICATIONS (NCC), 2019,
  • [6] Video Steganography Using 3D Convolutional Neural Networks
    Abdolmohammadi, Mahdi
    Toroghi, Rahil Mahdian
    Bastanfard, Azam
    PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2020, 1144 : 149 - 161
  • [7] 3D Video-based Motion Capture using Convolutional Neural Networks
    ShangGuan, Huyuan
    Mukundan, Ramakrishnan
    2017 INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ), 2017,
  • [8] Protein model quality assessment using 3D oriented convolutional neural networks
    Pages, Guillaume
    Charmettant, Benoit
    Grudinin, Sergei
    BIOINFORMATICS, 2019, 35 (18) : 3313 - 3319
  • [9] Violence Detection in Video by Using 3D Convolutional Neural Networks
    Ding, Chunhui
    Fan, Shouke
    Zhu, Ming
    Feng, Weiguo
    Jia, Baozhi
    ADVANCES IN VISUAL COMPUTING (ISVC 2014), PT II, 2014, 8888 : 551 - 558
  • [10] Subjective and Objective Quality Assessment of 2D and 3D Foveated Video Compression in Virtual Reality
    Jin, Yize
    Chen, Meixu
    Goodall, Todd
    Patney, Anjul
    Bovik, Alan C.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 (30) : 5905 - 5919