Subjective QoE of 360-Degree Virtual Reality Videos and Machine Learning Predictions

被引:56
|
作者
Anwar, Muhammad Shahid [1 ]
Wang, Jing [1 ]
Khan, Wahab [1 ,2 ]
Ullah, Asad [3 ]
Ahmad, Sadique [4 ]
Fei, Zesong [1 ]
机构
[1] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[2] Univ Sci & Technol Bannu, Dept Elect Engn, Bannu 28100, Pakistan
[3] Riphah Int Univ, Fac Comp, Faisalabad 38000, Pakistan
[4] Iqra Univ, Fac Engn Sci & Technol, Karachi 75500, Pakistan
来源
IEEE ACCESS | 2020年 / 8卷 / 08期
关键词
Quality of experience; Videos; Predictive models; Solid modeling; Machine learning; Prediction algorithms; Rendering (computer graphics); Quality of Experience; 360-degree video; virtual reality; perceptual quality; machine learning; EXPERIENCE; QUALITY; NETWORK;
D O I
10.1109/ACCESS.2020.3015556
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
360-degree video provides an immersive experience to end-users through Virtual Reality (VR) Head-Mounted-Displays (HMDs). However, it is not trivial to understand the Quality of Experience (QoE) of 360-degree video since user experience is influenced by various factors that affect QoE when watching a 360-degree video in VR. This manuscript presents a machine learning-based QoE prediction of 360-degree video in VR, considering the two key QoE aspects: perceptual quality and cybersickness. In addition, we proposed two new QoE-affecting factors: user's familiarity with VR and user's interest in 360-degree video for the QoE evaluation. To aim this, we first conduct a subjective experiment on 96 video samples and collect datasets from 29 users for perceptual quality and cybersickness. We design a new Logistic Regression (LR) based model for QoE prediction in terms of perceptual quality. The prediction accuracy of the proposed model is compared against well-known supervised machine-learning algorithms such as k-Nearest Neighbors (kNN), Support Vector Machine (SVM), and Decision Tree (DT) with respect to accuracy rate, recall, f1-score, precision, and mean absolute error (MAE). LR performs well with 86% accuracy, which is in close agreement with subjective opinion. The prediction accuracy of the proposed model is then compared with existing QoE models in terms of perceptual quality. Finally, we build a Neural Network-based model for the QoE prediction in terms of cybersickness. The proposed model performs well against the state of the art QoE prediction methods in terms of cybersickness.
引用
收藏
页码:148084 / 148099
页数:16
相关论文
共 50 条
  • [1] Evaluating the Factors Affecting QoE of 360-Degree Videos and Cybersickness Levels Predictions in Virtual Reality
    Anwar, Muhammad Shahid
    Wang, Jing
    Ahmad, Sadique
    Ullah, Asad
    Khan, Wahab
    Fei, Zesong
    ELECTRONICS, 2020, 9 (09) : 1 - 20
  • [2] Impact of the Impairment in 360-Degree Videos on Users VR Involvement and Machine Learning-Based QoE Predictions
    Anwar, Muhammad Shahid
    Wang, Jing
    Ahmad, Sadique
    Khan, Wahab
    Ullah, Asad
    Shah, Mudassir
    Fei, Zesong
    IEEE ACCESS, 2020, 8 : 204585 - 204596
  • [3] Impact of the impairment in 360-degree videos on users VR involvement and machine learning-based QoE predictions
    Anwar, Muhammad Shahid
    Wang, Jing
    Ahmad, Sadique
    Khan, Wahab
    Ullah, Asad
    Shah, Mudassir
    Fei, Zesong
    IEEE Access, 2020, 8 : 204585 - 204596
  • [4] Enhancing Intercultural Competence with 360-Degree Virtual Reality Videos
    Song, Jayoung
    KOREAN LANGUAGE IN AMERICA, 2019, 23 (01): : 85 - 98
  • [5] Measuring quality of experience for 360-degree videos in virtual reality
    Muhammad Shahid Anwar
    Jing Wang
    Asad Ullah
    Wahab Khan
    Sadique Ahmad
    Zesong Fei
    Science China Information Sciences, 2020, 63
  • [6] Measuring quality of experience for 360-degree videos in virtual reality
    Anwar, Muhammad Shahid
    Wang, Jing
    Ullah, Asad
    Khan, Wahab
    Ahmad, Sadique
    Fei, Zesong
    SCIENCE CHINA-INFORMATION SCIENCES, 2020, 63 (10)
  • [7] Measuring quality of experience for 360-degree videos in virtual reality
    Muhammad Shahid ANWAR
    Jing WANG
    Asad ULLAH
    Wahab KHAN
    Sadique AHMAD
    Zesong FEI
    Science China(Information Sciences), 2020, 63 (10) : 108 - 122
  • [8] Investigating learning outcomes and subjective experiences in 360-degree videos
    Rupp, Michael A.
    Odette, Katy L.
    Kozachuk, James
    Michaelis, Jessica R.
    Smither, Janan A.
    McConnell, Daniel S.
    COMPUTERS & EDUCATION, 2019, 128 : 256 - 268
  • [9] 360-Degree Virtual Reality Videos in EFL Teaching: Student Experiences
    Huang, Hui-Wen
    Huang, Kai
    Liu, Huilin
    Dusza, Daniel G.
    ADVANCED INTELLIGENT VIRTUAL REALITY TECHNOLOGIES, AIVR 2022, 2023, 330 : 131 - 143
  • [10] Trajectory-Based Viewport Prediction for 360-Degree Virtual Reality Videos
    Petrangeli, Stefano
    Simon, Gwendal
    Swaminathan, Viswanathan
    2018 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR), 2018, : 157 - 160