DEMI: Deep Video Quality Estimation Model using Perceptual Video Quality Dimensions

被引:0
作者
Zadtootaghaj, Saman [1 ]
Barman, Nabajeet [2 ]
Rao, Rakesh Rao Ramachandra [3 ]
Goering, Steve [3 ]
Martini, Maria G. [2 ]
Raake, Alexander [3 ]
Moeller, Sebastian [1 ,4 ]
机构
[1] TU Berlin, Qual & Usabil Lab, Berlin, Germany
[2] Kingston Univ, London, England
[3] Tech Univ Ilmenau, Ilmenau, Germany
[4] DFKI Projektbiiro Berlin, Berlin, Germany
来源
2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP) | 2020年
基金
欧盟地平线“2020”;
关键词
Quality of Experience; Video Quality Estimation; Quality Models; Deep Learning; Gaming Video Streaming;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Existing works in the field of quality assessment focus separately on gaming and non-gaming content. Along with the traditional modeling approaches, deep learning based approaches have been used to develop quality models, due to their high prediction accuracy. In this paper, we present a deep learning based quality estimation model considering both gaming and non-gaming videos. The model is developed in three phases. First, a convolutional neural network (CNN) is trained based on an objective metric which allows the CNN to learn video artifacts such as blurriness and blockiness. Next, the model is fine-tuned based on a small image quality dataset using blockiness and blurriness ratings. Finally, a Random Forest is used to pool frame-level predictions and temporal information of videos in order to predict the overall video quality. The light-weight, low complexity nature of the model makes it suitable for real-time applications considering both gaming and non-gaming content while achieving similar performance to existing state-of-the-art model NDNetGaming. The model implementation for testing is available on GitHub(1).
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Video quality assessment using generative adversarial network
    Voronin, V.
    Franc, V
    Zelensky, A.
    Agaian, S.
    MOBILE MULTIMEDIA/IMAGE PROCESSING, SECURITY, AND APPLICATIONS 2019, 2019, 10993
  • [42] Video Quality of Experience Metric for Dynamic Adaptive Streaming Services Using DASH Standard and Deep Spatial-Temporal Representation of Video
    Du, Lina
    Zhuo, Li
    Li, Jiafeng
    Zhang, Jing
    Li, Xioguang
    Zhang, Hui
    APPLIED SCIENCES-BASEL, 2020, 10 (05):
  • [43] Video Quality Estimation for Packet Loss Based on No-Reference Method
    Han, Junghyun
    Kim, Yo-han
    Jeong, Jangkeun
    Shin, Jitae
    12TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY: ICT FOR GREEN GROWTH AND SUSTAINABLE DEVELOPMENT, VOLS 1 AND 2, 2010, : 418 - 421
  • [44] FULL REFERENCE VIDEO QUALITY ESTIMATION FOR VIDEOS WITH DIFFERENT SPATIAL RESOLUTIONS
    Demirtas, A. Murat
    Reibman, Amy R.
    Jafarkhani, Hamid
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 1997 - 2001
  • [45] Deep learning-Based Quality Enhancement Algorithms for Background of Video
    Kobayashi, Kei
    Katayama, Takafumi
    Song, Tian
    Shimamoto, Takashi
    2022 37TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2022), 2022, : 353 - 356
  • [46] Using Deep Perceptual Embeddings as a Quality Metric for Synthetic Imagery
    Luer, William
    Harguess, Josh
    GEOSPATIAL INFORMATICS XI, 2021, 11733
  • [47] A Hybrid Contextual User Perception Model for Streamed Video Quality
    Diallo, Mamadou Tourad
    Marechal, Nicolas
    Afifi, Hossam
    2013 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2013, : 518 - 519
  • [48] Video-Quality Estimation Based on Reduced-Reference Model Employing Activity-Difference
    Yamada, Toru
    Miyamoto, Yoshihiro
    Senda, Yuzo
    Serizawa, Masahiro
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2009, E92A (12) : 3284 - 3290
  • [49] Learning a perceptual manifold with deep features for animation video resequencing
    Charles C. Morace
    Thi-Ngoc-Hanh Le
    Sheng-Yi Yao
    Shang-Wei Zhang
    Tong-Yee Lee
    Multimedia Tools and Applications, 2022, 81 : 23687 - 23707
  • [50] Research on perceptual fusion of audio and video based on deep learning
    An, Qing
    Chen, Yanhua
    Wu, Shusen
    2020 INTERNATIONAL CONFERENCE ON IMAGE, VIDEO PROCESSING AND ARTIFICIAL INTELLIGENCE, 2020, 11584