DEMI: Deep Video Quality Estimation Model using Perceptual Video Quality Dimensions

被引:0
|
作者
Zadtootaghaj, Saman [1 ]
Barman, Nabajeet [2 ]
Rao, Rakesh Rao Ramachandra [3 ]
Goering, Steve [3 ]
Martini, Maria G. [2 ]
Raake, Alexander [3 ]
Moeller, Sebastian [1 ,4 ]
机构
[1] TU Berlin, Qual & Usabil Lab, Berlin, Germany
[2] Kingston Univ, London, England
[3] Tech Univ Ilmenau, Ilmenau, Germany
[4] DFKI Projektbiiro Berlin, Berlin, Germany
来源
2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP) | 2020年
基金
欧盟地平线“2020”;
关键词
Quality of Experience; Video Quality Estimation; Quality Models; Deep Learning; Gaming Video Streaming;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Existing works in the field of quality assessment focus separately on gaming and non-gaming content. Along with the traditional modeling approaches, deep learning based approaches have been used to develop quality models, due to their high prediction accuracy. In this paper, we present a deep learning based quality estimation model considering both gaming and non-gaming videos. The model is developed in three phases. First, a convolutional neural network (CNN) is trained based on an objective metric which allows the CNN to learn video artifacts such as blurriness and blockiness. Next, the model is fine-tuned based on a small image quality dataset using blockiness and blurriness ratings. Finally, a Random Forest is used to pool frame-level predictions and temporal information of videos in order to predict the overall video quality. The light-weight, low complexity nature of the model makes it suitable for real-time applications considering both gaming and non-gaming content while achieving similar performance to existing state-of-the-art model NDNetGaming. The model implementation for testing is available on GitHub(1).
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Quality Estimation Models for Gaming Video Streaming Services Using Perceptual Video Quality Dimensions
    Zadtootaghaj, Saman
    Schmidt, Steven
    Sabet, Saeed Shafiee
    Moeller, Sebastian
    Griwodz, Carsten
    MMSYS'20: PROCEEDINGS OF THE 2020 MULTIMEDIA SYSTEMS CONFERENCE, 2020, : 213 - 224
  • [2] Direct Scaling & Quality Prediction for perceptual Video Quality Dimensions
    Schiffner, Falk
    Moeller, Sebastian
    2018 TENTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2018, : 51 - 53
  • [3] Extension to 4K Resolution of a Parametric Model for Perceptual Video Quality Estimation
    Sotelo, Rafael
    Joskowicz, Jose
    Puddu, Roberto
    Giusto, Daniele D.
    Anedda, Matteo
    2018 IEEE BROADCAST SYMPOSIUM (BTS), 2018,
  • [4] Investigation of Video Quality Dimensions for Different Type of Video Content
    Schiffner, Falk
    Bondarenko, Vladimir
    Moeller, Sebastian
    2018 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2018), 2018, : 122 - 126
  • [5] Impact of Video Luminance on Perceptual Quality and Energy Consumption in Video Streaming
    Nguyen, Minh
    Gueclue, Goerkem
    Lasak, Martin
    Seeliger, Robert
    Arbanowski, Stefan
    Steglich, Stephan
    2024 16TH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE, QOMEX 2024, 2024, : 76 - 79
  • [6] Defining the Relevant Perceptual Quality Space for Video and Video-Telephony
    Schiffner, Falk
    Moller, Sebastian
    2017 NINTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2017,
  • [7] Perceptual video quality assessment: the journey continues!
    Saha, Avinab
    Pentapati, Sai Karthikey
    Shang, Zaixi
    Pahwa, Ramit
    Chen, Bowen
    Gedik, Hakan Emre
    Mishra, Sandeep
    Bovik, Alan C.
    FRONTIERS IN SIGNAL PROCESSING, 2023, 3
  • [8] Objectification of perceptual image quality for mobile video
    Lee, Seon-Oh
    Sim, Dong-Gyu
    OPTICAL ENGINEERING, 2011, 50 (06)
  • [9] ACCURATE VIDEO-QUALITY ESTIMATION WITHOUT VIDEO DECODING
    Yamada, Toru
    Yachida, Shoji
    Senda, Yuzo
    Serizawa, Masahiro
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 2426 - 2429
  • [10] Deep Learning and Video Quality Analysis
    Topiwala, P.
    Krishnan, M.
    Dai, W.
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLII, 2019, 11137