DEMI: Deep Video Quality Estimation Model using Perceptual Video Quality Dimensions

被引:0
作者
Zadtootaghaj, Saman [1 ]
Barman, Nabajeet [2 ]
Rao, Rakesh Rao Ramachandra [3 ]
Goering, Steve [3 ]
Martini, Maria G. [2 ]
Raake, Alexander [3 ]
Moeller, Sebastian [1 ,4 ]
机构
[1] TU Berlin, Qual & Usabil Lab, Berlin, Germany
[2] Kingston Univ, London, England
[3] Tech Univ Ilmenau, Ilmenau, Germany
[4] DFKI Projektbiiro Berlin, Berlin, Germany
来源
2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP) | 2020年
基金
欧盟地平线“2020”;
关键词
Quality of Experience; Video Quality Estimation; Quality Models; Deep Learning; Gaming Video Streaming;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Existing works in the field of quality assessment focus separately on gaming and non-gaming content. Along with the traditional modeling approaches, deep learning based approaches have been used to develop quality models, due to their high prediction accuracy. In this paper, we present a deep learning based quality estimation model considering both gaming and non-gaming videos. The model is developed in three phases. First, a convolutional neural network (CNN) is trained based on an objective metric which allows the CNN to learn video artifacts such as blurriness and blockiness. Next, the model is fine-tuned based on a small image quality dataset using blockiness and blurriness ratings. Finally, a Random Forest is used to pool frame-level predictions and temporal information of videos in order to predict the overall video quality. The light-weight, low complexity nature of the model makes it suitable for real-time applications considering both gaming and non-gaming content while achieving similar performance to existing state-of-the-art model NDNetGaming. The model implementation for testing is available on GitHub(1).
引用
收藏
页数:6
相关论文
共 50 条
  • [31] HEVC Video Quality Enhancement Using Deep Learning with Super Interpolation and Laplacian Filter
    Sheeba, G.
    Maheswari, M.
    IETE JOURNAL OF RESEARCH, 2023, 69 (11) : 7979 - 7992
  • [32] Deep learning based on multimedia encoding to enhance video quality
    Challa, Nagendra Panini
    Shanmuganathan, C.
    Shobana, M.
    Deepthi, Ch. Venkata Sasi
    Bharathiraja, N.
    INTERNATIONAL JOURNAL OF COMMUNICATION NETWORKS AND DISTRIBUTED SYSTEMS, 2023, 29 (05) : 475 - 492
  • [33] Subjective Quality Assessment of an Adaptive Video Streaming Model
    Tavakoli, Samira
    Brunnstrom, Kjell
    Wang, Kun
    Andren, Borje
    Shahid, Muhammad
    Garcia, Narciso
    IMAGE QUALITY AND SYSTEM PERFORMANCE XI, 2014, 9016
  • [34] An Accurate Viewport Estimation Method for 360 Video Streaming using Deep Learning
    Hung N.V.
    Ngan D.T.
    Son P.N.
    Long D.T.
    Dung N.T.
    Huong T.T.
    EAI Endorsed Transactions on Industrial Networks and Intelligent Systems, 2022, 9 (04)
  • [35] Guidelines to Implement Video Dataset to Assess Video Quality
    Acosta, David
    Carlos Cuellar, Juan
    Luis Arciniegas, Jose
    2018 IEEE COLOMBIAN CONFERENCE ON COMMUNICATIONS AND COMPUTING (COLCOM), 2018,
  • [36] Modeling the Perceptual Quality for Viewport-Adaptive Omnidirectional Video Streaming Considering Dynamic Quality Boundary Artifact
    Zou, Wenjie
    Zhang, Wei
    Yang, Fuzheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (11) : 4241 - 4254
  • [37] Hybrid video quality prediction: reviewing video quality measurement for widening application scope
    Marcus Barkowsky
    Iñigo Sedano
    Kjell Brunnström
    Mikołaj Leszczuk
    Nicolas Staelens
    Multimedia Tools and Applications, 2015, 74 : 323 - 343
  • [38] Hybrid video quality prediction: reviewing video quality measurement for widening application scope
    Barkowsky, Marcus
    Sedano, Inigo
    Brunnstrom, Kjell
    Leszczuk, Mikolaj
    Staelens, Nicolas
    MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (02) : 323 - 343
  • [39] A Reactive Deep Learning-Based Model for Quality Assessment in Airport Video Surveillance Systems
    Liu, Wanting
    Pan, Ya
    Fan, Yong
    ELECTRONICS, 2024, 13 (04)
  • [40] No-Reference Cross-Layer Video Quality Estimation Model over Wireless Networks
    YanYang
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011,