DEMI: Deep Video Quality Estimation Model using Perceptual Video Quality Dimensions

被引:0
|
作者
Zadtootaghaj, Saman [1 ]
Barman, Nabajeet [2 ]
Rao, Rakesh Rao Ramachandra [3 ]
Goering, Steve [3 ]
Martini, Maria G. [2 ]
Raake, Alexander [3 ]
Moeller, Sebastian [1 ,4 ]
机构
[1] TU Berlin, Qual & Usabil Lab, Berlin, Germany
[2] Kingston Univ, London, England
[3] Tech Univ Ilmenau, Ilmenau, Germany
[4] DFKI Projektbiiro Berlin, Berlin, Germany
来源
2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP) | 2020年
基金
欧盟地平线“2020”;
关键词
Quality of Experience; Video Quality Estimation; Quality Models; Deep Learning; Gaming Video Streaming;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Existing works in the field of quality assessment focus separately on gaming and non-gaming content. Along with the traditional modeling approaches, deep learning based approaches have been used to develop quality models, due to their high prediction accuracy. In this paper, we present a deep learning based quality estimation model considering both gaming and non-gaming videos. The model is developed in three phases. First, a convolutional neural network (CNN) is trained based on an objective metric which allows the CNN to learn video artifacts such as blurriness and blockiness. Next, the model is fine-tuned based on a small image quality dataset using blockiness and blurriness ratings. Finally, a Random Forest is used to pool frame-level predictions and temporal information of videos in order to predict the overall video quality. The light-weight, low complexity nature of the model makes it suitable for real-time applications considering both gaming and non-gaming content while achieving similar performance to existing state-of-the-art model NDNetGaming. The model implementation for testing is available on GitHub(1).
引用
收藏
页数:6
相关论文
共 50 条
  • [21] A packet-layer video quality assessment model with spatiotemporal complexity estimation
    Ning Liao
    Zhibo Chen
    EURASIP Journal on Image and Video Processing, 2011
  • [22] A packet-layer video quality assessment model with spatiotemporal complexity estimation
    Liao, Ning
    Chen, Zhibo
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2011,
  • [23] Assessing Texture Dimensions and Video Quality in Motion Pictures using Sensory Evaluation Techniques
    Keller, Dominik
    Seybold, Tamara
    Skowronek, Janto
    Raake, Alexander
    2019 ELEVENTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2019,
  • [24] Deep-BVQM: A Deep-learning Bitstream-based Video Quality Model
    Avanaki, Nasim Jamshidi
    Schmidt, Steven
    Michael, Thilo
    Zadtootaghaj, Saman
    Meoller, Sebastian
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 915 - 923
  • [25] Video Quality Assessment System Using Deep Optical Flow and Fourier Property
    Kang, Donggoo
    Kim, Yeongjoon
    Kwon, Sunkyu
    Kim, Hyuncheol
    Kim, Jinah
    Paik, Joonki
    IEEE ACCESS, 2023, 11 : 132131 - 132146
  • [26] DELIVERY QUALITY SCORE MODEL FOR INTERNET VIDEO
    Yeganeh, Hojatollah
    Kordasiewicz, Roman
    Gallant, Michael
    Ghadiyaram, Deepti
    Bovik, Alan C.
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 2007 - 2011
  • [27] Real-Time Monitoring of Video Quality in a DASH-based Digital Video Broadcasting using Deep Learning
    Motaung, William
    Ogudo, Kingsley A.
    Chabalala, Chabalala
    5TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, BIG DATA, COMPUTING AND DATA COMMUNICATION SYSTEMS (ICABCD2022), 2022,
  • [28] Depth Estimation of Video Sequences With Perceptual Losses
    Wang, Anjie
    Fang, Zhijun
    Gao, Yongbin
    Jiang, Xiaoyan
    Ma, Siwei
    IEEE ACCESS, 2018, 6 : 30536 - 30546
  • [29] High-Quality Video Watermarking Based on Deep Neural Networks for Video with HEVC Compression
    Kaczynski, Maciej
    Piotrowski, Zbigniew
    Pietrow, Dymitr
    SENSORS, 2022, 22 (19)
  • [30] DEEP NEURAL NETWORKS FOR NO-REFERENCE VIDEO QUALITY ASSESSMENT
    You, Junyong
    Korhonen, Jari
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2349 - 2353