Real-Time Monitoring of Video Quality in a DASH-based Digital Video Broadcasting using Deep Learning

被引:2
|
作者
Motaung, William [1 ]
Ogudo, Kingsley A. [1 ]
Chabalala, Chabalala [2 ]
机构
[1] Univ Johannesburg, Dept Elect & Elect Engn, Johannesburg, South Africa
[2] Univ Witwatersrand, Sch Elect & Informat Engn, Johannesburg, South Africa
来源
5TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, BIG DATA, COMPUTING AND DATA COMMUNICATION SYSTEMS (ICABCD2022) | 2022年
关键词
deep learning; digital video broadcasting; multimedia streaming; restricted Boltzmann machine; video quality assessment;
D O I
10.1109/icABCD54961.2022.9856390
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Digital video processing and transmission can introduce numerous distortions while capturing signals from broadcasting stations. These distortions become a nightmare for multimedia companies, especially terrestrial broadcasting companies that have fully adopted the online video streaming service. While terrestrial broadcasting benefits from online streaming through over-the-top (OTT) channels, there is a potential setback to reducing the video quality due to preprocessing of signals. Video quality assessment (VQA) algorithms have been developed for analyzing the quality of videos in a database, but little attention has been paid to implementing such algorithms in a real-time situation. This paper develops a novel real-time VQA framework by integrating a deep learning technology into the broadcasting pipeline. Previous studies used objective metrics augmented with subjective values to validate techniques. However, this approach is not appropriate for real-time video evaluation. Our proposed framework uses objective metrics (devoid of subjective scores like mean opinion scores) but rather introduced a new metric to validate the framework. The whole framework is validated using compressed/uncompressed signals and varying devices to show the signal differences. Results show that the framework is a step toward feasible incorporation of a VQA tool in a digital terrestrial television model. Using 100 epochs for our simulated video stream, the restricted Boltzmann machine yields a root mean square and mean absolute of 3.6903 and 2.3861 respectively.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] DeepQoE: Real-time Measurement of Video QoE from Encrypted Traffic with Deep Learning
    Shen, Meng
    Zhang, Jinpeng
    Xu, Ke
    Zhu, Liehuang
    Liu, Jiangchuan
    Du, Xiaojiang
    2020 IEEE/ACM 28TH INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2020,
  • [22] Edge Computing-Enabled Deep Learning for Real-time Video Optimization in IIoT
    Dou, Wanchun
    Zhao, Xuan
    Yin, Xiaochun
    Wang, Huihui
    Luo, Yun
    Qi, Lianyong
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (04) : 2842 - 2851
  • [23] A deep-learning based system using multi-modal data for diagnosing gastric neoplasms in real-time (with video)
    Du, Hongliu
    Dong, Zehua
    Wu, Lianlian
    Li, Yanxia
    Liu, Jun
    Luo, Chaijie
    Zeng, Xiaoquan
    Deng, Yunchao
    Cheng, Du
    Diao, Wenxiu
    Zhu, Yijie
    Tao, Xiao
    Wang, Junxiao
    Zhang, Chenxia
    Yu, Honggang
    GASTRIC CANCER, 2023, 26 (02) : 275 - 285
  • [24] A deep-learning based system using multi-modal data for diagnosing gastric neoplasms in real-time (with video)
    Hongliu Du
    Zehua Dong
    Lianlian Wu
    Yanxia Li
    Jun Liu
    Chaijie Luo
    Xiaoquan Zeng
    Yunchao Deng
    Du Cheng
    Wenxiu Diao
    Yijie Zhu
    Xiao Tao
    Junxiao Wang
    Chenxia Zhang
    Honggang Yu
    Gastric Cancer, 2023, 26 : 275 - 285
  • [25] A study of real-time packet video quality using random neural networks
    Mohamed, S
    Rubino, G
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2002, 12 (12) : 1071 - 1083
  • [26] Frame Difference-Based Real-Time Video Stylization in Video Calls
    Xiong, Zheyang
    Weber, Cornelius
    Hu, Xiaolin
    2018 NINTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2018, : 333 - 339
  • [27] Integrating Depth-Based and Deep Learning Techniques for Real-Time Video Matting without Green Screens
    Su, Pin-Chen
    Yang, Mau-Tsuen
    ELECTRONICS, 2024, 13 (16)
  • [28] A survey on deep learning-based real-time crowd anomaly detection for secure distributed video surveillance
    Rezaee K.
    Rezakhani S.M.
    Khosravi M.R.
    Moghimi M.K.
    Personal and Ubiquitous Computing, 2024, 28 (01) : 135 - 151
  • [29] Real-time Driver Monitoring using Facial Landmarks and Deep Learning
    Joshi, Soham
    Venugopalan, Shankaran
    Kumar, Animesh
    Kukade, Shweta
    Lodha, Mokshit
    Motade, Sumitra
    2024 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND APPLIED INFORMATICS, ACCAI 2024, 2024,
  • [30] Real Time License Plate Recognition from Video Streams using Deep Learning
    Hashmi, Saquib Nadeem
    Kumar, Kaushtubh
    Khandelwal, Siddhant
    Lochan, Dravit
    Mittal, Sangeeta
    INTERNATIONAL JOURNAL OF INFORMATION RETRIEVAL RESEARCH, 2019, 9 (01) : 65 - 87