Internet Video Delivery Improved by Super-Resolution with GAN

被引:3
|
作者
Liborio, Joao da Mata [1 ,2 ]
Melo, Cesar [1 ]
Silva, Marcos [1 ]
机构
[1] Fed Univ Amazonas UFAM, Comp Inst, BR-69080900 Manaus, Brazil
[2] Amazonas State Univ UEA, Ctr Higher Studies Itacoatiara, BR-69101416 Itacoatiara, Brazil
关键词
super-resolution; deep neural networks; GAN; streaming traffic; CDN; video delivery; cloud;
D O I
10.3390/fi14120364
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, image and video super-resolution have gained attention outside the computer vision community due to the outstanding results produced by applying deep-learning models to solve the super-resolution problem. These models have been used to improve the quality of videos and images. In the last decade, video-streaming applications have also become popular. Consequently, they have generated traffic with an increasing quantity of data in network infrastructures, which continues to grow, e.g., global video traffic is forecast to increase from 75% in 2017 to 82% in 2022. In this paper, we leverage the power of deep-learning-based super-resolution methods and implement a model for video super-resolution, which we call VSRGAN+. We train our model with a dataset proposed to teach systems for high-level visual comprehension tasks. We also test it on a large-scale JND-based coded video quality dataset containing 220 video clips with four different resolutions. Additionally, we propose a cloud video-delivery framework that uses video super-resolution. According to our findings, the VSRGAN+ model can reconstruct videos without perceptual distinction of the ground truth. Using this model with added compression can decrease the quantity of data delivered to surrogate servers in a cloud video-delivery framework. The traffic decrease reaches 98.42% in total.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Revisiting Super-Resolution for Internet Video Streaming
    Wang, Zelong
    Luo, Zhenxiao
    Hu, Miao
    Wu, Di
    Cao, Youlong
    Qin, Yi
    PROCEEDINGS OF THE 32ND WORKSHOP ON NETWORK AND OPERATING SYSTEMS SUPPORT FOR DIGITAL AUDIO AND VIDEO, NOSSDAV 2022, 2022, : 8 - 14
  • [2] Improved super-resolution reconstruction from video
    Wang, Ci
    Xue, Ping
    Lin, Weisi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2006, 16 (11) : 1411 - 1422
  • [3] Improved Iterative Back Projection for Video Super-Resolution
    Rasti, Pejman
    Demirel, Hasan
    Anbarjafari, Gholamreza
    2014 22ND SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2014, : 552 - 555
  • [4] A GAN to Fight Video-related Traffic Flooding: Super-resolution
    Liborio Filho, Joao da M.
    Melo, Cesar A. V.
    2019 IEEE LATIN-AMERICAN CONFERENCE ON COMMUNICATIONS (IEEE LATINCOM), 2019,
  • [5] Improved EDVR Model for Robust and Efficient Video Super-Resolution
    Huang, Yulin
    Chen, Junying
    2022 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW 2022), 2022, : 103 - 111
  • [6] Omniscient Video Super-Resolution
    Yi, Peng
    Wang, Zhongyuan
    Jiang, Kui
    Jiang, Junjun
    Lu, Tao
    Tian, Xin
    Ma, Jiayi
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4409 - 4418
  • [7] GAN Flexible Lmser for Super-resolution
    Li, Peiying
    Tu, Shikui
    Xu, Lei
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 756 - 764
  • [8] Lightweight Video Super-Resolution for Compressed Video
    Kwon, Ilhwan
    Li, Jun
    Prasad, Mukesh
    ELECTRONICS, 2023, 12 (03)
  • [9] VIDEO SUPER-RESOLUTION FOR MIXED RESOLUTION STEREO
    Jain, Ankit K.
    Nguyen, Truong Q.
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 962 - 966
  • [10] A New Adaptive Video Super-Resolution Algorithm With Improved Robustness to Innovations
    Borsoi, Ricardo Augusto
    Costa, Guilherme Holsbach
    Moreira Bermudez, Jose Carlos
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (02) : 673 - 686