Internet Video Delivery Improved by Super-Resolution with GAN

被引:3
|
作者
Liborio, Joao da Mata [1 ,2 ]
Melo, Cesar [1 ]
Silva, Marcos [1 ]
机构
[1] Fed Univ Amazonas UFAM, Comp Inst, BR-69080900 Manaus, Brazil
[2] Amazonas State Univ UEA, Ctr Higher Studies Itacoatiara, BR-69101416 Itacoatiara, Brazil
关键词
super-resolution; deep neural networks; GAN; streaming traffic; CDN; video delivery; cloud;
D O I
10.3390/fi14120364
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, image and video super-resolution have gained attention outside the computer vision community due to the outstanding results produced by applying deep-learning models to solve the super-resolution problem. These models have been used to improve the quality of videos and images. In the last decade, video-streaming applications have also become popular. Consequently, they have generated traffic with an increasing quantity of data in network infrastructures, which continues to grow, e.g., global video traffic is forecast to increase from 75% in 2017 to 82% in 2022. In this paper, we leverage the power of deep-learning-based super-resolution methods and implement a model for video super-resolution, which we call VSRGAN+. We train our model with a dataset proposed to teach systems for high-level visual comprehension tasks. We also test it on a large-scale JND-based coded video quality dataset containing 220 video clips with four different resolutions. Additionally, we propose a cloud video-delivery framework that uses video super-resolution. According to our findings, the VSRGAN+ model can reconstruct videos without perceptual distinction of the ground truth. Using this model with added compression can decrease the quantity of data delivered to surrogate servers in a cloud video-delivery framework. The traffic decrease reaches 98.42% in total.
引用
收藏
页数:23
相关论文
共 50 条
  • [11] Deep Blind Video Super-resolution
    Pan, Jinshan
    Bai, Haoran
    Dong, Jiangxin
    Zhang, Jiawei
    Tang, Jinhui
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4791 - 4800
  • [12] A Parallel Framework for Video Super-Resolution
    Freitas, Pedro Garcia
    Farias, Mylene C. Q.
    de Araujo, Aleteia P. F.
    2014 27TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2014, : 204 - 211
  • [13] Super-Resolution Enhancement of Digital Video
    Russell C. Hardie
    Richard R. Schultz
    Kenneth E. Barner
    EURASIP Journal on Advances in Signal Processing, 2007
  • [14] Deep Blind Video Super-resolution
    Pan, Jinshan
    Bai, Haoran
    Dong, Jiangxin
    Zhang, Jiawei
    Tang, Jinhui
    Proceedings of the IEEE International Conference on Computer Vision, 2021, : 4791 - 4800
  • [15] Simultaneous super-resolution for video sequences
    Zibetti, MVW
    Mayer, J
    2005 International Conference on Image Processing (ICIP), Vols 1-5, 2005, : 189 - 192
  • [16] Video super-resolution with fast deconvolution
    Krylov A.S.
    Nasonov A.S.
    Ushmaev O.S.
    Pattern Recognition and Image Analysis, 2009, 19 (03) : 497 - 500
  • [17] Super-resolution enhancement of digital video
    Hardie, Russell C.
    Schultz, Richard R.
    Barner, Kenneth E.
    EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2007, 2007 (1)
  • [18] A 'deep' review of video super-resolution
    Gopalakrishnan, Subhadra
    Choudhury, Anustup
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2024, 129
  • [19] HDR Video Super-Resolution for Future Video Coding
    Umeda, Seiya
    Yano, Niai
    Watanabe, Hiroshi
    Ikai, Tomohiro
    Chujoh, Takeshi
    Ito, Norio
    2018 INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT), 2018,
  • [20] GAN-BASED VIDEO SUPER-RESOLUTION WITH DIRECT REGULARIZED INVERSION OF THE LOW-RESOLUTION FORMATIONMODEL
    Lopez-Tapia, Santiago
    Lucas, Alice
    Molina, Rafael
    Katsaggelos, Aggelos K.
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2886 - 2890