Internet Video Delivery Improved by Super-Resolution with GAN

被引:3
|
作者
Liborio, Joao da Mata [1 ,2 ]
Melo, Cesar [1 ]
Silva, Marcos [1 ]
机构
[1] Fed Univ Amazonas UFAM, Comp Inst, BR-69080900 Manaus, Brazil
[2] Amazonas State Univ UEA, Ctr Higher Studies Itacoatiara, BR-69101416 Itacoatiara, Brazil
关键词
super-resolution; deep neural networks; GAN; streaming traffic; CDN; video delivery; cloud;
D O I
10.3390/fi14120364
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, image and video super-resolution have gained attention outside the computer vision community due to the outstanding results produced by applying deep-learning models to solve the super-resolution problem. These models have been used to improve the quality of videos and images. In the last decade, video-streaming applications have also become popular. Consequently, they have generated traffic with an increasing quantity of data in network infrastructures, which continues to grow, e.g., global video traffic is forecast to increase from 75% in 2017 to 82% in 2022. In this paper, we leverage the power of deep-learning-based super-resolution methods and implement a model for video super-resolution, which we call VSRGAN+. We train our model with a dataset proposed to teach systems for high-level visual comprehension tasks. We also test it on a large-scale JND-based coded video quality dataset containing 220 video clips with four different resolutions. Additionally, we propose a cloud video-delivery framework that uses video super-resolution. According to our findings, the VSRGAN+ model can reconstruct videos without perceptual distinction of the ground truth. Using this model with added compression can decrease the quantity of data delivered to surrogate servers in a cloud video-delivery framework. The traffic decrease reaches 98.42% in total.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] Video Super-Resolution by Adaptive Kernel Regression
    Islam, Mohammad Moinul
    Asari, Vijayan K.
    Islam, Mohammed Nazrul
    Karim, Mohammad A.
    ADVANCES IN VISUAL COMPUTING, PT 2, PROCEEDINGS, 2009, 5876 : 799 - 806
  • [42] Super-resolution restoration of facial images in video
    Yu, Jiangang
    Bhanu, Bir
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 4, PROCEEDINGS, 2006, : 342 - +
  • [43] Understanding Deformable Alignment in Video Super-Resolution
    Chan, Kelvin C. K.
    Wang, Xintao
    Yu, Ke
    Dong, Chao
    Loy, Chen Change
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 973 - 981
  • [44] Deep Blind Super-Resolution for Satellite Video
    Xiao, Yi
    Yuan, Qiangqiang
    Zhang, Qiang
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [45] Deep Recurrent Resnet for Video Super-Resolution
    Lim, Bee
    Lee, Kyoung Mu
    2017 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC 2017), 2017, : 1452 - 1455
  • [46] Jitter camera: a super-resolution video camera
    Ben-Ezra, M
    Zomet, A
    Nayar, SK
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2006, PTS 1 AND 2, 2006, 6077
  • [47] Super-resolution of turbulent video: Potentials and limitations
    Yaroslavsky, Leonid P.
    Shabat, Gil
    Fishbain, Barak
    Ideses, Ianir A.
    IMAGE PROCESSING: ALGORITHMS AND SYSTEMS VI, 2008, 6812
  • [48] Optical flow for video super-resolution: a survey
    Tu, Zhigang
    Li, Hongyan
    Xie, Wei
    Liu, Yuanzhong
    Zhang, Shifu
    Li, Baoxin
    Yuan, Junsong
    ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (08) : 6505 - 6546
  • [49] SUPER-RESOLUTION OF DEFORMED FACIAL IMAGES IN VIDEO
    Yu, Jiangang
    Bhanu, Bir
    2008 15TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-5, 2008, : 1160 - 1163
  • [50] SUPER-RESOLUTION FOR INCONSISTENT SCALABLE VIDEO STREAMING
    Mahfoodh, Abo-Talib
    Mukherjee, Debargha
    Radha, Hayder
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 3019 - 3023