Recurrent feature supplementation network for video super-resolution

被引:0
|
作者
Li, Guo-Fang [1 ]
Zhu, Yong-Gui [2 ]
机构
[1] Commun Univ China, Sch Informat & Commun Engn, Beijing, Peoples R China
[2] Commun Univ China, Sch Data Sci & Media Intelligence, Beijing 100024, Peoples R China
基金
中国国家自然科学基金;
关键词
Hsieh; Sun-Yuan; Xu; Li; Video super-resolution; feature supplementation mechanism; temporal grouping; temporal fusion;
D O I
10.1080/02533839.2024.2383573
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Efficient aggregation of temporal information is the basis for achieving video super-resolution. Most researchers have employed alignment or propagation to exploit the temporal information of consecutive frames. However, they frequently overlook the centrality of the reference frame in the model reconstruction when using temporal features. Thus, in this paper, we design a novel recurrent feature supplementation network. We divide the temporal information into three parts: surrounding, back propagation and forward propagation, and extract and fuse them separately. A new grouping approach is proposed for extracting features from the reference frame and its surroundings. The backward temporal fusion module and the forward temporal fusion module are designed to aggregate the backward and forward temporal information at a distance. The temporal fusion module is designed to aggregate temporal information from different parts. Moreover, we propose a feature supplementation mechanism to improve the stability of the model. The feature supplement module is devised to improve the utilization of input features and the stability of the model. Experiments demonstrate that our model achieves the state-of-the-art performance.
引用
收藏
页码:888 / 900
页数:13
相关论文
共 50 条
  • [41] Online Video Super-resolution using Information Replenishing Unidirectional Recurrent Model
    Baniya, Arbind Agrahari
    Lee, Tsz-Kwan
    Eklund, Peter W.
    Aryal, Sunil
    Robles-Kelly, Antonio
    NEUROCOMPUTING, 2023, 546
  • [42] Video super-resolution based on spatial-temporal recurrent residual networks
    Yang, Wenhan
    Feng, Jiashi
    Xie, Guosen
    Liu, Jiaying
    Guo, Zongming
    Yan, Shuicheng
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2018, 168 : 79 - 92
  • [43] A 'deep' review of video super-resolution
    Gopalakrishnan, Subhadra
    Choudhury, Anustup
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2024, 129
  • [44] A Parallel Framework for Video Super-Resolution
    Freitas, Pedro Garcia
    Farias, Mylene C. Q.
    de Araujo, Aleteia P. F.
    2014 27TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2014, : 204 - 211
  • [45] Video super-resolution network via enhanced deep feature extraction and residual up-down block
    Lei, Jiajia
    He, Xiaohai
    Ren, Chao
    Wu, Xiaohong
    Wang, Yi
    JOURNAL OF ELECTRONIC IMAGING, 2020, 29 (06)
  • [46] Video Super-Resolution via a Spatio-Temporal Alignment Network
    Wen, Weilei
    Ren, Wenqi
    Shi, Yinghuan
    Nie, Yunfeng
    Zhang, Jingang
    Cao, Xiaochun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1761 - 1773
  • [47] Multi-Memory Convolutional Neural Network for Video Super-Resolution
    Wang, Zhongyuan
    Yi, Peng
    Jiang, Kui
    Jiang, Junjun
    Han, Zhen
    Lu, Tao
    Ma, Jiayi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) : 2530 - 2544
  • [48] Semantic Prior Based Generative Adversarial Network for Video Super-Resolution
    Wu, Xinyi
    Lucas, Alice
    Lopez-Tapia, Santiago
    Wang, Xijun
    Kim, Yul Hee
    Molina, Rafael
    Katsaggelos, Aggelos K.
    2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [49] Video super-resolution with phase-aided deformable alignment network
    Cai, Zhuojun
    Chen, Yaowu
    Tian, Xiang
    Jiang, Rongxin
    JOURNAL OF ELECTRONIC IMAGING, 2020, 29 (03)
  • [50] Video super-resolution based on a spatio-temporal matching network
    Zhu, Xiaobin
    Li, Zhuangzi
    Lou, Jungang
    Shen, Qing
    PATTERN RECOGNITION, 2021, 110