Recurrent feature supplementation network for video super-resolution

被引:0
|
作者
Li, Guo-Fang [1 ]
Zhu, Yong-Gui [2 ]
机构
[1] Commun Univ China, Sch Informat & Commun Engn, Beijing, Peoples R China
[2] Commun Univ China, Sch Data Sci & Media Intelligence, Beijing 100024, Peoples R China
基金
中国国家自然科学基金;
关键词
Hsieh; Sun-Yuan; Xu; Li; Video super-resolution; feature supplementation mechanism; temporal grouping; temporal fusion;
D O I
10.1080/02533839.2024.2383573
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Efficient aggregation of temporal information is the basis for achieving video super-resolution. Most researchers have employed alignment or propagation to exploit the temporal information of consecutive frames. However, they frequently overlook the centrality of the reference frame in the model reconstruction when using temporal features. Thus, in this paper, we design a novel recurrent feature supplementation network. We divide the temporal information into three parts: surrounding, back propagation and forward propagation, and extract and fuse them separately. A new grouping approach is proposed for extracting features from the reference frame and its surroundings. The backward temporal fusion module and the forward temporal fusion module are designed to aggregate the backward and forward temporal information at a distance. The temporal fusion module is designed to aggregate temporal information from different parts. Moreover, we propose a feature supplementation mechanism to improve the stability of the model. The feature supplement module is devised to improve the utilization of input features and the stability of the model. Experiments demonstrate that our model achieves the state-of-the-art performance.
引用
收藏
页码:888 / 900
页数:13
相关论文
共 50 条
  • [21] Video Super-Resolution via Bidirectional Recurrent Convolutional Networks
    Huang, Yan
    Wang, Wei
    Wang, Liang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) : 1015 - 1028
  • [22] A lightweight distillation recurrent convolution network on FPGA for real-time video super-resolution
    Zheng, Zhaowen
    Huang, Yuqiao
    Chen, Dihu
    MULTIMEDIA SYSTEMS, 2024, 30 (06)
  • [23] Dual Bidirectional Feature Enhancement Network for Continuous Space-Time Video Super-Resolution
    Luo, Laigan
    Yi, Benshun
    Wang, Zhongyuan
    He, Zheng
    Zhu, Chao
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2025, 11 : 228 - 236
  • [24] Video super-resolution with inverse recurrent net and hybrid local fusion
    Li, Dingyi
    Wang, Zengfu
    Yang, Jian
    NEUROCOMPUTING, 2022, 489 : 40 - 51
  • [25] Bidirectional Temporal-Recurrent Propagation Networks for Video Super-Resolution
    Han, Lei
    Fan, Cien
    Yang, Ye
    Zou, Lian
    ELECTRONICS, 2020, 9 (12) : 1 - 15
  • [26] A Fast and Scalable Frame-Recurrent Video Super-Resolution Framework
    Hou, Kaixuan
    Luo, Jianping
    NEURAL INFORMATION PROCESSING, ICONIP 2023, PT IV, 2024, 14450 : 310 - 325
  • [27] DENSE-CONNECTED RESIDUAL NETWORK FOR VIDEO SUPER-RESOLUTION
    Du, Xiaoting
    Zhou, Yuan
    Chen, Yanfang
    Zhang, Yeda
    Yang, Jianxing
    Jin, Dou
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 592 - 597
  • [28] Spatio-Temporal Fusion Network for Video Super-Resolution
    Li, Huabin
    Zhang, Pingjian
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [29] Learning a Deep Dual Attention Network for Video Super-Resolution
    Li, Feng
    Bai, Huihui
    Zhao, Yao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 4474 - 4488
  • [30] Deformable Non-Local Network for Video Super-Resolution
    Wang, Hua
    Su, Dewei
    Liu, Chuangchuang
    Jin, Longcun
    Sun, Xianfang
    Peng, Xinyi
    IEEE ACCESS, 2019, 7 : 177734 - 177744