Recurrent feature supplementation network for video super-resolution

被引:0
|
作者
Li, Guo-Fang [1 ]
Zhu, Yong-Gui [2 ]
机构
[1] Commun Univ China, Sch Informat & Commun Engn, Beijing, Peoples R China
[2] Commun Univ China, Sch Data Sci & Media Intelligence, Beijing 100024, Peoples R China
基金
中国国家自然科学基金;
关键词
Hsieh; Sun-Yuan; Xu; Li; Video super-resolution; feature supplementation mechanism; temporal grouping; temporal fusion;
D O I
10.1080/02533839.2024.2383573
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Efficient aggregation of temporal information is the basis for achieving video super-resolution. Most researchers have employed alignment or propagation to exploit the temporal information of consecutive frames. However, they frequently overlook the centrality of the reference frame in the model reconstruction when using temporal features. Thus, in this paper, we design a novel recurrent feature supplementation network. We divide the temporal information into three parts: surrounding, back propagation and forward propagation, and extract and fuse them separately. A new grouping approach is proposed for extracting features from the reference frame and its surroundings. The backward temporal fusion module and the forward temporal fusion module are designed to aggregate the backward and forward temporal information at a distance. The temporal fusion module is designed to aggregate temporal information from different parts. Moreover, we propose a feature supplementation mechanism to improve the stability of the model. The feature supplement module is devised to improve the utilization of input features and the stability of the model. Experiments demonstrate that our model achieves the state-of-the-art performance.
引用
收藏
页码:888 / 900
页数:13
相关论文
共 50 条
  • [31] Video Super-Resolution Using Wave-Shape Network
    Wu, Yanan
    Kamata, Sei-ichiro
    ICVIP 2019: PROCEEDINGS OF 2019 3RD INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING, 2019, : 132 - 136
  • [32] Local-Global Fusion Network for Video Super-Resolution
    Su, Dewei
    Wang, Hua
    Jin, Longcun
    Sun, Xianfang
    Peng, Xinyi
    IEEE ACCESS, 2020, 8 : 172443 - 172456
  • [33] Semantic guidance incremental network for efficiency video super-resolution
    He, Xiaonan
    Xia, Yukun
    Qiao, Yuansong
    Lee, Brian
    Ye, Yuhang
    VISUAL COMPUTER, 2024, : 4899 - 4911
  • [34] Video Super-Resolution via Dynamic Local Filter Network
    Zhou, Yang
    Liu, Xiaohong
    Chen, Lei
    Zhao, Jiying
    2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 41 - 45
  • [35] DDAN: A DEEP DUAL ATTENTION NETWORK FOR VIDEO SUPER-RESOLUTION
    Sun, Xiyue
    Li, Feng
    Bai, Huihui
    Zhao, Yao
    2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [36] FRAGAN-VSR: Frame-Recurrent Attention Generative Adversarial Network for Video Super-Resolution
    Zhang, Yuzhen
    Liu, Guanqun
    Zhao, Yanyan
    Zha, Daren
    Xin, Wang
    Zhao, Lin
    Wang, Lei
    2021 IEEE 33RD INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2021), 2021, : 753 - 757
  • [37] An FPGA-Based Residual Recurrent Neural Network for Real-Time Video Super-Resolution
    Sun, Kaicong
    Koch, Maurice
    Wang, Zhe
    Jovanovic, Slavisa
    Rabah, Hassan
    Simon, Sven
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (04) : 1739 - 1750
  • [38] Improving bi-directional recurrent network for video super-resolution with deformable motion alignment structure
    Liu, Heng
    Huang, Xiangchen
    Chu, Yuezhong
    Ye, Mingquan
    Liu, Tao
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2025,
  • [39] Video Super-Resolution Network with Gated High-Low Resolution Frames
    Ouyang, Ning
    Ou, Zhishan
    Lin, Leping
    APPLIED SCIENCES-BASEL, 2023, 13 (14):
  • [40] Lightweight Video Super-Resolution for Compressed Video
    Kwon, Ilhwan
    Li, Jun
    Prasad, Mukesh
    ELECTRONICS, 2023, 12 (03)