Video Super-Resolution with Regional Focus for Recurrent Network

被引:1
作者
Li, Yanghui [1 ]
Zhu, Hong [1 ]
He, Lixin [1 ]
Wang, Dong [1 ]
Shi, Jing [1 ]
Wang, Jing [2 ]
机构
[1] Xian Univ Technol, Sch Automat & Informat Engn, Xian 710048, Peoples R China
[2] Xian Univ Technol, Sch Printing Packaging & Digital Media, Xian 710054, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 01期
关键词
recurrent neural network; regional focus; feature aggregation; video super-resolution; CONVOLUTION;
D O I
10.3390/app13010526
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Video super-resolution reconstruction is the process of reconstructing low-resolution video frames into high-resolution video frames. Most of the current methods use motion estimation and motion compensation to extract temporal series information, but the inaccuracy of motion estimation will lead to the degradation of the quality of video super-resolution results. Additionally, when using convolution network to extract feature information, the number of feature information is limited by the number of feature channels, resulting in poor reconstruction results. In this paper, we propose a recurrent structure of regional focus network for video super-resolution, which can avoid the influence of inaccurate motion compensation on super-resolution results. Meanwhile, regional focus blocks in the network can focus on different areas of video frames, extract different features from shallow to deep layers, and skip-connect to the last layer of the network through feature aggregation to improve the richness of features participating in the reconstruction. The experimental results show that our method has higher computational efficiency and better video super-resolution results than other temporal modeling methods.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Group-based bi-directional recurrent wavelet neural network for efficient video super-resolution (VSR)
    Choi, Young-Ju
    Lee, Young-Woon
    Kim, Byung-Gyu
    PATTERN RECOGNITION LETTERS, 2022, 164 : 246 - 253
  • [22] STDAN: Deformable Attention Network for Space-Time Video Super-Resolution
    Wang, Hai
    Xiang, Xiaoyu
    Tian, Yapeng
    Yang, Wenming
    Liao, Qingmin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) : 10606 - 10616
  • [23] Video super-resolution with inverse recurrent net and hybrid local fusion
    Li, Dingyi
    Wang, Zengfu
    Yang, Jian
    NEUROCOMPUTING, 2022, 489 : 40 - 51
  • [24] Bidirectional Temporal-Recurrent Propagation Networks for Video Super-Resolution
    Han, Lei
    Fan, Cien
    Yang, Ye
    Zou, Lian
    ELECTRONICS, 2020, 9 (12) : 1 - 15
  • [25] FFFN: Frame-By-Frame Feedback Fusion Network for Video Super-Resolution
    Zhu, Jian
    Zhang, Qingwu
    Fei, Lunke
    Cai, Ruichu
    Xie, Yuan
    Sheng, Bin
    Yang, Xiaokang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 6821 - 6835
  • [26] A Fast and Scalable Frame-Recurrent Video Super-Resolution Framework
    Hou, Kaixuan
    Luo, Jianping
    NEURAL INFORMATION PROCESSING, ICONIP 2023, PT IV, 2024, 14450 : 310 - 325
  • [27] A Progressive Fusion Generative Adversarial Network for Realistic and Consistent Video Super-Resolution
    Yi, Peng
    Wang, Zhongyuan
    Jiang, Kui
    Jiang, Junjun
    Lu, Tao
    Ma, Jiayi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (05) : 2264 - 2280
  • [28] DENSE-CONNECTED RESIDUAL NETWORK FOR VIDEO SUPER-RESOLUTION
    Du, Xiaoting
    Zhou, Yuan
    Chen, Yanfang
    Zhang, Yeda
    Yang, Jianxing
    Jin, Dou
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 592 - 597
  • [29] Spatio-Temporal Fusion Network for Video Super-Resolution
    Li, Huabin
    Zhang, Pingjian
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [30] Learning a Deep Dual Attention Network for Video Super-Resolution
    Li, Feng
    Bai, Huihui
    Zhao, Yao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 4474 - 4488