Video Super-Resolution with Regional Focus for Recurrent Network

被引:1
作者
Li, Yanghui [1 ]
Zhu, Hong [1 ]
He, Lixin [1 ]
Wang, Dong [1 ]
Shi, Jing [1 ]
Wang, Jing [2 ]
机构
[1] Xian Univ Technol, Sch Automat & Informat Engn, Xian 710048, Peoples R China
[2] Xian Univ Technol, Sch Printing Packaging & Digital Media, Xian 710054, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 01期
关键词
recurrent neural network; regional focus; feature aggregation; video super-resolution; CONVOLUTION;
D O I
10.3390/app13010526
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Video super-resolution reconstruction is the process of reconstructing low-resolution video frames into high-resolution video frames. Most of the current methods use motion estimation and motion compensation to extract temporal series information, but the inaccuracy of motion estimation will lead to the degradation of the quality of video super-resolution results. Additionally, when using convolution network to extract feature information, the number of feature information is limited by the number of feature channels, resulting in poor reconstruction results. In this paper, we propose a recurrent structure of regional focus network for video super-resolution, which can avoid the influence of inaccurate motion compensation on super-resolution results. Meanwhile, regional focus blocks in the network can focus on different areas of video frames, extract different features from shallow to deep layers, and skip-connect to the last layer of the network through feature aggregation to improve the richness of features participating in the reconstruction. The experimental results show that our method has higher computational efficiency and better video super-resolution results than other temporal modeling methods.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Video Super-Resolution via Dynamic Local Filter Network
    Zhou, Yang
    Liu, Xiaohong
    Chen, Lei
    Zhao, Jiying
    [J]. 2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 41 - 45
  • [32] Spatio-Temporal Fusion Network for Video Super-Resolution
    Li, Huabin
    Zhang, Pingjian
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [33] Learning a Deep Dual Attention Network for Video Super-Resolution
    Li, Feng
    Bai, Huihui
    Zhao, Yao
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 4474 - 4488
  • [34] Tracking of Microbubbles with a Recurrent Neural Network for Super-Resolution Imaging
    Wilmes, Daniel
    Piepenbrock, Marion
    Schmitz, Georg
    Dencks, Stefanie
    [J]. PROCEEDINGS OF THE 2020 IEEE INTERNATIONAL ULTRASONICS SYMPOSIUM (IUS), 2020,
  • [35] Semantic guidance incremental network for efficiency video super-resolution
    He, Xiaonan
    Xia, Yukun
    Qiao, Yuansong
    Lee, Brian
    Ye, Yuhang
    [J]. VISUAL COMPUTER, 2024, : 4899 - 4911
  • [36] DDAN: A DEEP DUAL ATTENTION NETWORK FOR VIDEO SUPER-RESOLUTION
    Sun, Xiyue
    Li, Feng
    Bai, Huihui
    Zhao, Yao
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [37] Video Super-Resolution Using Wave-Shape Network
    Wu, Yanan
    Kamata, Sei-ichiro
    [J]. ICVIP 2019: PROCEEDINGS OF 2019 3RD INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING, 2019, : 132 - 136
  • [38] Local-Global Fusion Network for Video Super-Resolution
    Su, Dewei
    Wang, Hua
    Jin, Longcun
    Sun, Xianfang
    Peng, Xinyi
    [J]. IEEE ACCESS, 2020, 8 : 172443 - 172456
  • [39] Deformable Non-Local Network for Video Super-Resolution
    Wang, Hua
    Su, Dewei
    Liu, Chuangchuang
    Jin, Longcun
    Sun, Xianfang
    Peng, Xinyi
    [J]. IEEE ACCESS, 2019, 7 : 177734 - 177744
  • [40] Improving bi-directional recurrent network for video super-resolution with deformable motion alignment structure
    Liu, Heng
    Huang, Xiangchen
    Chu, Yuezhong
    Ye, Mingquan
    Liu, Tao
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2025,