Learning a Local-Global Alignment Network for Satellite Video Super-Resolution

被引:10
作者
Jin, Xianyu [1 ]
He, Jiang [1 ]
Xiao, Yi [1 ]
Yuan, Qiangqiang [1 ]
机构
[1] Wuhan Univ, Sch Geodesy & Geomat, Wuhan 430079, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolution; Satellites; Spatial resolution; Transformers; Superresolution; Training; Computational modeling; Deep learning; satellite videos; video super-resolution (VSR);
D O I
10.1109/LGRS.2023.3250009
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Satellite video is a novel data source for earth observation, which can be applied in multiple fields for dynamic monitoring. It is always equipped with high temporal resolution at the cost of low spatial resolution of tiny moving objects. Video super-resolution (VSR) is utilized to improve the spatial resolution of satellite video and obtain high spatial-temporal resolution data. However, most existing VSR methods mainly focus on the local interframe information during feature alignment, which lack the ability to model long-distance correspondence. In this letter, a novel two-branch alignment network with an efficient fusion module is proposed for satellite VSR. Both deformable convolution (DCN) and transformer-like attention are employed to fully explore the local and global information between frames. Furthermore, a fusion module is proposed to model the residuals between fusion features and compensate them for better fusion. Experiments on Jilin-1 satellite videos demonstrate that the proposed network can achieve comparable results to current state-of-the-art (SOTA) VSR methods with tiny parameters.
引用
收藏
页数:5
相关论文
共 16 条
  • [1] BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyond
    Chan, Kelvin C. K.
    Wang, Xintao
    Yu, Ke
    Dong, Chao
    Loy, Chen Change
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4945 - 4954
  • [2] Chan KCK, 2021, AAAI CONF ARTIF INTE, V35, P973
  • [3] Chan Kelvin CK, 2022, P IEEE CVF C COMP VI, P5972
  • [4] Recurrent Back-Projection Network for Video Super-Resolution
    Haris, Muhammad
    Shakhnarovich, Greg
    Ukita, Norimichi
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3892 - 3901
  • [5] Deep Back-Projection Networks For Super-Resolution
    Haris, Muhammad
    Shakhnarovich, Greg
    Ukita, Norimichi
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1664 - 1673
  • [6] Multiframe Video Satellite Image Super-Resolution via Attention-Based Residual Learning
    He, Zhi
    Li, Jun
    Liu, Lin
    He, Dan
    Xiao, Man
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] Edge-Enhanced GAN for Remote Sensing Image Superresolution
    Jiang, Kui
    Wang, Zhongyuan
    Yi, Peng
    Wang, Guangcheng
    Lu, Tao
    Jiang, Junjun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (08): : 5799 - 5812
  • [8] Deep Video Super-Resolution Network Using Dynamic Upsampling Filters Without Explicit Motion Compensation
    Jo, Younghyun
    Oh, Seoung Wug
    Kang, Jaeyeon
    Kim, Seon Joo
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3224 - 3232
  • [9] Liang JY, 2022, Arxiv, DOI arXiv:2201.12288
  • [10] Video super-resolution based on deep learning: a comprehensive survey
    Liu, Hongying
    Ruan, Zhubo
    Zhao, Peng
    Dong, Chao
    Shang, Fanhua
    Liu, Yuanyuan
    Yang, Linlin
    Timofte, Radu
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (08) : 5981 - 6035