Reference-Based Super-Resolution Network for Remote Sensing Image via Position-Constraint

被引:0
|
作者
Yang J. [1 ]
Yang F. [1 ]
Yue H. [1 ]
机构
[1] School of Electrical and Information Engineering, Tianjin University, Tianjin
来源
Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology | 2023年 / 56卷 / 04期
基金
中国国家自然科学基金;
关键词
channel attention; position encoding; remote sensing image; single image super-resolution;
D O I
10.11784/tdxbz202109030
中图分类号
学科分类号
摘要
Monitoring ecological and geological environments with high-resolution(HR)images for long time series is useful in remote sensing. However,capturing HR images for long time series is difficult. Therefore,most previous works reconstructed HR images by single image super-resolution(SR) algorithm. The visual results of these methods are smooth due to limited information in single low-resolution(LR)images. Because multiple observations of the same region are typically captured by different satellites at different times,the HR images can be used as references for the target LR images. Thus,we proposed performing reference-based super-resolution network for remote sensing images by imposing constraints on matching positions. First,a position-encoding-based transformer was used to match and transfer the HR reference details to the LR input in the feature space. The position-constraint strategy was implemented by calculating the polymerization degree of similar patches corresponding to the neighboring LR pixels. The position encoding significantly improved the matching accuracy. Second,a multiscale adaptive fusion module based on channel attention was proposed to improve the feature representation for SR image reconstruction. Experimental results demonstrate that our model outperforms other cutting-edge SR approaches at both 4×and 8×SR. © 2023 Tianjin University. All rights reserved.
引用
收藏
页码:372 / 380
页数:8
相关论文
共 23 条
  • [1] Liu Q,, Trinder J C,, Turner I L., Automatic super-resolution shoreline change monitoring using Landsat archival data : A case study at Narrabeen-Collaroy Beach,Australia[J], Journal of Applied Remote Sensing, 11, 1, (2017)
  • [2] Li P,, Ke Y,, Wang D,, Et al., Human impact on suspended particulate matter in the Yellow River Estuary,China:Evidence from remote sensing data fusion using an improved spatiotemporal fusion method[J], Science of the Total Environment, 750, (2021)
  • [3] Chen M,, Ke Y,, Bai J,, Et al., Monitoring early stage invasion of exotic spartina alterniflora using deep-learning super-resolution techniques based on multisource high-resolution satellite imagery:A case study in the Yellow River Delta,China[J], International Journal of Applied Earth Observation and Geoinformation, 92, (2020)
  • [4] Dong R,, Zhang L,, Fu H., RRSGAN:Reference-based super-resolution for remote sensing image[J], IEEE Transactions on Geoscience and Remote Sensing, 60, (2021)
  • [5] Irani M,, Peleg S., Improving resolution by image registration[J], CVGIP:Graphical Models and Image Processing, 53, 3, pp. 231-239, (1991)
  • [6] Dong C,, Loy C C,, He K,, Et al., Image super-resolution using deep convolutional networks[J], IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 2, pp. 295-307, (2015)
  • [7] Dong C,, Loy C C,, Tang X., Accelerating the super-resolution convolutional neural network[C], European Conference on Computer Vision, pp. 391-407, (2016)
  • [8] Kim J, Lee J K, Lee K M., Accurate image super-resolution using very deep convolutional networks[C], Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1646-1654, (2016)
  • [9] Lim B, Et al., Enhanced deep residual networks for single image super-resolution[C], Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 136-144, (2017)
  • [10] Zhang Y, Et al., Image super-resolution using very deep residual channel attention networks[C], Proceedings of the European Conference on Computer Vision(ECCV), pp. 286-301, (2018)