MCWESRGAN: Improving Enhanced Super-Resolution Generative Adversarial Network for Satellite Images

被引:4
|
作者
Karwowska, Kinga [1 ]
Wierzbicki, Damian [1 ]
机构
[1] Mil Univ Technol, Fac Civil Engn & Geodesy, Dept Imagery Intelligence, PL-00908 Warsaw, Poland
关键词
Spatial resolution; Training; Generators; Superresolution; Generative adversarial networks; Satellite images; Computational modeling; Convolutional neural networks; deep learning; enhanced super-resolution generative adversarial network (ESRGAN); neural networks; power spectral density (PSD); single-image super-resolution (SISR); super resolution (SR); RESOLUTION;
D O I
10.1109/JSTARS.2023.3322642
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the dynamic technological development, we are witnessing a major progress in solutions that allow for the observation of Earth's surface. Small satellites have a significant drawback. Due to their limitations, the installed optic systems are not perfect. As a result, the quality of the obtained images is lower, including lower resolution, although the satellites move on the Low Earth Orbit. In the case of images lacking a high-resolution counterpart, the spatial resolution of the imagery can be improved using single-image super-resolution algorithms. In this article, we present an SISR solution based on a new network called MCWESRGAN, which is a modification of the popular ESRGAN network. We propose a novel strategy that introduces a multi-column discriminator model. The generator model is trained using Wasserstein loss. The introduced modifications enable a tenfold reduction in the training time of the network. The proposed algorithm is verified using images obtained from space, aerial imagery, and the Dataset for Object deTection in Aerial Images (DOTA) database. A set of evaluation methods for super-resolution (SR) images is proposed to verify the results. These evaluation methods indicate areas that are poorly estimated by the algorithm. Furthermore, as part of the conducted experiments, an absolute assessment method for interpretational potential based on the power spectral density of the image (PSD) is proposed, allowing for determining the magnitude of interpretational improvement after applying resolution enhancement algorithms. The conducted research demonstrates that we achieve better qualitative and quantitative results than classical ESRGAN methods and other state-of-the-art (SOTA) approaches.
引用
收藏
页码:9886 / 9906
页数:21
相关论文
共 50 条
  • [1] Super-Resolution Reconstruction Algorithm of Images Based on Improved Enhanced Super-Resolution Generative Adversarial Network
    Xin Yuanxue
    Zhu Fengting
    Shi Pengfei
    Yang Xin
    Zhou Runkang
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (04)
  • [2] ESRGAN plus : FURTHER IMPROVING ENHANCED SUPER-RESOLUTION GENERATIVE ADVERSARIAL NETWORK
    Rakotonirina, Nathanael Carraz
    Rasoanaivo, Andry
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 3637 - 3641
  • [3] Lightweight Super-Resolution Generative Adversarial Network for SAR Images
    Jiang, Nana
    Zhao, Wenbo
    Wang, Hui
    Luo, Huiqi
    Chen, Zezhou
    Zhu, Jubo
    REMOTE SENSING, 2024, 16 (10)
  • [4] Recovering Super-Resolution Generative Adversarial Network for Underwater Images
    Chen, Yang
    Sun, Jinxuan
    Jiao, Wencong
    Zhong, Guoqiang
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT IV, 2019, 1142 : 75 - 83
  • [5] PathSRGAN: Multi-Supervised Super-Resolution for Cytopathological Images Using Generative Adversarial Network
    Ma, Jiabo
    Yu, Jingya
    Liu, Sibo
    Chen, Li
    Li, Xu
    Feng, Jie
    Chen, Zhixing
    Zeng, Shaoqun
    Liu, Xiuli
    Cheng, Shenghua
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (09) : 2920 - 2930
  • [6] Enhanced image super-resolution using hierarchical generative adversarial network
    Zhao, Jianwei
    Fang, Chenyun
    Zhou, Zhenghua
    INTERNATIONAL JOURNAL OF COMPUTING SCIENCE AND MATHEMATICS, 2022, 15 (03) : 243 - 257
  • [7] Multiattention Generative Adversarial Network for Remote Sensing Image Super-Resolution
    Jia, Sen
    Wang, Zhihao
    Li, Qingquan
    Jia, Xiuping
    Xu, Meng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Spatial Transformer Generative Adversarial Network for Robust Image Super-Resolution
    Kasem, Hossam M.
    Hung, Kwok-Wai
    Jiang, Jianmin
    IEEE ACCESS, 2019, 7 : 182993 - 183009
  • [9] The Use of a Stable Super-Resolution Generative Adversarial Network (SSRGAN) on Remote Sensing Images
    Pang, Boyu
    Zhao, Siwei
    Liu, Yinnian
    REMOTE SENSING, 2023, 15 (20)
  • [10] Fast and accurate super-resolution of MR images based on lightweight generative adversarial network
    Hangyu Li
    Zuxing Xuan
    Jianpin Zhou
    Xiyuan Hu
    Bo Yang
    Multimedia Tools and Applications, 2023, 82 : 2465 - 2487