MCWESRGAN: Improving Enhanced Super-Resolution Generative Adversarial Network for Satellite Images

被引:4
|
作者
Karwowska, Kinga [1 ]
Wierzbicki, Damian [1 ]
机构
[1] Mil Univ Technol, Fac Civil Engn & Geodesy, Dept Imagery Intelligence, PL-00908 Warsaw, Poland
关键词
Spatial resolution; Training; Generators; Superresolution; Generative adversarial networks; Satellite images; Computational modeling; Convolutional neural networks; deep learning; enhanced super-resolution generative adversarial network (ESRGAN); neural networks; power spectral density (PSD); single-image super-resolution (SISR); super resolution (SR); RESOLUTION;
D O I
10.1109/JSTARS.2023.3322642
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the dynamic technological development, we are witnessing a major progress in solutions that allow for the observation of Earth's surface. Small satellites have a significant drawback. Due to their limitations, the installed optic systems are not perfect. As a result, the quality of the obtained images is lower, including lower resolution, although the satellites move on the Low Earth Orbit. In the case of images lacking a high-resolution counterpart, the spatial resolution of the imagery can be improved using single-image super-resolution algorithms. In this article, we present an SISR solution based on a new network called MCWESRGAN, which is a modification of the popular ESRGAN network. We propose a novel strategy that introduces a multi-column discriminator model. The generator model is trained using Wasserstein loss. The introduced modifications enable a tenfold reduction in the training time of the network. The proposed algorithm is verified using images obtained from space, aerial imagery, and the Dataset for Object deTection in Aerial Images (DOTA) database. A set of evaluation methods for super-resolution (SR) images is proposed to verify the results. These evaluation methods indicate areas that are poorly estimated by the algorithm. Furthermore, as part of the conducted experiments, an absolute assessment method for interpretational potential based on the power spectral density of the image (PSD) is proposed, allowing for determining the magnitude of interpretational improvement after applying resolution enhancement algorithms. The conducted research demonstrates that we achieve better qualitative and quantitative results than classical ESRGAN methods and other state-of-the-art (SOTA) approaches.
引用
收藏
页码:9886 / 9906
页数:21
相关论文
共 50 条
  • [31] Unsupervised Change Detection in Satellite Images With Generative Adversarial Network
    Ren, Caijun
    Wang, Xiangyu
    Gao, Jian
    Zhou, Xiren
    Chen, Huanhuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (12): : 10047 - 10061
  • [32] Super-resolution with generative adversarial networks for improved object detection in aerial images
    Haykir, Aslan Ahmet
    Oksuz, Ilkay
    INFORMATION DISCOVERY AND DELIVERY, 2023, 51 (04) : 349 - 357
  • [33] Dual stage semantic information based generative adversarial network for image super-resolution
    Sharma, Shailza
    Dhall, Abhinav
    Johri, Shikhar
    Kumar, Vinay
    Singh, Vivek
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2025, 250
  • [34] Image Super-Resolution Reconstruction Algorithm Based on Improved Enhanced Generative Adversarial Network
    She, Xiangyang
    Yang, Qinghao
    PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON CRYPTOGRAPHY, NETWORK SECURITY AND COMMUNICATION TECHNOLOGY, CNSCT 2024, 2024, : 644 - 651
  • [35] License Plate Image Resolution Enhancement Using Super-Resolution Generative Adversarial Network
    Mei, Yuzheng
    Moelter, Mark
    Haddad, Rami J.
    SOUTHEASTCON 2024, 2024, : 1262 - 1267
  • [36] Improved generative adversarial network for retinal image super-resolution
    Qiu, Defu
    Cheng, Yuhu
    Wang, Xuesong
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2022, 225
  • [37] Agricultural Pest Super-Resolution and Identification With Attention Enhanced Residual and Dense Fusion Generative and Adversarial Network
    Dai, Qiang
    Cheng, Xi
    Qiao, Yan
    Zhang, Youhua
    IEEE ACCESS, 2020, 8 (08): : 81943 - 81959
  • [38] Image Super-Resolution using a Improved Generative Adversarial Network
    Wang, Han
    Wu, Wei
    Su, Yang
    Duan, Yongsheng
    Wang, Pengze
    PROCEEDINGS OF 2019 IEEE 9TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC 2019), 2019, : 312 - 315
  • [39] A lightweight generative adversarial network for single image super-resolution
    Xinbiao Lu
    Xupeng Xie
    Chunlin Ye
    Hao Xing
    Zecheng Liu
    Changchun Cai
    The Visual Computer, 2024, 40 : 41 - 52
  • [40] A lightweight generative adversarial network for single image super-resolution
    Lu, Xinbiao
    Xie, Xupeng
    Ye, Chunlin
    Xing, Hao
    Liu, Zecheng
    Cai, Changchun
    VISUAL COMPUTER, 2024, 40 (01) : 41 - 52