Digital Surface Model Super-Resolution by Integrating High-Resolution Remote Sensing Imagery Using Generative Adversarial Networks

被引:4
作者
Sun, Guihou [1 ]
Chen, Yuehong [1 ]
Huang, Jiamei [1 ]
Ma, Qiang [2 ]
Ge, Yong [3 ]
机构
[1] Hohai Univ, Coll Geog & Remote Sensing, Nanjing 211100, Peoples R China
[2] China Inst Water Resources & Hydropower Res, Res Ctr Flood & Drought Disaster Reduct, Beijing 100038, Peoples R China
[3] Chinese Acad Sci, State Key Lab Resources & Environm Informat Syst, Inst Geog Sci & Nat Resources Res, Beijing 100101, Peoples R China
关键词
Feature extraction; Remote sensing; Generators; Spatial resolution; Surface topography; Digital surface model (DSM); generative adversarial networks (GANs); remote sensing imagery; slope loss; super-resolution (SR); DEM; DSM;
D O I
10.1109/JSTARS.2024.3399544
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Digital surface model (DSM) is the fundamental data in various geoscience applications, such as city 3-D modeling and urban environment analysis. The freely available DSM often suffers from limited spatial resolution. Super-resolution (SR) is a promising technique to increase the spatial resolution of DSM. However, most existing SR models struggle to reconstruct spatial details, such as buildings, valleys, and ridges. This article proposes a novel DSM super-resolution (DSMSR) model that integrates high-resolution remote sensing imagery using generative adversarial networks. The generator in DSMSR contains three modules. The first DSM feature extraction module uses the residual-in-residual dense block to extract features from low-resolution DSM. The second multiscale attention feature extraction module employs the pyramid convolutional residual dense blocks to capture the spatial details of ground objects at multiple scales from remote sensing imagery. The third DSM reconstruction module uses a squeeze-and-excitation block to fuse the extracted features from low-resolution DSM and high-resolution remote sensing imagery for generating SR DSM. The discriminator of DSMSR uses the relativistic average discriminator for adversarial learning. The slope loss is further introduced to ensure the accurate representation of topographic features. We evaluate DSMSR on four different terrain regions in the U.K. to downscale the 30-m AW3D30 DSM to 5-m DSM. The experimental results indicate that DSMSR outperforms the traditional interpolation algorithms and four existing deep-learning-based SR models. The DSMSR restores more spatial detail of topographic features and generates more accurate image quality, elevation, and terrain metrics.
引用
收藏
页码:10636 / 10647
页数:12
相关论文
共 56 条
[1]   Accuracy Assessment of Different Digital Surface Models [J].
Alganci, Ugur ;
Besol, Baris ;
Sertel, Elif .
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2018, 7 (03)
[2]   DTM extraction from DSM using a multi-scale DTM fusion strategy based on deep learning [J].
Amirkolaee, Hamed Amini ;
Arefi, Hossein ;
Ahmadlou, Mohammad ;
Raikwar, Vinay .
REMOTE SENSING OF ENVIRONMENT, 2022, 274
[3]   Terrain Super-resolution through Aerial Imagery and Fully Convolutional Networks [J].
Argudo, O. ;
Chica, A. ;
Andujar, C. .
COMPUTER GRAPHICS FORUM, 2018, 37 (02) :101-110
[4]   Effects of digital terrain model uncertainties on high-resolution urban flood damage assessment [J].
Arrighi, Chiara ;
Campo, Lorenzo .
JOURNAL OF FLOOD RISK MANAGEMENT, 2019, 12
[5]   Automatic identification of utilizable rooftop areas in digital surface models for photovoltaics potential assessment [J].
Aslani, Mohammad ;
Seipel, Stefan .
APPLIED ENERGY, 2022, 306
[6]   Developing reliable urban flood hazard mapping from LiDAR data [J].
Bodoque, Jose M. ;
Aroca-Jimenez, Estefania ;
Eguibar, Miguel A. ;
Garcia, Juan A. .
JOURNAL OF HYDROLOGY, 2023, 617
[7]   Uncovering the rapid expansion of photovoltaic power plants in China from 2010 to 2022 using satellite data and deep learning [J].
Chen, Yuehong ;
Zhou, Jiayue ;
Ge, Yong ;
Dong, Jinwei .
REMOTE SENSING OF ENVIRONMENT, 2024, 305
[8]   Spatiotemporal image fusion using multiscale attention-aware two-stream convolutional neural networks [J].
Chen, Yuehong ;
Ge, Yong .
SCIENCE OF REMOTE SENSING, 2022, 6
[9]   Spatiotemporal Remote Sensing Image Fusion Using Multiscale Two-Stream Convolutional Neural Networks [J].
Chen, Yuehong ;
Shi, Kaixin ;
Ge, Yong ;
Zhou, Ya'nan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[10]   Downscaling Census Data for Gridded Population Mapping With Geographically Weighted Area-to-Point Regression Kriging [J].
Chen, Yuehong ;
Zhang, Ruojing ;
Ge, Yong ;
Jin, Yan ;
Xia, Zelong .
IEEE ACCESS, 2019, 7 :149132-149141