Digital Surface Model Super-Resolution by Integrating High-Resolution Remote Sensing Imagery Using Generative Adversarial Networks

被引:4
作者
Sun, Guihou [1 ]
Chen, Yuehong [1 ]
Huang, Jiamei [1 ]
Ma, Qiang [2 ]
Ge, Yong [3 ]
机构
[1] Hohai Univ, Coll Geog & Remote Sensing, Nanjing 211100, Peoples R China
[2] China Inst Water Resources & Hydropower Res, Res Ctr Flood & Drought Disaster Reduct, Beijing 100038, Peoples R China
[3] Chinese Acad Sci, State Key Lab Resources & Environm Informat Syst, Inst Geog Sci & Nat Resources Res, Beijing 100101, Peoples R China
关键词
Feature extraction; Remote sensing; Generators; Spatial resolution; Surface topography; Digital surface model (DSM); generative adversarial networks (GANs); remote sensing imagery; slope loss; super-resolution (SR); DEM; DSM;
D O I
10.1109/JSTARS.2024.3399544
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Digital surface model (DSM) is the fundamental data in various geoscience applications, such as city 3-D modeling and urban environment analysis. The freely available DSM often suffers from limited spatial resolution. Super-resolution (SR) is a promising technique to increase the spatial resolution of DSM. However, most existing SR models struggle to reconstruct spatial details, such as buildings, valleys, and ridges. This article proposes a novel DSM super-resolution (DSMSR) model that integrates high-resolution remote sensing imagery using generative adversarial networks. The generator in DSMSR contains three modules. The first DSM feature extraction module uses the residual-in-residual dense block to extract features from low-resolution DSM. The second multiscale attention feature extraction module employs the pyramid convolutional residual dense blocks to capture the spatial details of ground objects at multiple scales from remote sensing imagery. The third DSM reconstruction module uses a squeeze-and-excitation block to fuse the extracted features from low-resolution DSM and high-resolution remote sensing imagery for generating SR DSM. The discriminator of DSMSR uses the relativistic average discriminator for adversarial learning. The slope loss is further introduced to ensure the accurate representation of topographic features. We evaluate DSMSR on four different terrain regions in the U.K. to downscale the 30-m AW3D30 DSM to 5-m DSM. The experimental results indicate that DSMSR outperforms the traditional interpolation algorithms and four existing deep-learning-based SR models. The DSMSR restores more spatial detail of topographic features and generates more accurate image quality, elevation, and terrain metrics.
引用
收藏
页码:10636 / 10647
页数:12
相关论文
共 56 条
[11]  
Chen YH, 2018, IEEE T GEOSCI REMOTE, V56, P328, DOI [10.1109/TGRS.2017.2747624, 10.1109/tgrs.2017.2747624]
[12]   Integrating Object Boundary in Super-Resolution Land-Cover Mapping [J].
Chen, Yuehong ;
Ge, Yong ;
Jia, Yuanxin .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (01) :219-230
[13]   CONVOLUTIONAL NEURAL NETWORK BASED DEM SUPER RESOLUTION [J].
Chen, Zixuan ;
Wang, Xuewen ;
Xu, Zekai ;
Hou, Wenguang .
XXIII ISPRS CONGRESS, COMMISSION III, 2016, 41 (B3) :247-250
[14]  
Demiray B.Z, 2021, SN Comput. Sci., V2, P1, DOI DOI 10.1007/S42979-020-00442-2
[15]   D-SRCAGAN : DEM Super-resolution Generative Adversarial Network [J].
Deng, Xiaotong ;
Hua, Weihua ;
Liu, Xiuguo ;
Chen, Siying ;
Zhang, Wen ;
Duan, Jianchao .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19 :1-1
[16]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[17]   The shuttle radar topography mission [J].
Farr, Tom G. ;
Rosen, Paul A. ;
Caro, Edward ;
Crippen, Robert ;
Duren, Riley ;
Hensley, Scott ;
Kobrick, Michael ;
Paller, Mimi ;
Rodriguez, Ernesto ;
Roth, Ladislav ;
Seal, David ;
Shaffer, Scott ;
Shimada, Joanne ;
Umland, Jeffrey ;
Werner, Marian ;
Oskin, Michael ;
Burbank, Douglas ;
Alsdorf, Douglas .
REVIEWS OF GEOPHYSICS, 2007, 45 (02)
[18]   A UAV-derived thermal infrared remote sensing three-temperature model and estimation of various vegetation evapotranspiration in urban micro-environments [J].
Feng, Li ;
Liu, Yanxia ;
Zhou, Yanan ;
Yang, Shaoqi .
URBAN FORESTRY & URBAN GREENING, 2022, 69
[19]   Comparative accuracy of the AW3D30 DSM, ASTER GDEM, and SRTM1 DEM: A case study on the Zaoksky testing ground, Central European Russia [J].
Florinsky, I. V. ;
Skrypitsyna, T. N. ;
Luschikova, O. S. .
REMOTE SENSING LETTERS, 2018, 9 (07) :706-714
[20]   National-scale mapping of building height using Sentinel-1 and Sentinel-2 time series [J].
Frantz, David ;
Schug, Franz ;
Okujeni, Akpona ;
Navacchi, Claudio ;
Wagner, Wolfgang ;
van der Linden, Sebastian ;
Hostert, Patrick .
REMOTE SENSING OF ENVIRONMENT, 2021, 252