An Evolutionary Shadow Correction Network and a Benchmark UAV Dataset for Remote Sensing Images

被引:14
作者
Luo, Shuang [1 ,2 ]
Li, Huifang [1 ,3 ]
Li, Yiqiu [1 ]
Shao, Chenglin [1 ]
Shen, Huanfeng [1 ,3 ]
Zhang, Liangpei [4 ]
机构
[1] Wuhan Univ, Sch Resource & Environm Sci, Wuhan 430079, Peoples R China
[2] Changjiang Spatial Informat Technol Engn Co Ltd, Wuhan 430010, Peoples R China
[3] Wuhan Univ, Collaborat Innovat Ctr Geospatial Technol, Wuhan 430079, Peoples R China
[4] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Deep learning; evolutionary network; remote sensing; shadow correction; unmanned aerial vehicle (UAV) image dataset; RESOLUTION SATELLITE IMAGERY; URBAN AREAS; REMOVAL; RECONSTRUCTION; PHOTOGRAMMETRY; COMPENSATION; INFORMATION; MODEL;
D O I
10.1109/TGRS.2023.3295450
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Shadow correction is an important task in the analysis of high-resolution remote sensing images, as the existence of shadows reduces radiometric information and causes the changes in the energy distribution. This is especially the case when the spatial resolution is very high, as the shadows disturb the subsequent processing and applications, such as image mosaicking, classification, and segmentation. Traditional shadow correction methods are limited by the shadow detection accuracy and the available nonshaded samples in the imagery. In this article, we propose an evolutionary shadow correction network (ESCNet) and describe how we built a benchmark unmanned aerial vehicle (UAV) image dataset to achieve shadow correction directly, without shadow detection. The proposed ESCNet is made up of two subnetworks with an evolutionary relationship: a shadow removal network (SRNet) followed by a radiation adjustment network (RANet). The shadows are first removed by SRNet trained on the UAV image dataset to achieve the primary shadow-corrected image, and the global radiation is then adjusted to a sunlit-like status by RANet. Shadow detection is not required in the proposed method, which effectively overcomes the error accumulation and shadow edge artifact problem of the traditional methods. Experiments were carried out and the results were compared with those of both traditional and deep learning-based shadow correction methods, for which both qualitative and quantitative evaluations were performed. The results suggest that the proposed method shows obvious advantages in information recovery for shadow regions, and the global brightness of the corrected imagery is consistent with that of sunlit conditions.
引用
收藏
页数:14
相关论文
共 52 条
[1]   Modified invariant colour model for shadow detection [J].
Besheer, Mohamed ;
Abdelhafiz, Ahmed .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2015, 36 (24) :6214-6223
[2]   High accuracy optical flow estimation based on a theory for warping [J].
Brox, T ;
Bruhn, A ;
Papenberg, N ;
Weickert, J .
COMPUTER VISION - ECCV 2004, PT 4, 2004, 2034 :25-36
[3]   Shadow information recovery in urban areas from very high resolution satellite imagery [J].
Chen, Y. ;
Wen, D. ;
Jing, L. ;
Shi, P. .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2007, 28 (15) :3249-3254
[4]   Unmanned aerial systems for photogrammetry and remote sensing: A review [J].
Colomina, I. ;
Molina, P. .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 92 :79-97
[5]   Shadow analysis in high-resolution satellite imagery of urban areas [J].
Dare, PM .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2005, 71 (02) :169-177
[6]   ARGAN: Attentive Recurrent Generative Adversarial Network for Shadow Detection and Removal [J].
Ding, Bin ;
Long, Chengjiang ;
Zhang, Ling ;
Xiao, Chunxia .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :10212-10221
[7]   On the removal of shadows from images [J].
Finlayson, GD ;
Hordley, SD ;
Lu, C ;
Drew, MS .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (01) :59-68
[8]  
Finlayson GD, 2002, LECT NOTES COMPUT SC, V2353, P823
[9]   Entropy Minimization for Shadow Removal [J].
Finlayson, Graham D. ;
Drew, Mark S. ;
Lu, Cheng .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2009, 85 (01) :35-57
[10]   RANDOM SAMPLE CONSENSUS - A PARADIGM FOR MODEL-FITTING WITH APPLICATIONS TO IMAGE-ANALYSIS AND AUTOMATED CARTOGRAPHY [J].
FISCHLER, MA ;
BOLLES, RC .
COMMUNICATIONS OF THE ACM, 1981, 24 (06) :381-395