Blind cloud and cloud shadow removal of multitemporal images based on total variation regularized low-rank sparsity decomposition

被引:70
作者
Chen, Yong [1 ,2 ]
He, Wei [2 ]
Yokoya, Naoto [2 ,3 ]
Huang, Ting-Zhu [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Math Sci, Res Ctr Image & Vis Comp, Chengdu 611731, Sichuan, Peoples R China
[2] RIKEN, Ctr Adv Intelligence Project AIP, Geoinformat Unit, Tokyo 1030027, Japan
[3] Tokyo Univ Agr & Technol, Dept Elect & Elect Engn, Tokyo 1838538, Japan
基金
日本学术振兴会;
关键词
Cloud/shadow removal; Multitemporal images; Low-rank and sparsity; Total variation; Alternating direction method of multipliers; REMOTE-SENSING IMAGES; RECONSTRUCTION; RECOVERY;
D O I
10.1016/j.isprsjprs.2019.09.003
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Cloud and cloud shadow (cloud/shadow) removal from multitemporal satellite images is a challenging task and has elicited much attention for subsequent information extraction. Regarding cloud/shadow areas as missing information, low-rank matrix/tensor completion based methods are popular to recover information undergoing cloud/shadow degradation. However, existing methods required to determine the cloud/shadow locations in advance and failed to completely use the latent information in cloud/shadow areas. In this study, we propose a blind cloud/shadow removal method for time-series remote sensing images by unifying cloud/shadow detection and removal together. First, we decompose the degraded image into low-rank clean image (surface-reflected) component and sparse (cloud/shadow) component, which can simultaneously and completely use the underlying characteristics of these two components. Meanwhile, the spatial -spectral total variation regularization is introduced to promote the spatial-spectral continuity of the cloud/shadow component. Second, the cloud/shadow locations are detected from the sparse component using a threshold method. Finally, we adopt the cloud/shadow detection results to guide the information compensation from the original observed images to better preserve the information in cloud/shadow-free locations. The problem of the proposed model is efficiently addressed using the alternating direction method of multipliers. Both simulated and real datasets are performed to demonstrate the effectiveness of our method for cloud/shadow detection and removal when compared with other state-of-the-art methods.
引用
收藏
页码:93 / 107
页数:15
相关论文
共 47 条
[1]  
[Anonymous], FOUND TRENDS MACH LE
[2]   Contextual spatiospectral postreconstruction of cloud-contaminated images [J].
Benabdelkader, Soliad ;
Melgani, Farid .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2008, 5 (02) :204-208
[3]   The Power of Convex Relaxation: Near-Optimal Matrix Completion [J].
Candes, Emmanuel J. ;
Tao, Terence .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (05) :2053-2080
[4]   Total Variation Regularized Tensor RPCA for Background Subtraction From Compressive Measurements [J].
Cao, Wenfei ;
Wang, Yao ;
Sun, Jian ;
Meng, Deyu ;
Yang, Can ;
Cichocki, Andrzej ;
Xu, Zongben .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (09) :4075-4090
[5]   Spatially and Temporally Weighted Regression: A Novel Method to Produce Continuous Cloud-Free Landsat Imagery [J].
Chen, Bin ;
Huang, Bo ;
Chen, Lifan ;
Xu, Bing .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (01) :27-37
[6]   Destriping of Multispectral Remote Sensing Image Using Low-Rank Tensor Decomposition [J].
Chen, Yong ;
Huang, Ting-Zhu ;
Zhao, Xi-Le .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (12) :4950-4967
[7]   Group sparsity based regularization model for remote sensing image stripe noise removal [J].
Chen, Yong ;
Huang, Ting-Zhu ;
Deng, Liang-Jian ;
Zhao, Xi-Le ;
Wang, Min .
NEUROCOMPUTING, 2017, 267 :95-106
[8]   Stripe Noise Removal of Remote Sensing Images by Total Variation Regularization and Group Sparsity Constraint [J].
Chen, Yong ;
Huang, Ting-Zhu ;
Zhao, Xi-Le ;
Deng, Liang-Jian ;
Huang, Jie .
REMOTE SENSING, 2017, 9 (06)
[9]   Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal MRF model [J].
Cheng, Qing ;
Shen, Huanfeng ;
Zhang, Liangpei ;
Yuan, Qiangqiang ;
Zeng, Chao .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 92 :54-68
[10]   Improvement of the Fmask algorithm for Sentinel-2 images: Separating clouds from bright surfaces based on parallax effects [J].
Frantz, David ;
Hass, Erik ;
Uhl, Andreas ;
Stoffels, Johannes ;
Hill, Joachim .
REMOTE SENSING OF ENVIRONMENT, 2018, 215 :471-481