Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal MRF model

被引:169
作者
Cheng, Qing [1 ]
Shen, Huanfeng [2 ]
Zhang, Liangpei [1 ]
Yuan, Qiangqiang [3 ]
Zeng, Chao [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying, Wuhan 430079, Hubei, Peoples R China
[2] Wuhan Univ, Sch Resource & Environm Sci, Wuhan 430079, Hunan, Peoples R China
[3] Wuhan Univ, Sch Geodesy & Geomat, Wuhan 430079, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Cloud removal; Information reconstruction; Spatio-temporal MRF; Similar pixel replacement; Multitemporal; Remotely sensed image; FUSION; RECONSTRUCTION; REFLECTANCE;
D O I
10.1016/j.isprsjprs.2014.02.015
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Cloud cover is generally present in remotely sensed images, which limits the potential of the images for ground information extraction. Therefore, removing the clouds and recovering the ground information for the cloud-contaminated images is often necessary in many applications. In this paper, an effective method based on similar pixel replacement is developed to solve this task. A missing pixel is filled using an appropriate similar pixel within the remaining region of the target image. A multitemporal image is used as the guidance to locate the similar pixels. A pixel-offset based spatio-temporal Markov random fields (MRF) global function is built to find the most suitable similar pixel. The proposed method was tested on MODIS and Landsat images and their land surface temperature products, and the experiments verify that the proposed method can achieve highly accurate results and is effective at dealing with the obvious atmospheric and seasonal differences between multitemporal images. (C) 2014 International Society for Photogrammety and Remote Sensing, Inc. (ISPRS) Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:54 / 68
页数:15
相关论文
共 39 条
[1]   Fast approximate energy minimization via graph cuts [J].
Boykov, Y ;
Veksler, O ;
Zabih, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (11) :1222-1239
[3]   A simple and effective method for filling gaps in Landsat ETM plus SLC-off images [J].
Chen, Jin ;
Zhu, Xiaolin ;
Vogelmann, James E. ;
Gao, Feng ;
Jin, Suming .
REMOTE SENSING OF ENVIRONMENT, 2011, 115 (04) :1053-1064
[4]   Inpainting for Remotely Sensed Images With a Multichannel Nonlocal Total Variation Model [J].
Cheng, Qing ;
Shen, Huanfeng ;
Zhang, Liangpei ;
Li, Pingxiang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (01) :175-187
[5]   Region filling and object removal by exemplar-based image inpainting [J].
Criminisi, A ;
Pérez, P ;
Toyama, K .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) :1200-1212
[6]   Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA) [J].
Elad, M ;
Starck, JL ;
Querre, P ;
Donoho, DL .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2005, 19 (03) :340-358
[7]   NONLOCAL OPERATORS WITH APPLICATIONS TO IMAGE PROCESSING [J].
Gilboa, Guy ;
Osher, Stanley .
MULTISCALE MODELING & SIMULATION, 2008, 7 (03) :1005-1028
[8]   Quantitative Restoration for MODIS Band 6 on Aqua [J].
Gladkova, Irina ;
Grossberg, Michael D. ;
Shahriar, Fazlul ;
Bonev, George ;
Romanov, Peter .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2012, 50 (06) :2409-2416
[9]   Statistics of Patch Offsets for Image Completion [J].
He, Kaiming ;
Sun, Jian .
COMPUTER VISION - ECCV 2012, PT II, 2012, 7573 :16-29
[10]   Cloud-free satellite image mosaics with regression trees and histogram matching [J].
Helmer, EH ;
Ruefenacht, B .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2005, 71 (09) :1079-1089