Nonlocal Tensor Completion for Multitemporal Remotely Sensed Images' Inpainting

被引:76
作者
Ji, Teng-Yu [1 ]
Yokoya, Naoto [2 ,3 ,4 ]
Zhu, Xiao Xiang [3 ,4 ]
Huang, Ting-Zhu [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Math Sci, Chengdu 610054, Sichuan, Peoples R China
[2] Univ Tokyo, Dept Adv Interdisciplinary Studies, Tokyo 1538904, Japan
[3] German Aerosp Ctr, Remote Sensing Technol Inst, D-82234 Wessling, Germany
[4] Tech Univ Munich, Signal Proc Earth Observat, D-80333 Munich, Germany
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2018年 / 56卷 / 06期
基金
欧洲研究理事会; 日本学术振兴会;
关键词
Missing information reconstruction; multitemporal remotely sensed images; tensor completion; QUALITY ASSESSMENT; CLASSIFICATION; RECONSTRUCTION; REGULARIZATION; SPARSITY; REMOVAL; MODEL;
D O I
10.1109/TGRS.2018.2790262
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remotely sensed images may contain some missing areas because of poor weather conditions and sensor failure. Information of those areas may play an important role in the interpretation of multitemporal remotely sensed data. This paper aims at reconstructing the missing information by a nonlocal low-rank tensor completion method. First, nonlocal correlations in the spatial domain are taken into account by searching and grouping similar image patches in a large search window. Then, low rankness of the identified fourth-order tensor groups is promoted to consider their correlations in spatial, spectral, and temporal domains, while reconstructing the underlying patterns. Experimental results on simulated and real data demonstrate that the proposed method is effective both qualitatively and quantitatively. In addition, the proposed method is computationally efficient compared with other patch-based methods such as the recently proposed patch matching-based multitemporal group sparse representation method.
引用
收藏
页码:3047 / 3061
页数:15
相关论文
共 66 条
[1]  
[Anonymous], 2010, 100920105055 ARXIV
[2]  
[Anonymous], 2009, Encyclopedia of Distances, DOI [10.1007/978-3-642-00234-2, 10.1007/978-3-642-35943-9_435-1, DOI 10.1007/978-3-642-35943-9_435-1]
[3]   Filling-in by joint interpolation of vector fields and gray levels [J].
Ballester, C ;
Bertalmio, M ;
Caselles, V ;
Sapiro, G ;
Verdera, J .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (08) :1200-1211
[4]   Contextual spatiospectral postreconstruction of cloud-contaminated images [J].
Benabdelkader, Soliad ;
Melgani, Farid .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2008, 5 (02) :204-208
[5]   Joint Sparsity Model for Multilook Hyperspectral Image Unmixing [J].
Bieniarz, J. ;
Aguilera, E. ;
Zhu, X. X. ;
Mueller, R. ;
Reinartz, P. .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2015, 12 (04) :696-700
[6]   Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches [J].
Bioucas-Dias, Jose M. ;
Plaza, Antonio ;
Dobigeon, Nicolas ;
Parente, Mario ;
Du, Qian ;
Gader, Paul ;
Chanussot, Jocelyn .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2012, 5 (02) :354-379
[7]   A Comprehensive Framework for Image Inpainting [J].
Bugeau, Aurelie ;
Bertalmio, Marcelo ;
Caselles, Vicent ;
Sapiro, Guillermo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (10) :2634-2645
[8]   Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal MRF model [J].
Cheng, Qing ;
Shen, Huanfeng ;
Zhang, Liangpei ;
Yuan, Qiangqiang ;
Zeng, Chao .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 92 :54-68
[9]   Inpainting for Remotely Sensed Images With a Multichannel Nonlocal Total Variation Model [J].
Cheng, Qing ;
Shen, Huanfeng ;
Zhang, Liangpei ;
Li, Pingxiang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (01) :175-187
[10]   Region filling and object removal by exemplar-based image inpainting [J].
Criminisi, A ;
Pérez, P ;
Toyama, K .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) :1200-1212