Unsupervised missing information reconstruction for single remote sensing image with Deep Code Regression

被引:26
作者
Gao, Jianhao [1 ]
Yuan, Qiangqiang [1 ]
Li, Jie [1 ]
Su, Xin [2 ]
机构
[1] Wuhan Univ, Sch Geodesy & Geomat, Wuhan, Peoples R China
[2] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep network; Unsupervised optimization; Reconstruction; Enhancement; CLOUD REMOVAL; EARTH OBSERVATION; THICK CLOUDS; TIME-SERIES; MODELS;
D O I
10.1016/j.jag.2021.102599
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Remote sensing images have been applied to many aspects in Earth observation work. However, tons of optical remote sensing images are abandoned due to the information loss caused by the clouds and damage of sensing instruments. Recently, many deep learning methods have been proposed to reconstruct the missing information of remote sensing images but they will be non-effective when it comes to the condition where there is no training dataset. In this paper, we propose an unsupervised method which can reconstruct single remote sensing image without training datasets in a deep neural network. The main idea is to process a reference image of the corrupted image with a deep self-regression network and extract the internal map, which possesses the same spatial information as the reference image. The residual information of the corrupted image is used to constrain the spectral authority of internal map to obtain the reconstruction results. We apply the proposed method in three conditions: 1) dead pixel reconstruction, 2) multitemporal reconstruction and 3) heterogeneous data reconstruction. We conduct simulation experiments and real data experiments in three conditions to confirm the superiority of our methods. The results show that the proposed method outperforms some state-of-the-art algorithms.
引用
收藏
页数:10
相关论文
共 49 条
[1]  
Abdal R., 2020, P IEEE CVF C COMP VI, P8296
[2]   Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space? [J].
Abdal, Rameen ;
Qin, Yipeng ;
Wonka, Peter .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :4431-4440
[3]   Filling-in by joint interpolation of vector fields and gray levels [J].
Ballester, C ;
Bertalmio, M ;
Caselles, V ;
Sapiro, G ;
Verdera, J .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (08) :1200-1211
[4]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[5]   A Comprehensive Framework for Image Inpainting [J].
Bugeau, Aurelie ;
Bertalmio, Marcelo ;
Caselles, Vicent ;
Sapiro, Guillermo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (10) :2634-2645
[6]   Nontexture inpainting by curvature-driven diffusions [J].
Chan, TF .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2001, 12 (04) :436-449
[7]   Mathematical models for local nontexture inpaintings [J].
Chan, TF ;
Shen, JH .
SIAM JOURNAL ON APPLIED MATHEMATICS, 2002, 62 (03) :1019-1043
[8]   A simple method for reconstructing a high-quality NDVI time-series data set based on the Savitzky-Golay filter [J].
Chen, J ;
Jönsson, P ;
Tamura, M ;
Gu, ZH ;
Matsushita, B ;
Eklundh, L .
REMOTE SENSING OF ENVIRONMENT, 2004, 91 (3-4) :332-344
[9]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[10]   Region filling and object removal by exemplar-based image inpainting [J].
Criminisi, A ;
Pérez, P ;
Toyama, K .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (09) :1200-1212