Non-Local Meets Global: An Iterative Paradigm for Hyperspectral Image Restoration

被引:199
作者
He, Wei [1 ]
Yao, Quanming [2 ,3 ]
Li, Chao [1 ]
Yokoya, Naoto [1 ,4 ]
Zhao, Qibin [1 ,5 ]
Zhang, Hongyan [6 ]
Zhang, Liangpei [6 ]
机构
[1] RIKEN, Ctr Adv Intelligence Project AIP, Tokyo 1030027, Japan
[2] Tsinghua Univ, Dept Elect Engn, Beijing 100083, Peoples R China
[3] 4Paradigm Inc, Beijing 100083, Peoples R China
[4] Univ Tokyo, Grad Sch Frontier Sci, Chiba 2778561, Japan
[5] Guangdong Univ Technol, Guangzhou 510006, Peoples R China
[6] Wuhan Univ, LISMARS, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金; 日本学术振兴会;
关键词
Image restoration; Noise reduction; Tensile stress; Correlation; Task analysis; Image reconstruction; Image coding; Hyperspectral image; denoising; image restoration; non-local image modeling; low-rank tensor; MATRIX FACTORIZATION; FACE RECOGNITION; SPARSITY; RECONSTRUCTION; REPRESENTATION; MINIMIZATION; ALGORITHM; MODEL;
D O I
10.1109/TPAMI.2020.3027563
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Non-local low-rank tensor approximation has been developed as a state-of-the-art method for hyperspectral image (HSI) restoration, which includes the tasks of denoising, compressed HSI reconstruction and inpainting. Unfortunately, while its restoration performance benefits from more spectral bands, its runtime also substantially increases. In this paper, we claim that the HSI lies in a global spectral low-rank subspace, and the spectral subspaces of each full band patch group should lie in this global low-rank subspace. This motivates us to propose a unified paradigm combining the spatial and spectral properties for HSI restoration. The proposed paradigm enjoys performance superiority from the non-local spatial denoising and light computation complexity from the low-rank orthogonal basis exploration. An efficient alternating minimization algorithm with rank adaptation is developed. It is done by first solving a fidelity term-related problem for the update of a latent input image, and then learning a low-dimensional orthogonal basis and the related reduced image from the latent input image. Subsequently, non-local low-rank denoising is developed to refine the reduced image and orthogonal basis iteratively. Finally, the experiments on HSI denoising, compressed reconstruction, and inpainting tasks, with both simulated and real datasets, demonstrate its superiority with respect to state-of-the-art HSI restoration methods.
引用
收藏
页码:2089 / 2107
页数:19
相关论文
共 91 条
[1]   The DC (difference of convex functions) programming and DCA revisited with DC models of real world nonconvex optimization problems [J].
An, LTH ;
Tao, PD .
ANNALS OF OPERATIONS RESEARCH, 2005, 133 (1-4) :23-46
[2]  
[Anonymous], 2013, PROC C ADV NEURAL IN
[3]   Compressive Coded Aperture Spectral Imaging [J].
Arce, Gonzalo R. ;
Brady, David J. ;
Carin, Lawrence ;
Arguello, Henry ;
Kittle, David S. .
IEEE SIGNAL PROCESSING MAGAZINE, 2014, 31 (01) :105-115
[4]   Nonlocal Similarity Based Nonnegative Tucker Decomposition for Hyperspectral Image Denoising [J].
Bai, Xiao ;
Xu, Fan ;
Zhou, Lei ;
Xing, Yan ;
Bai, Lu ;
Zhou, Jun .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (03) :701-712
[5]   THE PROXIMAL AVERAGE: BASIC THEORY [J].
Bauschke, Heinz H. ;
Goebel, Rafal ;
Lucet, Yves ;
Wang, Xianfu .
SIAM JOURNAL ON OPTIMIZATION, 2008, 19 (02) :766-785
[6]   Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches [J].
Bioucas-Dias, Jose M. ;
Plaza, Antonio ;
Dobigeon, Nicolas ;
Parente, Mario ;
Du, Qian ;
Gader, Paul ;
Chanussot, Jocelyn .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2012, 5 (02) :354-379
[7]   Hyperspectral subspace identification [J].
Bioucas-Dias, Jose M. ;
Nascimento, Jose M. P. .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2008, 46 (08) :2435-2445
[8]   Hyperspectral Image Denoising via Subspace-Based Nonlocal Low-Rank and Sparse Factorization [J].
Cao, Chunhong ;
Yu, Jie ;
Zhou, Chengyao ;
Hu, Kai ;
Xiao, Fen ;
Gao, Xieping .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (03) :973-988
[9]   Total Variation Regularized Tensor RPCA for Background Subtraction From Compressive Measurements [J].
Cao, Wenfei ;
Wang, Yao ;
Sun, Jian ;
Meng, Deyu ;
Yang, Can ;
Cichocki, Andrzej ;
Xu, Zongben .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (09) :4075-4090
[10]   Robust Low-Rank Matrix Factorization Under General Mixture Noise Distributions [J].
Cao, Xiangyong ;
Zhao, Qian ;
Meng, Deyu ;
Chen, Yang ;
Xu, Zongben .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (10) :4677-4690