Deep and Low-Rank Quaternion Priors for Color Image Processing

被引:17
作者
Xu, Tingting [1 ]
Kong, Xiaoyu [1 ]
Shen, Qiangqiang [2 ]
Chen, Yongyong [1 ,3 ]
Zhou, Yicong [4 ]
机构
[1] Harbin Inst Technol Shenzhen, Sch Comp Sci & Technol, Shenzhen 518055, Peoples R China
[2] Harbin Inst Technol Shenzhen, Sch Elect & Informat Engn, Shenzhen 518055, Peoples R China
[3] Guangdong Prov Key Lab Novel Secur Intelligence T, Shenzhen 518055, Peoples R China
[4] Univ Macau, Dept Comp & Informat Sci, Macau, Macau, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-rank quaternion representation; deep prior; plug-and-play; color image denoising; color image inpainting; NUCLEAR NORM; SPARSE REPRESENTATION; RESTORATION; FACTORIZATION; COMPLETION;
D O I
10.1109/TCSVT.2022.3233589
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to the physical nature of color images, color image processing such as denoising and inpainting has shown extensive and versatile possibilities over grayscale image processing. The monochromatic and the concatenation model have been widely used to process color images by processing each color channel independently or concatenating three color channels as one unified one and then used existing grayscale image processing methods directly without specific operations. These above schemes, however, have some limitations: (1) they would destroy the inherent correlation among three color channels since they cannot represent color images holistically; (2) they usually focus on one specific handcrafted prior such as smoothness, low-rankness, or even deep prior and thus failing to fuse deep and handcrafted priors of color images flexibly. To conquer these limitations, we propose one unified model to integrate deep prior and low-rank quaternion prior (DLRQP) for color image processing under the plug-and-play (PnP) framework. Specifically, the quaternion representation with low-rank constraint is introduced to denote the color image in a holistic way and one advanced denoiser is adopted to explore the deep prior in an iterative process. To tightly approximate the quaternion rank, one nonconvex penalty function is further utilized. We derive an alternate iterative approach to tackle the proposed model. We empirically demonstrate that our model can achieve superior performance over existing methods on both color image denoising and inpainting tasks.
引用
收藏
页码:3119 / 3132
页数:14
相关论文
共 76 条
[1]   Efficient Tensor Completion for Color Image and Video Recovery: Low-Rank Tensor Train [J].
Bengua, Johann A. ;
Phien, Ho N. ;
Hoang Duong Tuan ;
Do, Minh N. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (05) :2466-2479
[2]   Exact Matrix Completion via Convex Optimization [J].
Candes, Emmanuel J. ;
Recht, Benjamin .
FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2009, 9 (06) :717-772
[3]   Quaternion Zernike moments and their invariants for color image analysis and object recognition [J].
Chen, B. J. ;
Shu, H. Z. ;
Zhang, H. ;
Chen, G. ;
Toumoulin, C. ;
Dillenseger, J. L. ;
Luo, L. M. .
SIGNAL PROCESSING, 2012, 92 (02) :308-318
[4]   An Efficient Statistical Method for Image Noise Level Estimation [J].
Chen, Guangyong ;
Zhu, Fengyuan ;
Heng, Pheng Ann .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :477-485
[5]   Generalized Nonconvex Low-Rank Tensor Approximation for Multi-View Subspace Clustering [J].
Chen, Yongyong ;
Wang, Shuqin ;
Peng, Chong ;
Hua, Zhongyun ;
Zhou, Yicong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :4022-4035
[6]   Low-Rank Quaternion Approximation for Color Image Processing [J].
Chen, Yongyong ;
Xiao, Xiaolin ;
Zhou, Yicong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :1426-1439
[7]   Denoising of Hyperspectral Images Using Nonconvex Low Rank Matrix Approximation [J].
Chen, Yongyong ;
Guo, Yanwen ;
Wang, Yongli ;
Wang, Dong ;
Peng, Chong ;
He, Guoping .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (09) :5366-5380
[8]   Color image denoising via sparse 3d collaborative filtering with grouping constraint in luminance-chrominance space [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, :313-316
[9]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[10]   Tensor low-rank sparse representation for tensor subspace learning [J].
Du, Shiqiang ;
Shi, Yuqing ;
Shan, Guangrong ;
Wang, Weilan ;
Ma, Yide .
NEUROCOMPUTING, 2021, 440 :351-364