Deep and Low-Rank Quaternion Priors for Color Image Processing

被引:17
作者
Xu, Tingting [1 ]
Kong, Xiaoyu [1 ]
Shen, Qiangqiang [2 ]
Chen, Yongyong [1 ,3 ]
Zhou, Yicong [4 ]
机构
[1] Harbin Inst Technol Shenzhen, Sch Comp Sci & Technol, Shenzhen 518055, Peoples R China
[2] Harbin Inst Technol Shenzhen, Sch Elect & Informat Engn, Shenzhen 518055, Peoples R China
[3] Guangdong Prov Key Lab Novel Secur Intelligence T, Shenzhen 518055, Peoples R China
[4] Univ Macau, Dept Comp & Informat Sci, Macau, Macau, Peoples R China
基金
中国国家自然科学基金;
关键词
Low-rank quaternion representation; deep prior; plug-and-play; color image denoising; color image inpainting; NUCLEAR NORM; SPARSE REPRESENTATION; RESTORATION; FACTORIZATION; COMPLETION;
D O I
10.1109/TCSVT.2022.3233589
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to the physical nature of color images, color image processing such as denoising and inpainting has shown extensive and versatile possibilities over grayscale image processing. The monochromatic and the concatenation model have been widely used to process color images by processing each color channel independently or concatenating three color channels as one unified one and then used existing grayscale image processing methods directly without specific operations. These above schemes, however, have some limitations: (1) they would destroy the inherent correlation among three color channels since they cannot represent color images holistically; (2) they usually focus on one specific handcrafted prior such as smoothness, low-rankness, or even deep prior and thus failing to fuse deep and handcrafted priors of color images flexibly. To conquer these limitations, we propose one unified model to integrate deep prior and low-rank quaternion prior (DLRQP) for color image processing under the plug-and-play (PnP) framework. Specifically, the quaternion representation with low-rank constraint is introduced to denote the color image in a holistic way and one advanced denoiser is adopted to explore the deep prior in an iterative process. To tightly approximate the quaternion rank, one nonconvex penalty function is further utilized. We derive an alternate iterative approach to tackle the proposed model. We empirically demonstrate that our model can achieve superior performance over existing methods on both color image denoising and inpainting tasks.
引用
收藏
页码:3119 / 3132
页数:14
相关论文
共 76 条
[61]   Image Restoration Using Joint Patch-Group-Based Sparse Representation [J].
Zha, Zhiyuan ;
Yuan, Xin ;
Wen, Bihan ;
Zhang, Jiachao ;
Zhou, Jiantao ;
Zhu, Ce .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) :7735-7750
[62]   A Benchmark for Sparse Coding: When Group Sparsity Meets Rank Minimization [J].
Zha, Zhiyuan ;
Yuan, Xin ;
Wen, Bihan ;
Zhou, Jiantao ;
Zhang, Jiachao ;
Zhu, Ce .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :5094-5109
[63]   From Rank Estimation to Rank Approximation: Rank Residual Constraint for Image Restoration [J].
Zha, Zhiyuan ;
Yuan, Xin ;
Wen, Bihan ;
Zhou, Jiantao ;
Zhang, Jiachao ;
Zhu, Ce .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3254-3269
[64]   Quaternions and matrices of quaternions [J].
Zhang, FZ .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1997, 251 :21-57
[65]   Low-Rank Matrix Recovery via Modified Schatten-p Norm Minimization With Convergence Guarantees [J].
Zhang, Hengmin ;
Qian, Jianjun ;
Zhang, Bob ;
Yang, Jian ;
Gong, Chen ;
Wei, Yang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3132-3142
[66]   Efficient Recovery of Low-Rank Matrix via Double Nonconvex Nonsmooth Rank Minimization [J].
Zhang, Hengmin ;
Gong, Chen ;
Qian, Jianjun ;
Zhang, Bob ;
Xu, Chunyan ;
Yang, Jian .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (10) :2916-2925
[67]   Plug-and-Play Image Restoration With Deep Denoiser Prior [J].
Zhang, Kai ;
Li, Yawei ;
Zuo, Wangmeng ;
Zhang, Lei ;
Van Gool, Luc ;
Timofte, Radu .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) :6360-6376
[68]   Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernels [J].
Zhang, Kai ;
Zuo, Wangmeng ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1671-1681
[69]   FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising [J].
Zhang, Kai ;
Zuo, Wangmeng ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (09) :4608-4622
[70]   Exemplar-Based Denoising: A Unified Low-Rank Recovery Framework [J].
Zhang, Xiaoqin ;
Zheng, Jingjing ;
Wang, Di ;
Zhao, Li .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (08) :2538-2549