Learning a Non-Locally Regularized Convolutional Sparse Representation for Joint Chromatic and Polarimetric Demosaicking

被引:4
作者
Luo, Yidong [1 ]
Zhang, Junchao [1 ]
Shao, Jianbo [3 ]
Tian, Jiandong [2 ]
Ma, Jiayi [3 ]
机构
[1] Cent South Univ, Sch Automat, Hunan Prov Key Lab Opt Elect Intelligent Measureme, Changsha 410083, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
[3] Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
Image color analysis; Imaging; Image edge detection; Polarization; Correlation; Cameras; Image reconstruction; Color polarization demosaicking; convolutional sparse coding; non-local self-similarity; unsupervised learning; global optimization; NETWORK; INTERPOLATION; DIVISION; IMAGES; FUSION;
D O I
10.1109/TIP.2024.3451693
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Division of focal plane color polarization camera becomes the mainstream in polarimetric imaging for it directly captures color polarization mosaic image by one snapshot, so image demosaicking is an essential task. Current color polarization demosaicking (CPDM) methods are prone to unsatisfied results since it's difficult to recover missed 15 or 14 pixels out of 16 pixels in color polarization mosaic images. To address this problem, a non-locally regularized convolutional sparse regularization model, which is advantaged in denoising and edge maintaining, is proposed to recall more information for CPDM task, and the CPDM task is transformed into an energy function to be solved by ADMM optimization. Finally, the optimal model generates informative and clear results. The experimental results, including reconstructed synthetic and real-world scenes, demonstrate that our proposed method outperforms the current state-of-the-art methods in terms of quantitative measurements and visual quality. The source code is available at https://github.com/roydon-luo/NLCSR-CPDM.
引用
收藏
页码:5029 / 5044
页数:16
相关论文
共 48 条
[1]   Residual interpolation for division of focal plane polarization image sensors [J].
Ahmed, Ashfaq ;
Zhao, Xiaojin ;
Gruev, Viktor ;
Zhang, Junchao ;
Bermak, Amine .
OPTICS EXPRESS, 2017, 25 (09) :10651-10662
[2]   Image denoising via local and nonlocal circulant similarity [J].
Chen, Fei ;
Zeng, Xunxun ;
Wang, Meiqing .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2015, 30 :117-124
[3]   Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization [J].
Dong, Weisheng ;
Zhang, Lei ;
Shi, Guangming ;
Wu, Xiaolin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (07) :1838-1857
[4]   For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution [J].
Donoho, DL .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2006, 59 (06) :797-829
[5]   Impact of training data on LMMSE demosaicing for Colour-Polarization Filter Array [J].
Dumoulin, Ronan ;
Lapray, Pierre-Jean ;
Thomas, Jean-Baptiste ;
Farup, Ivar .
2022 16TH INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS, SITIS, 2022, :275-280
[6]  
Gao SK, 2012, IEEE INT SYMP CIRC S, P1855
[7]   Bilinear and bicubic interpolation methods for division of focal plane polarimeters [J].
Gao, Shengkui ;
Gruev, Viktor .
OPTICS EXPRESS, 2011, 19 (27) :26161-26173
[8]   Semi-Supervised Sparse Representation Based Classification for Face Recognition With Insufficient Labeled Samples [J].
Gao, Yuan ;
Ma, Jiayi ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (05) :2545-2560
[9]   Convolutional Sparse Coding for Image Super-resolution [J].
Gu, Shuhang ;
Zuo, Wangmeng ;
Xie, Qi ;
Meng, Deyu ;
Feng, Xiangchu ;
Zhang, Lei .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1823-1831
[10]   Optical correlation assists to enhance underwater polarization imaging performance [J].
Han, Pingli ;
Liu, Fei ;
Wei, Yi ;
Shao, Xiaopeng .
OPTICS AND LASERS IN ENGINEERING, 2020, 134