Further Improvement of Debayering Performance of RGBW Color Filter Arrays Using Deep Learning and Pansharpening Techniques

被引:11
作者
Kwan, Chiman [1 ]
Chou, Bryan [1 ]
机构
[1] Appl Res LLC, Rockville, MD 20850 USA
关键词
debayering; RGBW pattern; CFA2.0; demosaicing; pansharpening; color filter array; Bayer pattern; deep learning; DEMOSAICKING; FUSION; MS;
D O I
10.3390/jimaging5080068
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
The RGBW color filter arrays (CFA), also known as CFA2.0, contains R, G, B, and white (W) pixels. It is a 4 x 4 pattern that has 8 white pixels, 4 green pixels, 2 red pixels, and 2 blue pixels. The pattern repeats itself over the whole image. In an earlier conference paper, we cast the demosaicing process for CFA2.0 as a pansharpening problem. That formulation is modular and allows us to insert different pansharpening algorithms for demosaicing. New algorithms in interpolation and demosaicing can also be used. In this paper, we propose a new enhancement of our earlier approach by integrating a deep learning-based algorithm into the framework. Extensive experiments using IMAX and Kodak images clearly demonstrated that the new approach improved the demosaicing performance even further.
引用
收藏
页数:14
相关论文
共 36 条
[1]   MTF-tailored multiscale fusion of high-resolution MS and pan imagery [J].
Aiazzi, B. ;
Alparone, L. ;
Baronti, S. ;
Garzelli, A. ;
Selva, M. .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2006, 72 (05) :591-596
[2]   Improving component substitution pansharpening through multivariate regression of MS plus Pan data [J].
Aiazzi, Bruno ;
Baronti, Stefano ;
Selva, Massimo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (10) :3230-3239
[3]   A Novel Utilization of Image Registration Techniques to Process Mastcam Images in Mars Rover With Applications to Image Fusion, Pixel Clustering, and Anomaly Detection [J].
Ayhan, Bulent ;
Dao, Minh ;
Kwan, Chiman ;
Chen, Hua-Mei ;
Bell, James F. ;
Kidd, Richard .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (10) :4553-4564
[4]  
Bayer B.E, 1976, US Patent, Patent No. [3971065, 397106520]
[5]  
CHAVEZ PS, 1991, PHOTOGRAMM ENG REM S, V57, P295
[6]   A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement [J].
Choi, Jaewan ;
Yu, Kiyun ;
Kim, Yongil .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2011, 49 (01) :295-309
[7]  
Compton J. T., 2012, U.S. Patent, Patent No. 8139130
[8]   A GENERIC VARIATIONAL APPROACH FOR DEMOSAICKING FROM AN ARBITRARY COLOR FILTER ARRAY [J].
Condat, Laurent .
2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, :1625-1628
[9]   Frequency-domain methods for demosaicking of Bayer-sampled color images [J].
Dubois, E .
IEEE SIGNAL PROCESSING LETTERS, 2005, 12 (12) :847-850
[10]   Deep Joint Demosaicking and Denoising [J].
Gharbi, Michael ;
Chaurasia, Gaurav ;
Paris, Sylvain ;
Durand, Fredo .
ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (06)