DEEP COLOR IMAGE DEMOSAICKING WITH FEATURE PYRAMID CHANNEL ATTENTION

被引:5
作者
Kang, Qi [1 ]
Fu, Ying [1 ]
Huang, Hua [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
来源
2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW) | 2019年
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Demosaicking; Bayer Color Filter Array; Convolutional Neural Network; Multi-scale Multi-level Feature Fusion; Channel Attention; SELF-SIMILARITY;
D O I
10.1109/ICMEW.2019.00-79
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Image demosaicking is the most crucial preprocessing step in the current color digital camera pipeline. Efficiency and high quality are of importance to demosaicking methods at the request of practical applications. Recently, convolutional neural network (CNN) has demonstrated its superior performance on image demosaicking. However, most existed CNN-based demosaicking methods fail to take full advantage of the self-similarity and redundancy in natural image, and interpolation artifacts (e.g. zippering and color moire) easily occur when local geometry cannot be inferred correctly from neighboring pixels. To solve these problems, we propose a fully convolutional feature pyramid network to exploit image self-similarity and redundant information as much as possible for image demosaicking. Furthermore, we add a compact channel attention module to the proposed network to flexibly rescale channel-wise features by modeling interdependencies among channels. Our experimental results on three datasets show that our method obviously outperforms state-of-the-art methods on both quantitative and visual quality assessments, and maintains competitive running time in the inference stage.
引用
收藏
页码:246 / 251
页数:6
相关论文
共 31 条
[1]  
[Anonymous], 2015, IEEE I CONF COMP VIS, DOI DOI 10.1109/ICCV.2015.123
[2]  
Bayer B., 1976, U.S. Patent, Patent No. 3971065
[3]   Self-Similarity Driven Color Demosaicking [J].
Buades, Antoni ;
Coll, Bartomeu ;
Morel, Jean-Michel ;
Sbert, Catalina .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (06) :1192-1202
[4]  
Cui K, 2018, IEEE IMAGE PROC, P2177, DOI 10.1109/ICIP.2018.8451020
[5]   Self-Similarity and Spectral Correlation Adaptive Algorithm for Color Demosaicking [J].
Duran, Joan ;
Buades, Antoni .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (09) :4031-4040
[6]   Deep Joint Demosaicking and Denoising [J].
Gharbi, Michael ;
Chaurasia, Gaurav ;
Paris, Sylvain ;
Durand, Fredo .
ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (06)
[7]  
Hu J., 2018, P IEEE C COMPUTER VI
[8]   Beyond Color Difference: Residual Interpolation for Color Image Demosaicking [J].
Kiku, Daisuke ;
Monno, Yusuke ;
Tanaka, Masayuki ;
Okutomi, Masatoshi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (03) :1288-1300
[9]   Minimized-Laplacian Residual Interpolation for Color Image Demosaicking [J].
Kiku, Daisuke ;
Monno, Yusuke ;
Tanaka, Masayuki ;
Okutomi, Masatoshi .
DIGITAL PHOTOGRAPHY X, 2014, 9023
[10]  
Kiku D, 2013, IEEE IMAGE PROC, P2304, DOI 10.1109/ICIP.2013.6738475