NERD: NEURAL FIELD-BASED DEMOSAICKING

被引:2
作者
Kerepecky, Tomas [1 ,2 ]
Sroubek, Filip [1 ]
Novozamsky, Adam [1 ]
Flusser, Jan [1 ]
机构
[1] Czech Acad Sci, Inst Informat Theory & Automat, Prague, Czech Republic
[2] Czech Tech Univ, Fac Nucl Sci & Phys Engn, Prague, Czech Republic
来源
2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2023年
关键词
Demosaicking; neural field; implicit neural representation;
D O I
10.1109/ICIP49359.2023.10221948
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce NeRD, a new demosaicking method for generating full-color images from Bayer patterns. Our approach leverages advancements in neural fields to perform demosaicking by representing an image as a coordinate-based neural network with sine activation functions. The inputs to the network are spatial coordinates and a low-resolution Bayer pattern, while the outputs are the corresponding RGB values. An encoder network, which is a blend of ResNet and U-net, enhances the implicit neural representation of the image to improve its quality and ensure spatial consistency through prior learning. Our experimental results demonstrate that NeRD outperforms traditional and state-of-the-art CNN-based methods and significantly closes the gap to transformer-based methods.
引用
收藏
页码:1735 / 1739
页数:5
相关论文
共 19 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]  
Chen H., 2021, P ADV NEUR INF PROC, P21568
[3]   Learning Continuous Image Representation with Local Implicit Image Function [J].
Chen, Yinbo ;
Liu, Sifei ;
Wang, Xiaolong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8624-8634
[4]  
Dupont E, 2022, PR MACH LEARN RES
[5]   Deep Joint Demosaicking and Denoising [J].
Gharbi, Michael ;
Chaurasia, Gaurav ;
Paris, Sylvain ;
Durand, Fredo .
ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (06)
[6]   Iterative Joint Image Demosaicking and Denoising Using a Residual Denoising Network [J].
Kokkinos, Filippos ;
Lefkimmiatis, Stamatios .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (08) :4177-4188
[7]   Enhanced Deep Residual Networks for Single Image Super-Resolution [J].
Lim, Bee ;
Son, Sanghyun ;
Kim, Heewon ;
Nah, Seungjun ;
Lee, Kyoung Mu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1132-1140
[8]  
Malvar HS, 2004, 2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL III, PROCEEDINGS, P485
[9]   Demosaicing with directional filtering and a posteriori decision [J].
Menon, Daniele ;
Andriani, Stefano ;
Calvagno, Giancarlo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (01) :132-141
[10]   Color image demosaicking: An overview [J].
Menon, Daniele ;
Calvagno, Giancarlo .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2011, 26 (8-9) :518-533