Invertible Denoising Network: A Light Solution for Real Noise Removal

被引:119
作者
Liu, Yang [1 ,2 ]
Qin, Zhenyue [1 ]
Anwar, Saeed [1 ,2 ]
Ji, Pan [3 ]
Kim, Dongwoo [4 ]
Caldwell, Sabrina [1 ]
Gedeon, Tom [1 ]
机构
[1] Australian Natl Univ, Canberra, ACT, Australia
[2] CSIRO, Data61, Canberra, ACT, Australia
[3] OPPO US Res, Palo Alto, CA USA
[4] GSAI POSTECH, Pohang, South Korea
来源
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021 | 2021年
关键词
IMAGE; ALGORITHM;
D O I
10.1109/CVPR46437.2021.01316
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Invertible networks have various benefits for image denoising since they are lightweight, information-lossless, and memory-saving during back-propagation. However, applying invertible models to remove noise is challenging because the input is noisy, and the reversed output is clean, following two different distributions. We propose an invertible denoising network, InvDN, to address this challenge. InvDN transforms the noisy input into a low-resolution clean image and a latent representation containing noise. To discard noise and restore the clean image, InvDN replaces the noisy latent representation with another one sampled from a prior distribution during reversion. The denoising performance of InvDN is better than all the existing competitive models, achieving a new state-of-the-art result for the SIDD dataset while enjoying less run time. Moreover, the size of InvDN is far smaller, only having 4.2% of the number of parameters compared to the most recently proposed DANet. Further, via manipulating the noisy latent representation, InvDN is also able to generate noise more similar to the original one. Our code is available at: https://github.com/Yang-Liu1082/InvDN.git.
引用
收藏
页码:13360 / 13369
页数:10
相关论文
共 56 条
[1]   Noise Flow: Noise Modeling with Conditional Normalizing Flows [J].
Abdelhamed, Abdelrahman ;
Brubaker, Marcus A. ;
Brown, Michael S. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3165-3173
[2]   A High-Quality Denoising Dataset for Smartphone Cameras [J].
Abdelhamed, Abdelrahman ;
Lin, Stephen ;
Brown, Michael S. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1692-1700
[3]  
ABSoft, Neat Image
[4]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[5]   Identity Enhanced Residual Image Denoising [J].
Anwar, Saeed ;
Cong Phuoc Huynh ;
Porikli, Fatih .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :2201-2210
[6]   Real Image Denoising with Feature Attention [J].
Anwar, Saeed ;
Barnes, Nick .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3155-3164
[7]  
Ardizzone Lynton, 2019, GUIDED IMAGE GENERAT
[8]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[9]  
Behrmann J, 2019, PR MACH LEARN RES, V97
[10]   Unprocessing Images for Learned Raw Denoising [J].
Brooks, Tim ;
Mildenhall, Ben ;
Xue, Tianfan ;
Chen, Jiawen ;
Sharlet, Dillon ;
Barron, Jonathan T. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11028-11037