Single Image Reflection Removal Based on GAN With Gradient Constraint

被引:19
作者
Abiko, Ryo [1 ]
Ikehara, Masaaki [1 ]
机构
[1] Keio Univ, Dept Elect & Elect Engn, Yokohama, Kanagawa 2238522, Japan
关键词
Image restoration; deep learning; reflection removal; image separation; generative adversarial network;
D O I
10.1109/ACCESS.2019.2947266
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
When we take a picture through glass windows, the photographs are often degraded by undesired reflections. To separate reflection layer and background layer is an important problem for enhancing image quality. However, single-image reflection removal is a challenging process because of the ill-posed nature of the problem. In this paper, we propose a single-image reflection removal method based on generative adversarial networks. Our network is an end-to-end trained network with four types of losses. It includes pixel loss, feature loss, adversarial loss, and gradient constraint loss. We propose a novel gradient constraint loss in order to separate the background layer and the reflection layer clearly. Gradient constraint loss is applied in a gradient domain and it minimizes the correlation between the background and reflection layer. Owing to the novel loss and our new synthetic dataset, our reflection removal method outperforms state-of-the-art methods in PSNR and SSIM, especially in real world images.
引用
收藏
页码:148790 / 148799
页数:10
相关论文
共 33 条
[1]   Removing photography artifacts using gradient projection and flash-exposure sampling [J].
Agrawal, A ;
Raskar, R ;
Nayar, SK ;
Li, YZ .
ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03) :828-835
[2]  
[Anonymous], 2015, ICLR
[3]  
[Anonymous], P IEEE C COMP VIS PA
[4]  
[Anonymous], 2015, ARXIV PREPRINT ARXIV
[5]  
[Anonymous], P IEEE C COMP VIS PA
[6]  
[Anonymous], 2017, P IEEE C COMPUTER VI
[7]  
[Anonymous], P IEEE C COMP VIS PA
[8]  
[Anonymous], 2018, ARXIV180200094
[9]   Single Image Reflection Removal Using Convolutional Neural Networks [J].
Chang, Yakun ;
Jung, Cheolkon .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (04) :1954-1966
[10]   Image Blind Denoising With Generative Adversarial Network Based Noise Modeling [J].
Chen, Jingwen ;
Chen, Jiawei ;
Chao, Hongyang ;
Yang, Ming .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3155-3164