Channel Attention GAN Trained With Enhanced Dataset for Single-Image Shadow Removal

被引:6
作者
Abiko, Ryo [1 ]
Ikehara, Masaaki [1 ]
机构
[1] Keio Univ, Dept Elect & Elect Engn, Yokohama, Kanagawa 2238522, Japan
关键词
Training; Image color analysis; Mathematical models; Cameras; Generative adversarial networks; Task analysis; Neural networks; Image restoration; deep learning; shadow removal; generative adversarial networks;
D O I
10.1109/ACCESS.2022.3147063
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Even today, where many deep-learning-based methods have been published, single-image shadow removal is a challenging task to achieve high accuracy. This is because the shadow changes depending on various conditions such as the target material or the light source, and it is difficult to estimate all the physical parameters. In this paper, we propose a new single-image shadow removal method (Channel Attention GAN: CANet) using two networks for detecting shadows and removing shadows. Intensity change in shadowed regions has different characteristics depending on the wavelength of light. In addition, the image acquisition system of the camera acquires an image in a state where the RGB values influence each other. Therefore, our method focused on the physical properties of shadows and the camera's image acquisition system. The proposed network has a structure considering the relationship between color channels. When training this network, we modified the color and added some artifacts to the training images in order to make the training dataset more complex. These image processing are based on the shadow model, considering the camera image acquisition system. With these new proposals, our method can remove shadows in all ISTD, ISTD+, SRD, and SRD+ datasets with higher accuracy than the state-of-the-art methods. The code is available on GitHub: https://github.com/ryo-abiko/CANet.
引用
收藏
页码:12322 / 12333
页数:12
相关论文
共 32 条
[1]   Single Image Reflection Removal Based on GAN With Gradient Constraint [J].
Abiko, Ryo ;
Ikehara, Masaaki .
IEEE ACCESS, 2019, 7 :148790-148799
[2]   Shadow Removal Using Intensity Surfaces and Texture Anchor Points [J].
Arbel, Eli ;
Hel-Or, Hagit .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (06) :1202-1216
[3]   Shadow compensation in 2D images for face recognition [J].
Choi, Sang-Il ;
Kim, Chunghoon ;
Choi, Chong-Ho .
PATTERN RECOGNITION, 2007, 40 (07) :2118-2125
[4]  
Cun XD, 2020, AAAI CONF ARTIF INTE, V34, P10680
[5]  
Friedman N., 2013, ARXIV PREPRINT ARXIV
[6]   Auto-Exposure Fusion for Single-Image Shadow Removal [J].
Fu, Lan ;
Zhou, Changqing ;
Guo, Qing ;
Juefei-Xu, Felix ;
Yu, Hongkai ;
Feng, Wei ;
Liu, Yang ;
Wang, Song .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :10566-10575
[7]  
Gong H., 2014, P BRIT MACH VIS C, P1, DOI DOI 10.5244/C.28.36
[8]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[9]   Paired Regions for Shadow Detection and Removal [J].
Guo, Ruiqi ;
Dai, Qieyun ;
Hoiem, Derek .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (12) :2956-2967
[10]  
Hore Alain, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P2366, DOI 10.1109/ICPR.2010.579