Deep Highlight Removal Using Temporal Dark Prior in High-Speed Domain

被引:3
作者
Ha, Jeong-Won [1 ]
Lee, Kang-Kyu [1 ]
Yoo, Jun-Sang [2 ]
Kim, Jong-Ok [1 ]
机构
[1] Korea Univ, Sch Elect Engn, Seoul 02841, South Korea
[2] Samsung Adv Inst Technol, Comp Vis Lab, Suwon 16678, Gyeonggi Do, South Korea
基金
新加坡国家研究基金会;
关键词
Reflection; Image color analysis; Light sources; Cameras; Image decomposition; Fluctuations; Estimation; Dichromatic model; highlight removal; high-speed camera; REFLECTION; SEPARATION; COMPONENTS; COLOR;
D O I
10.1109/ACCESS.2023.3249779
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a deep highlight removal method based on the dichromatic model under alternating current (AC) light sources with a new diffuse prior on temporal domain, temporal dark prior. An input image is decomposed into specular and diffuse components using a deep network. Due to AC powered lights, both incident and reflected lights are time-varying. We exploit the periodic variation property of the specular and diffuse reflections as a prior for dichromatic model based image decomposition. In addition, we propose a new temporal dark prior as a pseudo-diffuse reflection. Unlike the conventional prior in the spatial domain, to the best of our knowledge, this is the first study to utilize a diffuse prior on the temporal domain for highlight removal. The blurred version of the temporal dark prior is additionally fed to the network to alleviate hole artifacts. It is demonstrated through diverse experiments that these temporal priors can strongly contribute to accurate image decomposition, leading to better highlight removal.
引用
收藏
页码:20136 / 20149
页数:14
相关论文
共 48 条
[1]   Separation of Reflection Components by Sparse Non-negative Matrix Factorization [J].
Akashi, Yasuhiro ;
Okatani, Takayuki .
COMPUTER VISION - ACCV 2014, PT V, 2015, 9007 :611-625
[2]  
Alsaleh S., 2020, THESIS G WASHINGTON
[3]   Automatic Segmentation and Inpainting of Specular Highlights for Endoscopic Imaging [J].
Arnold, Mirko ;
Ghosh, Anarta ;
Ameling, Stefan ;
Lacey, Gerard .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2010,
[4]   Single Image Reflection Removal with Edge Guidance, Reflection Classifier, and Recurrent Decomposition [J].
Chang, Ya-Chu ;
Lu, Chia-Ni ;
Cheng, Chia-Chi ;
Chiu, Wei-Chen .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, :2032-2041
[5]   The Impact of Specular Highlights on 3D-2D Face Recognition [J].
Christleini, Vincent ;
Riess, Christian ;
Angelopoulou, Elli ;
Evangelopoulos, Georgios ;
Kakadiaris, Ioannis A. .
BIOMETRIC AND SURVEILLANCE TECHNOLOGY FOR HUMAN AND ACTIVITY IDENTIFICATION X, 2013, 8712
[6]   HDR image reconstruction from a single exposure using deep CNNs [J].
Eilertsen, Gabriel ;
Kronander, Joel ;
Denes, Gyorgy ;
Mantiuk, Rafal K. ;
Unger, Jonas .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06)
[7]   Specular reflection reduction with multi-flash imaging [J].
Feris, R ;
Raskar, R ;
Tan, KH ;
Turk, M .
XVII BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING, PROCEEDINGS, 2004, :316-321
[8]   Learning to Detect Specular Highlights from Real-world Images [J].
Fu, Gang ;
Zhang, Qing ;
Lin, Qifeng ;
Zhu, Lei ;
Xiao, Chunxia .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :1873-1881
[9]   A Multi-Task Network for Joint Specular Highlight Detection and Removal [J].
Fu, Gang ;
Zhang, Qing ;
Zhu, Lei ;
Li, Ping ;
Xiao, Chunxia .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :7748-7757
[10]   Specular Highlight Removal for Real-world Images [J].
Fu, Gang ;
Zhang, Qing ;
Song, Chengfang ;
Lin, Qifeng ;
Xiao, Chunxia .
COMPUTER GRAPHICS FORUM, 2019, 38 (07) :253-263