LTNet: Light Transfer Network for Depth Guided Image Relighting

被引:0
作者
Zhu, Yu [3 ]
Ding, Bosong [1 ]
Li, Chenghua [1 ]
Qian, Wanli [6 ]
Li, Fangya [7 ]
Yao, Yiheng [1 ]
Gang, Ruipeng [2 ]
Zhang, Chunjie [4 ]
Cheng, Jian [1 ,5 ]
机构
[1] Chinese Acad Sci CASIA, Inst Automat, Beijing 100190, Peoples R China
[2] NRTA, Acad Broadcasting Sci, Beijing 100866, Peoples R China
[3] Anhui Univ, Sch Comp Sci & Technol, Hefei 230601, Peoples R China
[4] BJTU, Beijing Key Lab Adv Informat Sci & Network Techno, Beijing, Peoples R China
[5] CASIA, Nanjing Artificial Intelligence Chip Res, Nanjing 211100, Peoples R China
[6] Georgia Inst Technol, Atlanta, GA 30318 USA
[7] State Key Lab Media Convergence & Commun, Beijing 100024, Peoples R China
来源
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021 | 2021年
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
D O I
10.1109/CVPRW53098.2021.00033
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Relighting is an interesting yet challenging low-level vision problem, which aims to re-render the scene with new light sources. In this paper, we introduce LTNet, a novel framework for image relighting. Unlike previous methods, we propose to solve this challenging problem by decoupling the enhancement process. Specifically, we propose to train a network that focuses on learning light variations. Our key insight is that light variations are the critical information to be learned because the scene stays unchanged during the light transfer process. To this end, we employ a global residual connection and corresponding residual loss for capturing light variations. Experimental results show that the proposed method achieves better visual quality on the VIDIT dataset in the NTIRE2021 relighting challenge.
引用
收藏
页码:243 / 251
页数:9
相关论文
共 26 条
[1]  
[Anonymous], 2010, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2010.5539823
[2]  
El Helou M., 2020, P EUR C COMP VIS WOR
[3]   Deferred Neural Lighting: Free-viewpoint Relighting from Unstructured Photographs [J].
Gao, Duan ;
Chen, Guojun ;
Dong, Yue ;
Peers, Pieter ;
Xu, Kun ;
Tong, Xin .
ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (06)
[4]   Verifiable and Forward-secure Encrypted Search Using Blockchain Techniques [J].
Guo, Yu ;
Zhang, Chen ;
Jia, Xiaohua .
ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
[5]   Single Image Haze Removal Using Dark Channel Prior [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) :2341-2353
[6]  
Helou Majed El, 2021, P IEEE C COMP VIS PA
[7]  
Helou Majed El, 2020, VIDIT VIRTUAL IMAGE
[8]  
Huang G., 2017, 5 INT C LEARN REPR I, DOI DOI 10.1109/CVPR.2017.243
[9]   Replacing Mobile Camera ISP with a Single Deep Learning Model [J].
Ignatov, Andrey ;
Van Gool, Luc ;
Timofte, Radu .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :2275-2285
[10]   FormResNet: Formatted Residual Learning for Image Restoration [J].
Jiao, Jianbo ;
Tu, Wei-Chih ;
He, Shengfeng ;
Lau, Rynson W. H. .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1034-1042