NTIRE 2021 Depth Guided Image Relighting Challenge

被引:25
作者
El Helou, Majed [1 ]
Zhou, Ruofan [1 ]
Susstrunk, Sabine [1 ]
Timofte, Radu [2 ]
Suin, Maitreya [10 ]
Rajagopalan, A. N. [10 ]
Wang, Yuanzhi [16 ]
Lu, Tao [16 ]
Zhang, Yanduo [16 ]
Wu, Yuntao [16 ]
Yang, Hao-Hsiang [3 ,4 ,5 ]
Chen, Wei-Ting [3 ,4 ,5 ]
Kuo, Sy-Yen [3 ,4 ,5 ]
Luo, Hao-Lun [3 ,4 ,5 ]
Zhang, Zhiguang [8 ]
Luo, Zhipeng [8 ]
He, Jianye [3 ,8 ]
Zhu, Zuo-Liang [11 ]
Li, Zhen [11 ]
Qiu, Jia-Xiong [3 ,11 ]
Kuang, Zeng-Sheng [11 ]
Lu, Cheng-Ze [11 ]
Cheng, Ming-Ming [11 ]
Shao, Xiu-Li [11 ]
Li, Chenghua [6 ]
Ding, Bosong [6 ]
Qian, Wanli [6 ]
Li, Fangya [6 ]
Li, Fu [15 ]
Deng, Ruifeng [15 ]
Lin, Tianwei [15 ]
Liu, Songhua [15 ]
Li, Xin [15 ]
He, Dongliang [15 ]
Yazdani, Amirsaeed [9 ]
Guo, Tiantong [9 ]
Monga, Vishal [9 ]
Nsampi, Ntumba Elie [12 ]
Hu, Zhongyun [12 ]
Wang, Qing [12 ]
Nathan, Sabari [7 ]
Kansal, Priya [7 ]
Zhao, Tongtong [13 ,14 ]
Zhao, Shanshan [13 ,14 ]
机构
[1] Ecole Polytech Fed Lausanne, Lausanne, Switzerland
[2] Swiss Fed Inst Technol, Zurich, Switzerland
[3] ASUSTeK Comp Inc, ASUS Intelligent Cloud Serv, Taipei, Taiwan
[4] Natl Taiwan Univ, Grad Inst Elect Engn, Taipei, Taiwan
[5] Natl Taiwan Univ, Dept Elect Engn, Taipei, Taiwan
[6] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
[7] Couger Inc, Tokyo, Japan
[8] DeepBlue Technol Shanghai Co Ltd, Shanghai, Peoples R China
[9] Penn State Univ, Sch Elect Engn & Comp Sci, Informat Proc & Algorithms Lab iPAL, University Pk, PA 16802 USA
[10] Indian Inst Technol Madras, Chennai, Tamil Nadu, India
[11] Nankai Univ, Tianjin, Peoples R China
[12] Northwestern Polytech Univ, Sch Comp Sci, Comp Vis & Computat Photog Grp, Xian, Peoples R China
[13] Dalian Maritime Univ, Dalian, Peoples R China
[14] China Everbright Bank, Shanghai, Peoples R China
[15] Baidu Inc, Dept Comp Vis Vis, Beijing, Peoples R China
[16] Wuhan Inst Technol, Hubei Key Lab Intelligent Robot, Wuhan, Peoples R China
来源
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021 | 2021年
关键词
D O I
10.1109/CVPRW53098.2021.00069
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image relighting is attracting increasing interest due to its various applications. From a research perspective, image relighting can be exploited to conduct both image normalization for domain adaptation, and also for data augmentation. It also has multiple direct uses for photo montage and aesthetic enhancement. In this paper, we review the NTIRE 2021 depth guided image relighting challenge. We rely on the VIDIT dataset for each of our two challenge tracks, including depth information. The first track is on one-to-one relighting where the goal is to transform the illumination setup of an input image (color temperature and light source position) to the target illumination setup. In the second track, the any-to-any relighting challenge, the objective is to transform the illumination settings of the input image to match those of another guide image, similar to style transfer. In both tracks, participants were given depth information about the captured scenes. We had nearly 250 registered participants, leading to 18 confirmed team submissions in the final competition stage. The competitions, methods, and final results are presented in this paper.
引用
收藏
页码:566 / 577
页数:12
相关论文
共 59 条
[1]   NTIRE 2021 Challenge for Defocus Deblurring Using Dual-pixel Images: Methods and Results [J].
Abuolaim, Abdullah ;
Timofte, Radu ;
Brown, Michael S. ;
Zhang, Dafeng ;
Wang, Xiaobing ;
Zamir, Syed Waqas ;
Arora, Aditya ;
Khan, Salman ;
Hayat, Munawar ;
Khan, Fahad Shahbaz ;
Shao, Ling ;
Liu, Shuai ;
Lei, Lei ;
Feng, Chaoyu ;
Xiong, Zhiwei ;
Xiao, Zeyu ;
Xu, Ruikang ;
Zhu, Yunan ;
Liu, Dong ;
Vo, Tu ;
Miao, Si ;
Shah, Nisarg A. ;
Liang, Pengwei ;
Zhong, Zhiwei ;
Hu, Xingyu ;
Chen, Yiqun ;
Li, Chenghua ;
Bai, Xiaoying ;
Zhang, Chi ;
Yao, Yiheng ;
Gang, Ruipeng ;
Nathan, Sabari ;
Ragavendran, Thangavelu ;
Srinija, Venkatakrishnan ;
Srivatsav, Venkatakrishnan .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :578-587
[2]   NTIRE 2021 NonHomogeneous Dehazing Challenge Report [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Vasluianu, Florin-Alexandru ;
Timofte, Radu ;
Fu, Minghan ;
Liu, Huan ;
Yu, Yankun ;
Chen, Jun ;
Wang, Keyan ;
Chang, Jerome ;
Wang, Xiyao ;
Liu, Jing ;
Xu, Yi ;
Zhang, Xinjian ;
Zhao, Minyi ;
Zhou, Shuigeng ;
Chen, Tianyi ;
Fu, Jiahui ;
Jiang, Wentao ;
Gao, Chen ;
Liu, Si ;
Wang, Yudong ;
Guo, Jichang ;
Li, Chongyi ;
Yan, Qixin ;
Zheng, Sida ;
Zamir, Syed Waqas ;
Arora, Aditya ;
Dudhane, Akshay ;
Khan, Salman ;
Hayat, Munawar ;
Khan, Fahad Shahbaz ;
Shao, Ling ;
Zhang, Haichuan ;
Guo, Tiantong ;
Monga, Vishal ;
Yang, Wenjin ;
Lin, Jin ;
Luo, Xiaotong ;
Huang, Guowen ;
Chen, Shuxin ;
Qu, Yanyun ;
Xu, Kele ;
Yang, Lehan ;
Sun, Pengliang ;
Niu, Xuetong ;
Zheng, Junjun ;
Ruan, Xiaotong ;
Wang, Yunfeng ;
Yang, Jiang .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :627-646
[3]  
[Anonymous], 2020, P EUR C COMP VIS WOR
[4]  
[Anonymous], 2020, EUR C COMP VIS
[5]   A General and Adaptive Robust Loss Function [J].
Barron, Jonathan T. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4326-4334
[6]   NTIRE 2021 Challenge on Burst Super-Resolution: Methods and Results [J].
Bhat, Goutam ;
Danelljan, Martin ;
Timofte, Radu ;
Akita, Kazutoshi ;
Cho, Wooyeong ;
Fan, Haoqiang ;
Jia, Lanpeng ;
Kim, Daeshik ;
Lecouat, Bruno ;
Li, Youwei ;
Liu, Shuaicheng ;
Liu, Ziluan ;
Luo, Ziwei ;
Maeda, Takahiro ;
Mairal, Julien ;
Micheloni, Christian ;
Mo, Xuan ;
Oba, Takeru ;
Ostyakov, Pavel ;
Ponce, Jean ;
Son, Sanghyeok ;
Sun, Jian ;
Ukita, Norimichi ;
Muhammad, Rao ;
Yan, Umer Youliang ;
Yu, Lei ;
Zhussip, Magauiya ;
Zou, Xueyi .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :613-626
[7]   JS']JSTASR: Joint Size and Transparency-Aware Snow Removal Algorithm Based on Modified Partial Convolution and Veiling Effect Removal [J].
Chen, Wei-Ting ;
Fang, Hao-Yu ;
Ding, Jian-Jiun ;
Tsai, Cheng-Che ;
Kuo, Sy-Yen .
COMPUTER VISION - ECCV 2020, PT XXI, 2020, 12366 :754-770
[8]   PMHLD: Patch Map-Based Hybrid Learning DehazeNet for Single Image Haze Removal [J].
Chen, Wei-Ting ;
Fang, Hao-Yu ;
Ding, Jian-Jiun ;
Kuo, Sy-Yen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :6773-6788
[9]   PMS-Net: Robust Haze Removal Based on Patch Map for Single Images [J].
Chen, Wei-Ting ;
Ding, Jian-Jiun ;
Kuo, Sy-Yen .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11673-11681
[10]  
Das S. D., 2021, ARXIV210209242