Deep Learning-Based Patch-Wise Illumination Estimation for Enhanced Multi-Exposure Fusion

被引:2
作者
Al-Zamili, Zainab [1 ]
Danach, Kassem M. [2 ]
Frikha, Mondher [1 ]
机构
[1] Univ Sfax, Fac Sci, Sfax 3029, Tunisia
[2] Maaref Univ, Fac Business Adm, Dept Informat Technol & Management Syst, Beirut, Lebanon
关键词
Convolutional neural network (CNN); dynamic range expansion; image enhancement; multi-exposure fusion; patch-wise illumination estimation; IMAGE FUSION; FRAMEWORK;
D O I
10.1109/ACCESS.2023.3328579
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article suggests a unique technique for multi-exposure fusion using convolutional neural networks (CNNs) for patch-wise illumination estimates. Multi-exposure fusion is a crucial component of enhancing image quality, particularly in circumstances with erratic lighting. Our proposed approach makes use of CNNs' capability to anticipate light levels inside specific image patches in order to accurately change exposure levels. We look at the theoretical foundations of our approach, emphasising the advantages of patch-wise estimation in capturing intricate lighting details. Additionally, we present experimental results demonstrating enhanced dynamic range expansion and image detail preservation, demonstrating that our methodology is more effective than conventional fusion methods. This study advances the state-of-the-art in multi-exposure fusion while also opening up new prospects for computational photography, surveillance, and computer vision applications.
引用
收藏
页码:120642 / 120653
页数:12
相关论文
共 43 条
[31]  
Tumblin J, 2005, PROC CVPR IEEE, P103
[32]   Exposure Fusion Using a Relative Generative Adversarial Network [J].
Wang, Jinhua ;
Li, Xuewei ;
Liu, Hongzhe .
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (07) :1017-1027
[33]   End-to-End Exposure Fusion Using Convolutional Neural Network [J].
Wang, Jinhua ;
Wang, Weiqiang ;
Xu, Guangmei ;
Liu, Hongzhe .
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (02) :560-563
[34]   Multi-Exposure Decomposition-Fusion Model for High Dynamic Range Image Saliency Detection [J].
Wang, Xu ;
Sun, Zhenhao ;
Zhang, Qiudan ;
Fang, Yuming ;
Ma, Lin ;
Wang, Shiqi ;
Kwong, Sam .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (12) :4409-4420
[35]   Deep High Dynamic Range Imaging with Large Foreground Motions [J].
Wu, Shangzhe ;
Xu, Jiarui ;
Tai, Yu-Wing ;
Tang, Chi-Keung .
COMPUTER VISION - ECCV 2018, PT II, 2018, 11206 :120-135
[36]   Multi-Exposure Image Fusion Techniques: A Comprehensive Review [J].
Xu, Fang ;
Liu, Jinghong ;
Song, Yueming ;
Sun, Hui ;
Wang, Xuan .
REMOTE SENSING, 2022, 14 (03)
[37]   MEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks [J].
Xu, Han ;
Ma, Jiayi ;
Zhang, Xiao-Ping .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :7203-7216
[38]   Attention-guided Network for Ghost-free High Dynamic Range Imaging [J].
Yan, Qingsen ;
Gong, Dong ;
Shi, Qinfeng ;
van den Hengel, Anton ;
Shen, Chunhua ;
Reid, Ian ;
Zhang, Yanning .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1751-1760
[39]   Multi-scale Dense Networks for Deep High Dynamic Range Imaging [J].
Yan, Qingsen ;
Gong, Dong ;
Zhang, Pingping ;
Shi, Qinfeng ;
Sun, Jinqiu ;
Reid, Ian ;
Zhang, Yanning .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :41-50
[40]   GANFuse: a novel multi-exposure image fusion method based on generative adversarial networks [J].
Yang, Zhiguang ;
Chen, Youping ;
Le, Zhuliang ;
Ma, Yong .
NEURAL COMPUTING & APPLICATIONS, 2021, 33 (11) :6133-6145