Deep Learning-Based Patch-Wise Illumination Estimation for Enhanced Multi-Exposure Fusion

被引:2
作者
Al-Zamili, Zainab [1 ]
Danach, Kassem M. [2 ]
Frikha, Mondher [1 ]
机构
[1] Univ Sfax, Fac Sci, Sfax 3029, Tunisia
[2] Maaref Univ, Fac Business Adm, Dept Informat Technol & Management Syst, Beirut, Lebanon
关键词
Convolutional neural network (CNN); dynamic range expansion; image enhancement; multi-exposure fusion; patch-wise illumination estimation; IMAGE FUSION; FRAMEWORK;
D O I
10.1109/ACCESS.2023.3328579
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article suggests a unique technique for multi-exposure fusion using convolutional neural networks (CNNs) for patch-wise illumination estimates. Multi-exposure fusion is a crucial component of enhancing image quality, particularly in circumstances with erratic lighting. Our proposed approach makes use of CNNs' capability to anticipate light levels inside specific image patches in order to accurately change exposure levels. We look at the theoretical foundations of our approach, emphasising the advantages of patch-wise estimation in capturing intricate lighting details. Additionally, we present experimental results demonstrating enhanced dynamic range expansion and image detail preservation, demonstrating that our methodology is more effective than conventional fusion methods. This study advances the state-of-the-art in multi-exposure fusion while also opening up new prospects for computational photography, surveillance, and computer vision applications.
引用
收藏
页码:120642 / 120653
页数:12
相关论文
共 43 条
[1]   Split aperture imaging for high dynamic range [J].
Aggarwal, M ;
Ahuja, N .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 58 (01) :7-17
[2]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[3]   Deep learning in computer vision: A critical review of emerging techniques and application scenarios [J].
Chai, Junyi ;
Zeng, Hao ;
Li, Anming ;
Ngai, Eric W. T. .
MACHINE LEARNING WITH APPLICATIONS, 2021, 6
[4]  
Chen SY, 2020, INT CONF ACOUST SPEE, P1464, DOI [10.1109/ICASSP40776.2020.9053765, 10.1109/icassp40776.2020.9053765]
[5]   Recent advances and applications of deep learning methods in materials science [J].
Choudhary, Kamal ;
DeCost, Brian ;
Chen, Chi ;
Jain, Anubhav ;
Tavazza, Francesca ;
Cohn, Ryan ;
Park, Cheol Woo ;
Choudhary, Alok ;
Agrawal, Ankit ;
Billinge, Simon J. L. ;
Holm, Elizabeth ;
Ong, Shyue Ping ;
Wolverton, Chris .
NPJ COMPUTATIONAL MATERIALS, 2022, 8 (01)
[6]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[7]   A Stacked Multi-Connection Simple Reducing Net for Brain Tumor Segmentation [J].
Ding, Yi ;
Chen, Fujuan ;
Zhao, Yang ;
Wu, Zhixing ;
Zhang, Chao ;
Wu, Dongyuan .
IEEE ACCESS, 2019, 7 :104011-104024
[8]   A light-weight, efficient, and general cross-modal image fusion network [J].
Fang, Aiqing ;
Zhao, Xinbo ;
Yang, Jiaqi ;
Qin, Beibei ;
Zhang, Yanning .
NEUROCOMPUTING, 2021, 463 :198-211
[9]   Image dehazing by artificial multiple-exposure image fusion [J].
Galdran, A. .
SIGNAL PROCESSING, 2018, 149 :135-147
[10]   Hybrid High Dynamic Range Imaging fusing Neuromorphic and Conventional Images [J].
Han, Jin ;
Yang, Yixin ;
Duan, Peiqi ;
Zhou, Chu ;
Ma, Lei ;
Xu, Chao ;
Huang, Tiejun ;
Sato, Imari ;
Shi, Boxin .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (07) :8553-8565