Multiexposed Image-Fusion Strategy Using Mutual Image Translation Learning with Multiscale Surround Switching Maps

被引:1
作者
Go, Young-Ho [1 ]
Lee, Seung-Hwan [1 ]
Lee, Sung-Hak [1 ]
机构
[1] Kyungpook Natl Univ, Sch Elect & Elect Engn, 80 Daehak ro, Daegu 41566, South Korea
关键词
CycleGAN; multiexposed image fusion; mutual image translation learning; switching map; QUALITY ASSESSMENT;
D O I
10.3390/math12203244
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
The dynamic range of an image represents the difference between its darkest and brightest areas, a crucial concept in digital image processing and computer vision. Despite display technology advancements, replicating the broad dynamic range of the human visual system remains challenging, necessitating high dynamic range (HDR) synthesis, combining multiple low dynamic range images captured at contrasting exposure levels to generate a single HDR image that integrates the optimal exposure regions. Recent deep learning advancements have introduced innovative approaches to HDR generation, with the cycle-consistent generative adversarial network (CycleGAN) gaining attention due to its robustness against domain shifts and ability to preserve content style while enhancing image quality. However, traditional CycleGAN methods often rely on unpaired datasets, limiting their capacity for detail preservation. This study proposes an improved model by incorporating a switching map (SMap) as an additional channel in the CycleGAN generator using paired datasets. The SMap focuses on essential regions, guiding weighted learning to minimize the loss of detail during synthesis. Using translated images to estimate the middle exposure integrates these images into HDR synthesis, reducing unnatural transitions and halo artifacts that could occur at boundaries between various exposures. The multilayered application of the retinex algorithm captures exposure variations, achieving natural and detailed tone mapping. The proposed mutual image translation module extends CycleGAN, demonstrating superior performance in multiexposure fusion and image translation, significantly enhancing HDR image quality. The image quality evaluation indices used are CPBDM, JNBM, LPC-SI, S3, JPEG_2000, and SSEQ, and the proposed model exhibits superior performance compared to existing methods, recording average scores of 0.6196, 15.4142, 0.9642, 0.2838, 80.239, and 25.054, respectively. Therefore, based on qualitative and quantitative results, this study demonstrates the superiority of the proposed model.
引用
收藏
页数:29
相关论文
共 44 条
[1]   Image lightness rescaling using sigmoidal contrast enhancement functions [J].
Braun, GJ ;
Fairchild, MD .
JOURNAL OF ELECTRONIC IMAGING, 1999, 8 (04) :380-393
[2]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[3]   A study of efficiency and accuracy in the transformation from RGB to CIELAB color space [J].
Connolly, C ;
Fliess, T .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1997, 6 (07) :1046-1048
[4]  
Debevec P. E., 1997, Computer Graphics Proceedings, SIGGRAPH 97, P369, DOI 10.1145/258734.258884
[5]   A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) [J].
Ferzli, Rony ;
Karam, Lina J. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (04) :717-728
[6]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[7]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[8]  
GYHrlt, 2024, GYHrlt/DataimgMEF/SelfImage
[9]   Image Sharpness Assessment Based on Local Phase Coherence [J].
Hassen, Rania ;
Wang, Zhou ;
Salama, Magdy M. A. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (07) :2798-2810
[10]  
Ibrahim M, 2019, International Journal of Computer Applications, V177, P26, DOI [10.5120/ijca2019919637, 10.5120/ijca2019919637, DOI 10.5120/IJCA2019919637]