A novel approach to low-light image and video enhancement using adaptive dual super-resolution generative adversarial networks and top-hat filtering

被引:1
作者
Vishalakshi [1 ,2 ]
Rani, Shobha [1 ,2 ]
Hanumantharaju [1 ,2 ]
机构
[1] BMS Inst Technol & Management, Dept Elect & Commun Engn, Res Ctr, Bengaluru, India
[2] Visvesvaraya Technol Univ, Belagavi, Karnataka, India
关键词
Adaptive fusion; Generative adversarial network; Image and video enhancement; Mobile devices; Super-resolution; Top-hat transform;
D O I
10.1016/j.compeleceng.2024.110052
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Image and video enhancement under low-light conditions is challenging, as the task involves more than just brightness adjustment. Without addressing issues such as artifacts, distortions, and noise in dark regions, brightness improvement alone can worsen the quality. This paper presents a novel approach to low-light image and video enhancement based on the adaptive fusion of Dual Super-Resolution Generative Adversarial Network (DSRGAN) models, followed by Top-Hat Gradient-Domain Filtering (THGDF). A soft thresholding mechanism is used to integrate the Memory Residual Super-Resolution Generative Adversarial Network (MRSRGAN) and the Weighted Perception Super-Resolution Generative Adversarial Network (WPSRGAN). MRSRGAN enhances fine details, improving the objective performance of the image, while WPSRGAN improves overall details, enhancing the subjective performance. Top-hat gradient- domain filtering is then applied to remove artifacts, distortions, and noise in both images and videos, resulting in outstanding perception scores. The proposed approach is validated using the quality assessment metrics such as Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measurement (SSIM), and Information Fidelity Criterion (IFC). Extensive experiments conducted on publicly available source codes and databases demonstrate that the proposed method is more effective than the existing state-of-the-art techniques.
引用
收藏
页数:29
相关论文
共 57 条
[41]   LEGAN: A low-light image enhancement generative adversarial network for industrial internet of smart-cameras [J].
Tao, Jing ;
Wang, Junliang ;
Zhang, Peng ;
Zhang, Jie ;
Yung, K. L. ;
Ip, W. H. .
INTERNET OF THINGS, 2024, 25
[42]   Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data [J].
Wang, Xintao ;
Xie, Liangbin ;
Dong, Chao ;
Shan, Ying .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, :1905-1914
[43]   Single image super-resolution with denoising diffusion GANS [J].
Xiao, Heng ;
Wang, Xin ;
Wang, Jun ;
Cai, Jing-Ye ;
Deng, Jian-Hua ;
Yan, Jing-Ke ;
Tang, Yi-Dong .
SCIENTIFIC REPORTS, 2024, 14 (01)
[44]   SUN Database: Exploring a Large Collection of Scene Categories [J].
Xiao, Jianxiong ;
Ehinger, Krista A. ;
Hays, James ;
Torralba, Antonio ;
Oliva, Aude .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2016, 119 (01) :3-22
[45]   Degrade for upgrade: Learning degradation representations for real-world low-light image enhancement [J].
Xu, Lintao ;
Hu, Changhui ;
Zhu, Weihong ;
Wu, Fei ;
Cai, Ziyun ;
Ye, Mengjun ;
Lu, Xiaobo .
COMPUTERS & ELECTRICAL ENGINEERING, 2024, 119
[46]   Fine-grained video super-resolution via spatial-temporal learning and image detail enhancement [J].
Yeh, Chia -Hung ;
Yang, Hsin-Fu ;
Lin, Yu -Yang ;
Huang, Wan-Jen ;
Tsai, Feng-Hsu ;
Kang, Li - Wei .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 131
[47]   An efficient multi-scale learning method for image super-resolution networks [J].
Ying, Wenyuan ;
Dong, Tianyang ;
Fan, Jing .
NEURAL NETWORKS, 2024, 169 :120-133
[48]   Super-Resolution Reconstruction of Particleboard Images Based on Improved SRGAN [J].
Yu, Wei ;
Zhou, Haiyan ;
Liu, Ying ;
Yang, Yutu ;
Shen, Yinxi .
FORESTS, 2023, 14 (09)
[49]   Blind Image Super-resolution with Elaborate Degradation Modeling on Noise and Kernel [J].
Yue, Zongsheng ;
Zhao, Qian ;
Xie, Jianwen ;
Zhang, Lei ;
Meng, Deyu ;
Wong, Kwan-Yee K. .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :2118-2128
[50]  
Zeyde R., 2010, INT C CURVES SURFACE, P711, DOI [DOI 10.1007/978-3-642-27413-847, DOI 10.1007/978-3-642-27413-8_47]