Low-Light Image and Video Enhancement for More Robust Computer Vision Tasks: A Review

被引:2
作者
Tatana, Mpilo M. [1 ]
Tsoeu, Mohohlo S. [2 ]
Maswanganyi, Rito C. [1 ]
机构
[1] Durban Univ Technol, Dept Elect & Comp Engn, ZA-4001 Durban, South Africa
[2] Durban Univ Technol, Steve Biko Campus, ZA-4001 Durban, South Africa
基金
新加坡国家研究基金会;
关键词
light enhancement; video de-flickering; zero-shot learning; action recognition; object detection; computer vision; criminal activity; ACTION RECOGNITION; HISTOGRAM EQUALIZATION; DEEP; ILLUMINATION; COMPENSATION; FRAMEWORK; RETINEX; NETWORK;
D O I
10.3390/jimaging11040125
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Computer vision aims to enable machines to understand the visual world. Computer vision encompasses numerous tasks, namely action recognition, object detection and image classification. Much research has been focused on solving these tasks, but one that remains relatively uncharted is light enhancement (LE). Low-light enhancement (LLE) is crucial as computer vision tasks fail in the absence of sufficient lighting, having to rely on the addition of peripherals such as sensors. This review paper will shed light on this (focusing on video enhancement) subfield of computer vision, along with the other forementioned computer vision tasks. The review analyzes both traditional and deep learning-based enhancers and provides a comparative analysis on recent models in the field. The review also analyzes how popular computer vision tasks are improved and made more robust when coupled with light enhancement algorithms. Results show that deep learners outperform traditional enhancers, with supervised learners obtaining the best results followed by zero-shot learners, while computer vision tasks are improved with light enhancement coupling. The review concludes by highlighting major findings such as that although supervised learners obtain the best results, due to a lack of real-world data and robustness to new data, a shift to zero-shot learners is required.
引用
收藏
页数:44
相关论文
共 145 条
[1]   Nighttime image enhancement using a new illumination boost algorithm [J].
Al-Ameen, Zohair .
IET IMAGE PROCESSING, 2019, 13 (08) :1314-1320
[2]  
Amit Y., 2021, Computer Vision: A Reference Guide, P875, DOI [10.1007/978-3-030-63416-2_660, DOI 10.1007/978-3-030-63416-2_660]
[3]   A Histogram Modification Framework and Its Application for Image Contrast Enhancement [J].
Arici, Tarik ;
Dikbas, Salih ;
Altunbasak, Yucel .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (09) :1921-1935
[4]   A dataset for automatic violence detection in videos [J].
Bianculli, Miriana ;
Falcionelli, Nicola ;
Sernani, Paolo ;
Tomassini, Selene ;
Contardo, Paolo ;
Lombardi, Mara ;
Dragoni, Aldo Franco .
DATA IN BRIEF, 2020, 33
[5]   The 2018 PIRM Challenge on Perceptual Image Super-Resolution [J].
Blau, Yochai ;
Mechrez, Roey ;
Timofte, Radu ;
Michaeli, Tomer ;
Zelnik-Manor, Lihi .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 :334-355
[6]  
Bychkovsky V, 2011, PROC CVPR IEEE, P97
[7]   A Joint Intrinsic-Extrinsic Prior Model for Retinex [J].
Cai, Bolun ;
Xu, Xiangmin ;
Guo, Kailing ;
Jia, Kui ;
Hu, Bin ;
Tao, Dacheng .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4020-4029
[8]   Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancement [J].
Cai, Yuanhao ;
Bian, Hao ;
Lin, Jing ;
Wang, Haoqian ;
Timofte, Radu ;
Zhang, Yulun .
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, :12470-12479
[9]   Brightness guided preprocessing for automatic cold steel weapon detection in surveillance videos with deep learning [J].
Castillo, Alberto ;
Tabik, Siham ;
Perez, Francisco ;
Olmos, Roberto ;
Herrera, Francisco .
NEUROCOMPUTING, 2019, 330 :151-161
[10]   Blind Deblurring for Saturated Images [J].
Chen, Liang ;
Zhang, Jiawei ;
Lin, Songnan ;
Fang, Faming ;
Ren, Jimmy S. .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :6304-6312