Low-Light Image and Video Enhancement Using Deep Learning: A Survey

被引:178
|
作者
Li, Chongyi [1 ]
Guo, Chunle [2 ]
Han, Linghao [2 ]
Jiang, Jun [3 ]
Cheng, Ming-Ming [2 ]
Gu, Jinwei [3 ]
Loy, Chen Change [1 ]
机构
[1] Nanyang Technol Univ NTU, S Lab, Singapore 639798, Singapore
[2] Nankai Univ, Coll Comp Sci, Tianjin 300071, Peoples R China
[3] SenseTime, San Jose, CA 95110 USA
关键词
Lighting; Deep learning; Feature extraction; Supervised learning; Cameras; Training data; Photography; Image and video restoration; low-light image dataset; low-light image enhancement platform; computational photography; DYNAMIC HISTOGRAM EQUALIZATION; NETWORK; REPRESENTATION; ILLUMINATION;
D O I
10.1109/TPAMI.2021.3126387
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low-light image enhancement (LLIE) aims at improving the perception or interpretability of an image captured in an environment with poor illumination. Recent advances in this area are dominated by deep learning-based solutions, where many learning strategies, network structures, loss functions, training data, etc. have been employed. In this paper, we provide a comprehensive survey to cover various aspects ranging from algorithm taxonomy to unsolved open issues. To examine the generalization of existing methods, we propose a low-light image and video dataset, in which the images and videos are taken by different mobile phones' cameras under diverse illumination conditions. Besides, for the first time, we provide a unified online platform that covers many popular LLIE methods, of which the results can be produced through a user-friendly web interface. In addition to qualitative and quantitative evaluation of existing methods on publicly available and our proposed datasets, we also validate their performance in face detection in the dark. This survey together with the proposed dataset and online platform could serve as a reference source for future study and promote the development of this research field. The proposed platform and dataset as well as the collected methods, datasets, and evaluation metrics are publicly available and will be regularly updated. Project page: https://www.mmlab-ntu.com/project/lliv_survey/index.html.
引用
收藏
页码:9396 / 9416
页数:21
相关论文
共 50 条
  • [1] A survey on learning-based low-light image and video enhancement
    Ye, Jing
    Qiu, Changzhen
    Zhang, Zhiyong
    DISPLAYS, 2024, 81
  • [2] A Survey of Deep Learning-Based Low-Light Image Enhancement
    Tian, Zhen
    Qu, Peixin
    Li, Jielin
    Sun, Yukun
    Li, Guohou
    Liang, Zheng
    Zhang, Weidong
    SENSORS, 2023, 23 (18)
  • [3] RetinexDIP: A Unified Deep Framework for Low-Light Image Enhancement
    Zhao, Zunjin
    Xiong, Bangshu
    Wang, Lei
    Ou, Qiaofeng
    Yu, Lei
    Kuang, Fa
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 1076 - 1088
  • [4] Low-light image enhancement based on deep learning: a survey
    Wang, Yong
    Xie, Wenjie
    Liu, Hongqi
    OPTICAL ENGINEERING, 2022, 61 (04)
  • [5] LightingNet: An Integrated Learning Method for Low-Light Image Enhancement
    Yang, Shaoliang
    Zhou, Dongming
    Cao, Jinde
    Guo, Yanbu
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 : 29 - 42
  • [6] A survey on image enhancement for Low-light images
    Guo, Jiawei
    Ma, Jieming
    Garcia-Fernandez, Angel F.
    Zhang, Yungang
    Liang, Haining
    HELIYON, 2023, 9 (04)
  • [7] Deep Pyramid Network for Low-Light Endoscopic Image Enhancement
    Yue, Guanghui
    Gao, Jie
    Cong, Runmin
    Zhou, Tianwei
    Li, Leida
    Wang, Tianfu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3834 - 3845
  • [8] Residual Quotient Learning for Zero-Reference Low-Light Image Enhancement
    Xie, Chao
    Fei, Linfeng
    Tao, Huanjie
    Hu, Yaocong
    Zhou, Wei
    Hoe, Jiun Tian
    Hu, Weipeng
    Tan, Yap-Peng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 365 - 378
  • [9] Learning Deep Context-Sensitive Decomposition for Low-Light Image Enhancement
    Ma, Long
    Liu, Risheng
    Zhang, Jiaao
    Fan, Xin
    Luo, Zhongxuan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5666 - 5680
  • [10] A Low-Light Image Enhancement Algorithm Using the Hybrid Strategy of Deep Learning and Image Fusion
    Xu S.-P.
    Lin Z.-Y.
    Zhang G.-Z.
    Chen X.-G.
    Li F.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2021, 49 (01): : 72 - 76