Low-Light Image and Video Enhancement Using Deep Learning: A Survey

被引:178
|
作者
Li, Chongyi [1 ]
Guo, Chunle [2 ]
Han, Linghao [2 ]
Jiang, Jun [3 ]
Cheng, Ming-Ming [2 ]
Gu, Jinwei [3 ]
Loy, Chen Change [1 ]
机构
[1] Nanyang Technol Univ NTU, S Lab, Singapore 639798, Singapore
[2] Nankai Univ, Coll Comp Sci, Tianjin 300071, Peoples R China
[3] SenseTime, San Jose, CA 95110 USA
关键词
Lighting; Deep learning; Feature extraction; Supervised learning; Cameras; Training data; Photography; Image and video restoration; low-light image dataset; low-light image enhancement platform; computational photography; DYNAMIC HISTOGRAM EQUALIZATION; NETWORK; REPRESENTATION; ILLUMINATION;
D O I
10.1109/TPAMI.2021.3126387
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low-light image enhancement (LLIE) aims at improving the perception or interpretability of an image captured in an environment with poor illumination. Recent advances in this area are dominated by deep learning-based solutions, where many learning strategies, network structures, loss functions, training data, etc. have been employed. In this paper, we provide a comprehensive survey to cover various aspects ranging from algorithm taxonomy to unsolved open issues. To examine the generalization of existing methods, we propose a low-light image and video dataset, in which the images and videos are taken by different mobile phones' cameras under diverse illumination conditions. Besides, for the first time, we provide a unified online platform that covers many popular LLIE methods, of which the results can be produced through a user-friendly web interface. In addition to qualitative and quantitative evaluation of existing methods on publicly available and our proposed datasets, we also validate their performance in face detection in the dark. This survey together with the proposed dataset and online platform could serve as a reference source for future study and promote the development of this research field. The proposed platform and dataset as well as the collected methods, datasets, and evaluation metrics are publicly available and will be regularly updated. Project page: https://www.mmlab-ntu.com/project/lliv_survey/index.html.
引用
收藏
页码:9396 / 9416
页数:21
相关论文
共 50 条
  • [21] Low-Light Image Enhancement Algorithm Based on Deep Learning and Retinex Theory
    Lei, Chenyu
    Tian, Qichuan
    APPLIED SCIENCES-BASEL, 2023, 13 (18):
  • [22] A comparative analysis of Deep Learning based approaches for Low-light Image Enhancement
    Parihar, Anil Singh
    Singhal, Shivam
    Nanduri, Srishti
    Raghav, Yash
    2020 5TH IEEE INTERNATIONAL CONFERENCE ON RECENT ADVANCES AND INNOVATIONS IN ENGINEERING (IEEE - ICRAIE-2020), 2020,
  • [23] Low-Light Stereo Image Enhancement
    Huang, Jie
    Fu, Xueyang
    Xiao, Zeyu
    Zhao, Feng
    Xiong, Zhiwei
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 2978 - 2992
  • [24] Low-Light Hyperspectral Image Enhancement
    Li, Xuelong
    Li, Guanlin
    Zhao, Bin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [25] UHD Low-light image enhancement via interpretable bilateral learning
    Lin, Qiaowanni
    Zheng, Zhuoran
    Jia, Xiuyi
    INFORMATION SCIENCES, 2022, 608 : 1401 - 1415
  • [26] Learning deep texture-structure decomposition for low-light image restoration and enhancement
    Zhao, Lijun
    Wang, Ke
    Zhang, Jinjing
    Wang, Anhong
    Bai, Huihui
    NEUROCOMPUTING, 2023, 524 : 126 - 141
  • [27] A deep Retinex network for underwater low-light image enhancement
    Ji, Kai
    Lei, Weimin
    Zhang, Wei
    MACHINE VISION AND APPLICATIONS, 2023, 34 (06)
  • [28] Low-Light Image Enhancement via a Deep Hybrid Network
    Ren, Wenqi
    Liu, Sifei
    Ma, Lin
    Xu, Qianqian
    Xu, Xiangyu
    Cao, Xiaochun
    Du, Junping
    Yang, Ming-Hsuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (09) : 4364 - 4375
  • [29] Unsupervised Low-Light Image Enhancement With Self-Paced Learning
    Luo, Yu
    Chen, Xuanrong
    Ling, Jie
    Huang, Chao
    Zhou, Wei
    Yue, Guanghui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 : 1808 - 1820
  • [30] FFENet: Learning Frequency Features for Low-Light Enhancement
    Liu, Zhenbing
    Gong, Junming
    Lu, Haoxiang
    Pan, Xipeng
    Lan, Rushi
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74