PIA: Parallel Architecture with Illumination Allocator for Joint Enhancement and Detection in Low-Light

被引:6
作者
Ma, Tengyu [1 ]
Ma, Long [1 ]
Fan, Xin [1 ]
Luo, Zhongxuan [1 ]
Liu, Risheng [1 ]
机构
[1] Dalian Univ Technol, Dalian, Peoples R China
来源
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022 | 2022年
基金
中国国家自然科学基金;
关键词
low-light image enhancement; low-light face detection; parallel architecture; illumination allocator;
D O I
10.1145/3503161.3548041
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Visual perception in low-light conditions (e.g., nighttime) plays an important role in various multimedia-related applications (e.g., autonomous driving). The enhancement (provides a visual-friendly appearance) and detection (detects the instances of objects) in lowlight are two fundamental and crucial visual perception tasks. In this paper, we make efforts on how to simultaneously realize lowlight enhancement and detection from two aspects. First, we define a parallel architecture to satisfy the task demand for both two tasks. In which, a decomposition-type warm-start acting on the entrance of parallel architecture is developed to narrow down the adverse effects brought by low-light scenes to some extent. Second, a novel illumination allocator is designed by encoding the key illumination component (the inherent difference between normal-light and lowlight) to extract hierarchical features for assisting in enhancement and detection. Further, we make a substantive discussion for our proposed method. That is, we solve enhancement in a coarse-to-fine manner and handle detection in a decomposed-to-integrated fashion. Finally, multidimensional analytical and evaluated experiments are performed to indicate our effectiveness and superiority. The code is available at https://github.com/tengyu1998/PIA.
引用
收藏
页码:2070 / 2078
页数:9
相关论文
共 37 条
  • [1] Transform coefficient histogram-based image enhancement algorithms using contrast entropy
    Agaian, Sos S.
    Silver, Blair
    Panetta, Karen A.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (03) : 741 - 758
  • [2] Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learning
    Baik, Sungyong
    Choi, Janghoon
    Kim, Heewon
    Cho, Dohee
    Min, Jaesik
    Lee, Kyoung Mu
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9445 - 9454
  • [3] Multitask AET with Orthogonal Tangent Regularity for Dark Object Detection
    Cui, Ziteng
    Qi, Guo-Jun
    Gu, Lin
    You, Shaodi
    Zhang, Zenghui
    Harada, Tatsuya
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 2533 - 2542
  • [4] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [5] FAN QW, 2018, ACM T GRAPHIC, P164
  • [6] He K., 2016, 2016 IEEE C COMP VIS, DOI [DOI 10.1109/CVPR.2016.90, 10.1109/CVPR.2016.90]
  • [7] EnlightenGAN: Deep Light Enhancement Without Paired Supervision
    Jiang, Yifan
    Gong, Xinyu
    Liu, Ding
    Cheng, Yu
    Fang, Chen
    Shen, Xiaohui
    Yang, Jianchao
    Zhou, Pan
    Wang, Zhangyang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2340 - 2349
  • [8] Bridging the Gap between Low-Light Scenes: Bilevel Learning for Fast Adaptation
    Jin, Dian
    Ma, Long
    Liu, Risheng
    Fan, Xin
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2401 - 2409
  • [9] Li C., 2022, IEEE T PATTERN ANAL, V44, P4225, DOI [DOI 10.1109/TPAMI.2021.3063604, 10.1109/TPAMI.2021.3063604]
  • [10] DSFD: Dual Shot Face Detector
    Li, Jian
    Wang, Yabiao
    Wang, Changan
    Tai, Ying
    Qian, Jianjun
    Yang, Jian
    Wang, Chengjie
    Li, Jilin
    Huang, Feiyue
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 5055 - 5064