PIA: Parallel Architecture with Illumination Allocator for Joint Enhancement and Detection in Low-Light

被引:6
作者
Ma, Tengyu [1 ]
Ma, Long [1 ]
Fan, Xin [1 ]
Luo, Zhongxuan [1 ]
Liu, Risheng [1 ]
机构
[1] Dalian Univ Technol, Dalian, Peoples R China
来源
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022 | 2022年
基金
中国国家自然科学基金;
关键词
low-light image enhancement; low-light face detection; parallel architecture; illumination allocator;
D O I
10.1145/3503161.3548041
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Visual perception in low-light conditions (e.g., nighttime) plays an important role in various multimedia-related applications (e.g., autonomous driving). The enhancement (provides a visual-friendly appearance) and detection (detects the instances of objects) in lowlight are two fundamental and crucial visual perception tasks. In this paper, we make efforts on how to simultaneously realize lowlight enhancement and detection from two aspects. First, we define a parallel architecture to satisfy the task demand for both two tasks. In which, a decomposition-type warm-start acting on the entrance of parallel architecture is developed to narrow down the adverse effects brought by low-light scenes to some extent. Second, a novel illumination allocator is designed by encoding the key illumination component (the inherent difference between normal-light and lowlight) to extract hierarchical features for assisting in enhancement and detection. Further, we make a substantive discussion for our proposed method. That is, we solve enhancement in a coarse-to-fine manner and handle detection in a decomposed-to-integrated fashion. Finally, multidimensional analytical and evaluated experiments are performed to indicate our effectiveness and superiority. The code is available at https://github.com/tengyu1998/PIA.
引用
收藏
页码:2070 / 2078
页数:9
相关论文
共 37 条
  • [11] Liang Jinxiu, 2021, IEEE T MULTIMEDIA
  • [12] Liu R., 2021, IEEE T NEURAL NETWOR
  • [13] Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancement
    Liu, Risheng
    Ma, Long
    Zhang, Jiaao
    Fan, Xin
    Luo, Zhongxuan
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10556 - 10565
  • [14] Liu Risheng, 2021, ARXIV211204719
  • [15] SSD: Single Shot MultiBox Detector
    Liu, Wei
    Anguelov, Dragomir
    Erhan, Dumitru
    Szegedy, Christian
    Reed, Scott
    Fu, Cheng-Yang
    Berg, Alexander C.
    [J]. COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 : 21 - 37
  • [16] Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
    Liu, Ze
    Lin, Yutong
    Cao, Yue
    Hu, Han
    Wei, Yixuan
    Zhang, Zheng
    Lin, Stephen
    Guo, Baining
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9992 - 10002
  • [17] Getting to know low-light images with the Exclusively Dark dataset
    Loh, Yuen Peng
    Chan, Chee Seng
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 178 : 30 - 42
  • [18] Toward Fast, Flexible, and Robust Low-Light Image Enhancement
    Ma, Long
    Ma, Tengyu
    Liu, Risheng
    Fan, Xin
    Luo, Zhongxuan
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5627 - 5636
  • [19] Ma Long, 2021, IEEE T NEURAL NETWOR
  • [20] Ma Long, 2022, IEEE Transactions on Multimedia