Unsupervised Face Detection in the Dark

被引:30
作者
Wang, Wenjing [1 ]
Wang, Xinhao [1 ]
Yang, Wenhan [1 ]
Liu, Jiaying [1 ]
机构
[1] Peking Univ, Wangxuan Inst Comp Technol, Beijing 100080, Peoples R China
基金
中国国家自然科学基金;
关键词
Face detection; Face recognition; Lighting; Adaptation models; Detectors; Annotations; Task analysis; Low-light; domain adaptation; illumination enhancement; high-level; low-level; face detection;
D O I
10.1109/TPAMI.2022.3152562
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low-light face detection is challenging but critical for real-world applications, such as nighttime autonomous driving and city surveillance. Current face detection models rely on extensive annotations and lack generality and flexibility. In this paper, we explore how to learn face detectors without low-light annotations. Fully exploiting existing normal light data, we propose adapting face detectors from normal light to low light. This task is difficult because the gap between brightness and darkness is too large and complicated at the object level and pixel level. Accordingly, the performance of current low-light enhancement or adaptation methods is unsatisfactory. To solve this problem, we propose a joint High-Low Adaptation (HLA) framework. We design bidirectional low-level adaptation and multitask high-level adaptation. For low-level, we enhance the dark images and degrade the normal-light images, making both domains move toward each other. For high-level, we combine context-based and contrastive learning to comprehensively close the features on different domains. Experiments show that our HLA-Face v2 model obtains superior low-light face detection performance even without the use of low-light annotations. Moreover, our adaptation scheme can be extended to a wide range of applications, such as improving supervised learning and generic object detection.
引用
收藏
页码:1250 / 1266
页数:17
相关论文
共 77 条
  • [11] Semantic Segmentation With Low Light Images by Modified CycleGAN-Based Image Enhancement
    Cho, Se Woon
    Baek, Na Rae
    Koo, Ja Hyung
    Arsalan, Muhammad
    Park, Kang Ryoung
    [J]. IEEE ACCESS, 2020, 8 : 93561 - 93585
  • [12] The Cityscapes Dataset for Semantic Urban Scene Understanding
    Cordts, Marius
    Omran, Mohamed
    Ramos, Sebastian
    Rehfeld, Timo
    Enzweiler, Markus
    Benenson, Rodrigo
    Franke, Uwe
    Roth, Stefan
    Schiele, Bernt
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3213 - 3223
  • [13] D'Innocente Antonio, 2020, Computer Vision - ECCV 2020 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12361), P732, DOI 10.1007/978-3-030-58517-4_43
  • [14] Deng JK, 2019, Arxiv, DOI [arXiv:1905.00641, 10.48550/ARXIV.1905.00641]
  • [15] Dong X, 2011, IEEE INT CON MULTI
  • [16] A fusion-based enhancing method for weakly illuminated images
    Fu, Xueyang
    Zeng, Delu
    Huang, Yue
    Liao, Yinghao
    Ding, Xinghao
    Paisley, John
    [J]. SIGNAL PROCESSING, 2016, 129 : 82 - 96
  • [17] Ganin Y, 2016, J MACH LEARN RES, V17
  • [18] Gidaris S., 2018, ARXIV180307728
  • [19] Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement
    Guo, Chunle
    Li, Chongyi
    Guo, Jichang
    Loy, Chen Change
    Hou, Junhui
    Kwong, Sam
    Cong, Runmin
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1777 - 1786
  • [20] LIME: Low-Light Image Enhancement via Illumination Map Estimation
    Guo, Xiaojie
    Li, Yu
    Ling, Haibin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) : 982 - 993