Low-Light Salient Object Detection by Learning to Highlight the Foreground Objects

被引:6
|
作者
Lu, Xiao [1 ]
Yuan, Yulin [1 ]
Liu, Xing [1 ]
Wang, Lucai [1 ]
Zhou, Xuanyu [1 ]
Yang, Yimin [2 ]
机构
[1] Hunan Normal Univ, Coll Engn & Design, Changsha 410081, Peoples R China
[2] Western Univ, Dept Elect & Comp Engn, London, ON N6A 3K7, Canada
基金
中国国家自然科学基金;
关键词
Salient object detection; low-light images; image enhancement; deep convolutional neural networks; datasets; ENHANCEMENT;
D O I
10.1109/TCSVT.2024.3377108
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Previous methods in salient object detection (SOD) mainly focused on favorable illumination circumstances while neglecting the performance in low-light condition, which significantly impedes the development of related down-stream tasks. In this work, considering that it is impractical to annotate the large-scale labels for this task, we present a framework (HDNet) to detect the salient objects in low-light images with the synthetic images. Our HDNet consists of a foreground highlight sub-network (HNet) and an appearance-aware detection sub-network (DNet), both of which can be learned jointly in an end-to-end manner. Specifically, to highlight the foreground objects, we design the HNet to estimate the parameters to adjust the dynamic range for each pixel adaptively, which can be trained via the weak supervision signals of the salient object labels. In addition, we design a simple detection network (DNet) with a contextual feature fusion module and a multi-scale feature refine module for detailed feature fusion and refinement. Furthermore, we contribute the first annotated dataset for salient object detection in low-light images (SOD-LL), including 6,000 labeled synthetic images (SOD-LLS) and 2,000 labeled real images (SOD-LLR). Experimental results on SOD-LL and other low-light videos in the wild demonstrate the effectiveness and generalization ability of our method. Our dataset and code are available at https://github.com/Ylinyuan/HDNet.
引用
收藏
页码:7712 / 7724
页数:13
相关论文
共 50 条
  • [1] Salient Objects in Clutter: Bringing Salient Object Detection to the Foreground
    Fan, Deng-Ping
    Cheng, Ming-Ming
    Liu, Jiang-Jiang
    Gao, Shang-Hua
    Hou, Qibin
    Borji, Ali
    COMPUTER VISION - ECCV 2018, PT 15, 2018, 11219 : 196 - 212
  • [2] Low-Light Salient Object Detection Meets the Small Size
    Wang, Shiqin
    Xu, Xin
    Chen, Haoyang
    Jiang, Kui
    Wang, Zheng
    Tang, Ke
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024,
  • [3] Degradation-removed multiscale fusion for low-light salient object detection
    Yu, Nana
    Wang, Jie
    Shi, Hong
    Zhang, Zihao
    Han, Yahong
    PATTERN RECOGNITION, 2024, 155
  • [4] Joint learning of foreground, background and edge for salient object detection
    Wu, Qin
    Zhu, Pengcheng
    Chai, Zhilei
    Guo, Guodong
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 240
  • [5] Global guidance-based integration network for salient object detection in low-light images
    Zhang, Zenan
    Guo, Jichang
    Yue, Huihui
    Wang, Yudong
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [6] Low-light DEtection TRansformer (LDETR): object detection in low-light and adverse weather conditions
    Tiwari A.K.
    Pattanaik M.
    Sharma G.K.
    Multimedia Tools and Applications, 2024, 83 (36) : 84231 - 84248
  • [7] Salient object detection in low-light images via functional optimization-inspired feature polishing
    Yue, Huihui
    Guo, Jichang
    Yin, Xiangjun
    Zhang, Yi
    Zheng, Sida
    Zhang, Zenan
    Li, Chongyi
    KNOWLEDGE-BASED SYSTEMS, 2022, 257
  • [8] PaIaNet: position-aware and identification-aware network for low-light salient object detection
    Yue, Huihui
    Guo, Jichang
    Yin, Xiangjun
    Zhang, Yi
    Zheng, Sida
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024, 15 (03) : 1137 - 1151
  • [9] PaIaNet: position-aware and identification-aware network for low-light salient object detection
    Huihui Yue
    Jichang Guo
    Xiangjun Yin
    Yi Zhang
    Sida Zheng
    International Journal of Machine Learning and Cybernetics, 2024, 15 : 1137 - 1151
  • [10] Salient object detection based on compactness and foreground connectivity
    Yanzhao Wang
    Guohua Peng
    Machine Vision and Applications, 2018, 29 : 1143 - 1155