Don't worry about noisy labels in soft shadow detection

被引:0
作者
Wu, Xian-Tao [1 ]
Wu, Wen [2 ]
Zhang, Lin-Lin [1 ]
Wan, Yi [3 ]
机构
[1] Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830046, Peoples R China
[2] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou 310018, Peoples R China
[3] Shaoxing Univ, Dept Comp Sci & Engn, Shaoxing 312000, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Noisy label; Transformer; Soft shadow; ILLUMINATION; NETWORKS; REMOVAL;
D O I
10.1007/s00371-022-02730-9
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Soft shadow is harder to detect than hard shadow as its complex characteristics (i.e., low-contrast, irregular shape, and ambiguous shadow boundaries). To improve the detecting capacity of these images, in this paper, we create a new benchmark for soft shadow detection and then design a reasonable supervision strategy to alleviate the effect of annotation noises. Next, we present a general shadow detection framework based on transformer to deal with complex scenes. Concretely, we combine the traditional channel attention and recent popular self-attention into our network. Moreover, we introduce a deep supervision mechanism that performs deep layer supervision to "guide " early classification results at each layer, which can further improve our detection performance. Finally, experimental results on three datasets show that our shadow transformer can be favorable against current state-of-the-art detectors.
引用
收藏
页码:6297 / 6308
页数:12
相关论文
共 47 条
  • [1] Weber local descriptor for image analysis and recognition: a survey
    Banerjee, Arnab
    Das, Nibaran
    Santosh, K. C.
    [J]. VISUAL COMPUTER, 2022, 38 (01) : 321 - 343
  • [2] Brendel W., 2019, arXiv
  • [3] Carion N., 2020, EUROPEAN C COMPUTER, V12346, P213, DOI 10.1007/978-3-030-58452-8_13
  • [4] Chen J., 2021, ARXIV
  • [5] A Multi-task Mean Teacher for Semi-supervised Shadow Detection
    Chen, Zhihao
    Zhu, Lei
    Wan, Liang
    Wang, Song
    Feng, Wei
    Heng, Pheng-Ann
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5610 - 5619
  • [6] Dosovitskiy A., 2020, INT C LEARN REPR
  • [7] On the removal of shadows from images
    Finlayson, GD
    Hordley, SD
    Lu, C
    Drew, MS
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (01) : 59 - 68
  • [8] Entropy Minimization for Shadow Removal
    Finlayson, Graham D.
    Drew, Mark S.
    Lu, Cheng
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2009, 85 (01) : 35 - 57
  • [9] Learning to Remove Soft Shadows
    Gryka, Maciej
    Terry, Michael
    Brostow, Gabriel J.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (05):
  • [10] Guo RQ, 2011, PROC CVPR IEEE