Fast and Efficient Shadow Detection Algorithm via Shadow Decoupling and Reparameterization

被引:0
作者
Chen, Jueyu [1 ]
Yang, Yuhong [1 ]
Xing, Guanyu [2 ]
Liu, Yanli [2 ]
机构
[1] College of Computer Sci., Sichuan Univ., Chengdu
[2] National Key Lab. of Fundamental Sci. on Synthetic Vision, Sichuan Univ., Chengdu
来源
Gongcheng Kexue Yu Jishu/Advanced Engineering Sciences | 2024年 / 56卷 / 05期
关键词
convolutional network; deep learning; mask decoupling; reparameterization; shadow detection;
D O I
10.12454/j.jsuese.202300005
中图分类号
学科分类号
摘要
Since the number of pixels along shadow boundaries is often significantly smaller than that of pixles within shadow regions, accurately detecting shadow boundary areas is more challenging than detecting pixels within the shadow interior. To improve detection accuracy at shadow boundaries, a novel and efficient lightweight boundary-aware shadow detection algorithm called RBNet was proposed in this paper. During the supervised training phase, the input image was divided into shadow and non-shadow regions, and the distance transforms were applied to decouple the shadow and non-shadow regions into a boundary part and a body part respectively. Secondly, the boundary features of shadow regions were learned and the impact of shadow boundaries and interior pixels were balanced in the loss function of RBNet. Additionally, a multi-branch fusion structured re-parameterization module named RepConv was designed in RBNet. Through re-parameterization, the model parameters and computational cost were reduced, and the inference speed was improved. A series of shadow detection comparison experiments and algorithm model comparison experiments between the proposed RBNet and other common shadow detection algorithms is conducted in the paper. Experimental results demonstrate that the proposed shadow detection algorithm, RBNet, not only has the smallest model size but also achieves the fastest inference speed, while outperforming existing shadow detection algorithms in terms of BER performance. RBNet is highly applicable to mobile devices. When combined with shadow removal algorithms, it can significantly enhance the accuracy of object detection or segmentation tasks. © 2024 Sichuan University. All rights reserved.
引用
收藏
页码:297 / 306
页数:9
相关论文
共 28 条
[1]  
Okabe T, Sato I, Sato Y., Attached shadow coding:Estimating surface normals from shadows under unknown reflectance and lighting conditions[C], Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, pp. 1693-1700, (2009)
[2]  
Lalonde J F, Efros A A, Narasimhan S G., Estimating the natural illumination conditions from a single outdoor image[J], International Journal of Computer Vision, 98, 2, pp. 123-145, (2012)
[3]  
Junejo I N, Foroosh H., Estimating geo-temporal location of stationary cameras using shadow trajectories[M], Computer Vision—ECCV 2008, pp. 318-331, (2008)
[4]  
Ecins A, Fermuller C, Aloimonos Y., Shadow free segmentation in still images using local density measure[C], Proceedings of the 2014 IEEE International Conference on Computational Photography(ICCP), pp. 1-8, (2014)
[5]  
Cucchiara R, Grana C, Piccardi M, Et al., Detecting moving objects,ghosts,and shadows in video streams[J], IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 10, pp. 1337-1342, (2003)
[6]  
Nadimi S, Bhanu B., Physical models for moving shadow and object detection in video[J], IEEE Transactions on Pattern Analysis and Machine Intelligence, 26, 8, pp. 1079-1087, (2004)
[7]  
Hu Xiaowei, Zhu Lei, Fu C W, Et al., Direction-aware spatial context features for shadow detection[C], Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7454-7462, (2018)
[8]  
Xiaowei Hu, Tianyu Wang, Fu C W, Et al., Revisiting shadow detection:A new benchmark dataset for complex world[J], IEEE Transactions on Image Processing, 30, pp. 1925-1934, (2021)
[9]  
Lei Zhu, Zijun Deng, Xiaowei Hu, Et al., Bidirectional feature pyramid network with recurrent attention residual modules for shadow detection[M], Computer Vision—ECCV 2008, pp. 122-137, (2018)
[10]  
Quanlong Zheng, Xiaotian Qiao, Cao Ying, Et al., Distractionaware shadow detection[C], Proceedings of the 2019 IEEE/ CVF Conference on Computer Vision and Pattern Recognition(CVPR), pp. 5162-5171, (2019)