Transmission Line Segmentation Solutions for UAV Aerial Photography Based on Improved UNet

被引:11
作者
He, Min [1 ,2 ]
Qin, Liang [1 ,2 ]
Deng, Xinlan [1 ,2 ]
Zhou, Sihan [1 ,2 ]
Liu, Haofeng [1 ,2 ]
Liu, Kaipei [1 ,2 ]
机构
[1] Wuhan Univ, Sch Elect & Automat, Wuhan 430072, Peoples R China
[2] Hubei Key Lab Power Equipment & Syst Secur Integra, Wuhan 430072, Peoples R China
关键词
transmission line segmentation; UAV; UNet; light-weighting model; ACmix; CARAFE; NETWORK;
D O I
10.3390/drones7040274
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The accurate and efficient detection of power lines and towers in aerial drone images with complex backgrounds is crucial for the safety of power grid operations and low-altitude drone flights. In this paper, we propose a new method that enhances the deep learning segmentation model UNet algorithm called TLSUNet. We enhance the UNet algorithm by using a lightweight backbone structure to extract the features and then reconstructing them with contextual information features. In this network model, to reduce its parameters and computational complexity, we adopt DFC-GhostNet (Dubbed Full Connected) as the backbone feature extraction network, which is composed of the DFC-GhostBottleneck structure and uses asymmetric convolution to capture long-distance targets in transmission lines, thus enhancing the model's extraction capability. Additionally, we design a hybrid feature extraction module based on convolution and a transformer to refine deep semantic features and improve the model's ability to locate towers and transmission lines in complex environments. Finally, we adopt the up-sampling operator CARAFE (Content-Aware Re-Assembly of FEature) to improve segmentation accuracy by enhancing target restoration using contextual neighborhood pixel information correlation under feature decoding. Our experiments on public aerial photography datasets demonstrate that the improved model requires only 8.3% of the original model's computational effort and has only 21.4% of the original model's parameters, while achieving a reduction in inference speed delay by 0.012 s. The segmentation metrics also showed significant improvements, with the mIOU improving from 79.75% to 86.46% and the mDice improving from 87.83% to 92.40%. These results confirm the effectiveness of our proposed method.
引用
收藏
页数:23
相关论文
共 41 条
[1]  
Abdelfattah R., 2020, P ASIAN C COMPUTER V, P1
[2]  
[Anonymous], About us
[3]  
CAO Haopeng, 2018, Computer Technology and Development, V28, P164
[4]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[5]   Attention-Based Multimodal Image Feature Fusion Module for Transmission Line Detection [J].
Choi, Hyeyeon ;
Yun, Jong Pil ;
Kim, Bum Jun ;
Jang, Hyeonah ;
Kim, Sang Woo .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (11) :7686-7695
[6]   Remote Sensing Object Detection Based on Receptive Field Expansion Block [J].
Dong, Xiaohu ;
Fu, Ruigang ;
Gao, Yinghui ;
Qin, Yao ;
Ye, Yuanxin ;
Li, Biao .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[7]   USE OF HOUGH TRANSFORMATION TO DETECT LINES AND CURVES IN PICTURES [J].
DUDA, RO ;
HART, PE .
COMMUNICATIONS OF THE ACM, 1972, 15 (01) :11-&
[8]   Real Time Power Equipment Meter Recognition Based on Deep Learning [J].
Fan, Zizhu ;
Shi, Linrui ;
Xi, Chao ;
Wang, Hui ;
Wang, Song ;
Wu, Gaochang .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[9]   Efficient Parallel Branch Network With Multi-Scale Feature Fusion for Real-Time Overhead Power Line Segmentation [J].
Gao, Zishu ;
Yang, Guodong ;
Li, En ;
Liang, Zize ;
Guo, Rui .
IEEE SENSORS JOURNAL, 2021, 21 (10) :12220-12227
[10]   A Lightweight Aerial Power Line Segmentation Algorithm Based on Attention Mechanism [J].
Han, Gujing ;
Zhang, Min ;
Li, Qiang ;
Liu, Xia ;
Li, Tao ;
Zhao, Liu ;
Liu, Kaipei ;
Qin, Liang .
MACHINES, 2022, 10 (10)