PLPose: An efficient framework for detecting power lines via key points-based pose estimation

被引:7
作者
Jaffari, Rabeea [1 ,2 ]
Hashmani, Manzoor Ahmed [2 ]
Reyes-Aldasoro, Constantino Carlos [3 ]
Junejo, Aisha Zahid [2 ]
Taib, Hasmi [4 ]
Abdullah, M. Nasir B. [5 ]
机构
[1] Mehran Univ Engn & Technol, Software Engn Dept, Jamshoro, Sindh, Pakistan
[2] Univ Teknol PETRONAS, Dept Comp & Informat Sci, Seri Iskandar, Perak, Malaysia
[3] City Univ London, Dept Comp Sci, giCtr, London EC1V 0HB, England
[4] Petroliam Nas Berhad Petronas, Project Delivery & Technol Div, Grp Tech Solut, Engn Dept,Floating Prod Facil Civil & Struct Sect, Kuala Lumpur, Selangor, Malaysia
[5] Petroliam Nas Berhad Petronas, Kuala Lumpur, Selangor, Malaysia
关键词
Power lines; Cable detection; Unmanned aerial vehicles; Key point pose estimation; Deep learning; AERIAL IMAGES; RECOGNITION; EXTRACTION;
D O I
10.1016/j.jksuci.2023.101615
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The inspection and maintenance of electrical power lines (PL) via unmanned aerial vehicles (UAV) require fast and accurate PL detection to ensure smooth and secure electrical operations. However, the detection of PLs from aerial images is a highly challenging task due to the thin nature of PLs and the inherent noisy image backgrounds. Traditional line and edge detection methods do not detect the PLs accurately due to the cluttered backgrounds while the more recent deep learning (DL) CNNs are also not feasible for efficient PL detection due to the coarse bounding boxes and the computationally expensive pixel-based segmentations. Hence, in this study we propose PLPose, a novel framework for detecting the PLs via key points-based pose estimation technique and adapt the MobileNetV3 CNN for this task (kMobileNetV3), by adding a simple key point detection head to predict the PL key points. We also introduce a novel data-centric architecture (kMobileNetV3 + UDP), by adding the unbiased data processing (UDP) module to our kMobileNetV3, for faster and more accurate key point-based PL detection along with novel methods for data annotations and performance evaluation. Evaluations of PLPose on three benchmark PL data -sets (PLDM, PLDU and the Mendeley Powerline Dataset) reveal that our proposed framework outperforms the state-of-the-art top-down pose estimation networks (HRNet-w32, HRNet-w32 + UDP and Resnet-50 Simple Baselines) in processing speed (-29 FPS) and model size (5.23 M) for PL detection. Thus, the comprehensive experimental results demonstrate the effectiveness of our proposed framework. Our code is available from Github (https://www.github.com/rubeea/pl_mmpose).(c) 2023 The Author(s). Published by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页数:18
相关论文
共 86 条
[1]  
Abdelfattah R., 2022, arXiv
[2]  
Amadi H.N., 2015, International Journal of Engineering Research Technology, V4, P956, DOI DOI 10.3390/LOGISTICS7020021
[3]  
Avizonis P., 1999, GAT NEW MILL 18 DIG
[4]   Deep convolutional networks do not classify based on global object shape [J].
Baker, Nicholas ;
Lu, Hongjing ;
Erlikhman, Gennady ;
Kellman, Philip J. .
PLOS COMPUTATIONAL BIOLOGY, 2018, 14 (12)
[5]   Detection of the power lines in UAV remote sensed images using spectral-spatial methods [J].
Bhola, Rishav ;
Krishna, Nandigam Hari ;
Ramesh, K. N. ;
Senthilnath, J. ;
Anand, Gautham .
JOURNAL OF ENVIRONMENTAL MANAGEMENT, 2018, 206 :1233-1242
[6]   Detection of Thin Lines using Low-Quality Video from Low-Altitude Aircraft in Urban Settings [J].
Candamo, Joshua ;
Kasturi, Rangachar ;
Goldgof, Dmitry ;
Sarkar, Sudeep .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2009, 45 (03) :937-949
[7]   Vision-based on-board collision avoidance system to aircraft navigation [J].
Candamo, Joshua ;
Kasturi, Rangachar ;
Goldgof, Dmitry ;
Sarkar, Sudeep .
UNMANNED SYSTEMS TECHNOLOGY VIII, PTS 1 AND 2, 2006, 6230
[9]  
Cerón A, 2014, INT CONF UNMAN AIRCR, P632, DOI 10.1109/ICUAS.2014.6842307
[10]   Monocular human pose estimation: A survey of deep learning-based methods [J].
Chen, Yucheng ;
Tian, Yingli ;
He, Mingyi .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2020, 192