Real-Time Power Line Detection for Safe Flight of Agricultural Spraying Drones Using Embedded Systems and Deep Learning

被引:8
作者
Son, Hyun-Sik [1 ,2 ]
Kim, Deok-Keun [2 ,3 ]
Yang, Seung-Hwan [2 ]
Choi, Young-Kiu [1 ]
机构
[1] Pusan Natl Univ, Dept Elect & Comp Engn, Busan 43241, South Korea
[2] Korea Inst Ind Technol, Smart Agr Machinery R&D Grp, Gimje Si 54325, Jeollabuk Do, South Korea
[3] Chonnam Natl Univ, Interdisciplinary Program Agr & Life Sci, Gwangju 61186, South Korea
关键词
Drones; Labeling; Deep learning; Spraying; Software algorithms; Image segmentation; Cameras; Power line detection; deep learning; agricultural spraying drone; unmanned aerial vehicle (UAV);
D O I
10.1109/ACCESS.2022.3177196
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Power line detection is necessary for the safe flight of low-flying UAVs (Unmanned Aerial Vehicles). This paper deals with the power line recognition problem for the safety of agricultural spraying drones in agricultural environments. The dataset of power lines was obtained in an agricultural environment. The training dataset was constructed by labeling powerlines with bounding boxes of 6 sizes, ranging from 0.03 to 0.15 times the image. The model used for training was the tiny-YOLOv3 model. The model was verified using the mean average precision (mAP), which was used to verify the object recognition performance. Depending on the six sizes of bounding boxes, the mAPs were evaluated to be 70.22, 94.00, 86.75, 68.87, 61.65, and 53.40, respectively. The mAP was the highest at the bounding box of 0.05 times the image size, and it was confirmed that this size is most suitable for power line detection. The real-time frames per second (FPS) results of power lines detection are on average 12.5. This paper shows that the location detection of power lines is possible in real-time using deep-learning techniques with embedded systems.
引用
收藏
页码:54947 / 54956
页数:10
相关论文
共 28 条
[1]  
[Anonymous], 2010, International journal of computer vision, DOI DOI 10.1007/s11263-009-0275-4
[2]   Real-Time On-Board Deep Learning Fault Detection for Autonomous UAV Inspections [J].
Ayoub, Naeem ;
Schneider-Kamp, Peter .
ELECTRONICS, 2021, 10 (09)
[3]   LiDAR-Based Real-Time Detection and Modeling of Power Lines for Unmanned Aerial Vehicles [J].
Azevedo, Fabio ;
Dias, Andre ;
Almeida, Jose ;
Oliveira, Alexandre ;
Ferreira, Andre ;
Santos, Tiago ;
Martins, Alfredo ;
Silva, Eduardo .
SENSORS, 2019, 19 (08)
[4]  
Baker L, 2016, INT CONF IMAG VIS, P134
[5]   A UAV Guidance System Using Crop Row Detection and Line Follower Algorithms [J].
Basso, Maik ;
Pignaton de Freitas, Edison .
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2020, 97 (3-4) :605-621
[6]   Detection, classification, and mapping of coffee fruits during harvest with computer vision [J].
Bazame, Helizani Couto ;
Molin, Jose Paulo ;
Althoff, Daniel ;
Martello, Mauricio .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 183
[7]  
Berrahal Sarra., 2016, J COMMUN SOFTW SYS, V12, P67, DOI DOI 10.24138/JCOMSS.V12I1.92
[8]   Advanced lane detection technique for structural highway based on computer vision algorithm [J].
Dinakaran, K. ;
Sagayaraj, A. Stephen ;
Kabilesh, S. K. ;
Mani, T. ;
Anandkumar, A. ;
Chandrasekaran, Gokul .
MATERIALS TODAY-PROCEEDINGS, 2021, 45 :2073-2081
[9]   A Novel Marker Detection System for People with Visual Impairment Using the Improved Tiny-YOLOv3 Model [J].
Elgendy, Mostafa ;
Sik-Lanyi, Cecilia ;
Kelemen, Arpad .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2021, 205
[10]   An improved Tiny YOLOv3 for real-time object detection [J].
Gai, Wendong ;
Liu, Yakun ;
Zhang, Jing ;
Jing, Gang .
SYSTEMS SCIENCE & CONTROL ENGINEERING, 2021, 9 (01) :314-321