Vision-based autonomous navigation approach for unmanned aerial vehicle transmission-line inspection

被引:55
作者
Hui, Xiaolong [1 ]
Bian, Jiang [1 ]
Zhao, Xiaoguang [1 ]
Tan, Min [1 ]
机构
[1] Univ Chinese Acad Sci, Inst Automat, Chinese Acad Sci, 95 ZhongGuanCun East Rd, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Unmanned aerial vehicle; intelligent inspection; three-dimensional (3-D) perception; visual navigation; VANISHING-POINT; SEGMENT DETECTOR; UAV;
D O I
10.1177/1729881417752821
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This article presents an autonomous navigation approach based on a transmission tower for unmanned aerial vehicle (UAV) power line inspection. For this complex vision task, a perspective navigation model, which plays an important role in the description and analysis of the flight strategy, is introduced. Based on the proposed navigation model, valuable cues are excavated from a perspective image, which enhances the capability of the perception of three-dimensional direction and simultaneously improves the safety of intelligent inspection. Specifically, for robust and continuous localization of the transmission tower, a developed detecting-tracking visual strategycomprised tower detection based on a faster region-based convolutional neural network and tower tracking by kernelized correlation filtersis presented. Further, segmentation by fully convolutional networks is applied to the extraction of transmission lines, from which the vanishing point (VP), an important basis for determining the flight heading, can be obtained. For more robust navigation, the designed scheme addresses the scenario of a nonexistent VP. Finally, the proposed navigation approach and constructed UAV platform were evaluated in a practical environment and achieved satisfactory results. To the best of our knowledge, this article marks the first time that a navigation approach based on a transmission tower is proposed and implemented.
引用
收藏
页数:15
相关论文
共 41 条
[1]   EDLines: A real-time line segment detector with a false detection control [J].
Akinlar, Cuneyt ;
Topal, Cihan .
PATTERN RECOGNITION LETTERS, 2011, 32 (13) :1633-1642
[2]  
[Anonymous], 2014, ARXIV14114464
[3]  
Araar O, 2014, MED C CONTR AUTOMAT, P1418, DOI 10.1109/MED.2014.6961575
[4]  
Cao WR, 2013, IEEE ASME INT C ADV, P554, DOI 10.1109/AIM.2013.6584150
[5]   Real-time transmission tower detection from video based on a feature descriptor [J].
Ceron, Alexander ;
Mondragon, Ivan ;
Prieto, Flavio .
IET COMPUTER VISION, 2017, 11 (01) :33-42
[6]  
Cerón A, 2014, INT CONF UNMAN AIRCR, P632, DOI 10.1109/ICUAS.2014.6842307
[7]   Automatic power line extraction from high resolution remote sensing imagery based on an improved Radon transform [J].
Chen, Yunping ;
Li, Yang ;
Zhang, Huixiong ;
Tong, Ling ;
Cao, Yongxing ;
Xue, Zhihang .
PATTERN RECOGNITION, 2016, 49 :174-186
[8]  
Cipolla R., 2016, CORR
[9]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893
[10]  
Elloumi W., 2013, INT C INDOOR POSIT, P1