Vision-based autonomous navigation approach for unmanned aerial vehicle transmission-line inspection

被引:55
作者
Hui, Xiaolong [1 ]
Bian, Jiang [1 ]
Zhao, Xiaoguang [1 ]
Tan, Min [1 ]
机构
[1] Univ Chinese Acad Sci, Inst Automat, Chinese Acad Sci, 95 ZhongGuanCun East Rd, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Unmanned aerial vehicle; intelligent inspection; three-dimensional (3-D) perception; visual navigation; VANISHING-POINT; SEGMENT DETECTOR; UAV;
D O I
10.1177/1729881417752821
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This article presents an autonomous navigation approach based on a transmission tower for unmanned aerial vehicle (UAV) power line inspection. For this complex vision task, a perspective navigation model, which plays an important role in the description and analysis of the flight strategy, is introduced. Based on the proposed navigation model, valuable cues are excavated from a perspective image, which enhances the capability of the perception of three-dimensional direction and simultaneously improves the safety of intelligent inspection. Specifically, for robust and continuous localization of the transmission tower, a developed detecting-tracking visual strategycomprised tower detection based on a faster region-based convolutional neural network and tower tracking by kernelized correlation filtersis presented. Further, segmentation by fully convolutional networks is applied to the extraction of transmission lines, from which the vanishing point (VP), an important basis for determining the flight heading, can be obtained. For more robust navigation, the designed scheme addresses the scenario of a nonexistent VP. Finally, the proposed navigation approach and constructed UAV platform were evaluated in a practical environment and achieved satisfactory results. To the best of our knowledge, this article marks the first time that a navigation approach based on a transmission tower is proposed and implemented.
引用
收藏
页数:15
相关论文
共 41 条
[21]   Generalizing Laplacian of Gaussian Filters for Vanishing-Point Detection [J].
Kong, Hui ;
Sarma, Sanjay E. ;
Tang, Feng .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2013, 14 (01) :408-418
[22]   Robust object detection with interleaved categorization and segmentation [J].
Leibe, Bastian ;
Leonardis, Ales ;
Schiele, Bernt .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2008, 77 (1-3) :259-289
[23]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37
[24]  
Lu, 2012, POW EN ENG C APPEEC, P1, DOI 10.1109/APPEEC.2012.6307403
[25]   Visual Navigation Using Heterogeneous Landmarks and Unsupervised Geometric Constraints [J].
Lu, Yan ;
Song, Dezhen .
IEEE TRANSACTIONS ON ROBOTICS, 2015, 31 (03) :736-749
[26]  
Nocedal J, 2006, SPRINGER SER OPER RE, P1, DOI 10.1007/978-0-387-40065-5
[27]   A roadmap for automated power line inspection. Maintenance and repair. [J].
Pagnano, A. ;
Hoepf, M. ;
Teti, R. .
EIGHTH CIRP CONFERENCE ON INTELLIGENT COMPUTATION IN MANUFACTURING ENGINEERING, 2013, 12 :234-239
[28]   LineScout Technology Opens the Way to Robotic Inspection and Maintenance of High-Voltage Power Lines [J].
Pouliot, Nicolas ;
Richard, Pierre-Luc ;
Montambault, Serge .
IEEE Power and Energy Technology Systems Journal, 2015, 2 (01) :1-11
[29]   Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].
Ren, Shaoqing ;
He, Kaiming ;
Girshick, Ross ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149
[30]   ImageNet Large Scale Visual Recognition Challenge [J].
Russakovsky, Olga ;
Deng, Jia ;
Su, Hao ;
Krause, Jonathan ;
Satheesh, Sanjeev ;
Ma, Sean ;
Huang, Zhiheng ;
Karpathy, Andrej ;
Khosla, Aditya ;
Bernstein, Michael ;
Berg, Alexander C. ;
Fei-Fei, Li .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 115 (03) :211-252