DCPLD-Net: A diffusion coupled convolution neural network for real-time power transmission lines detection from UAV-Borne LiDAR data

被引:19
作者
Chen, Chi [1 ,2 ,3 ]
Jin, Ang [1 ,2 ,3 ]
Yang, Bisheng [1 ,2 ,3 ]
Ma, Ruiqi [1 ,2 ,3 ]
Sun, Shangzhe [1 ,2 ,3 ]
Wang, Zhiye [1 ,2 ,3 ]
Zong, Zeliang [1 ,2 ,3 ,4 ]
Zhang, Fei [5 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan, Peoples R China
[2] Wuhan Univ, Engn Res Ctr Spatio Temporal Data Smart Acquisit &, Minist Educ China, Wuhan, Peoples R China
[3] Wuhan Univ, Inst Geospatial intelligence, Wuhan, Peoples R China
[4] Sence Time, Hangzhou, Peoples R China
[5] Shanghai Weizhizhuoxin Informat Technol Co Ltd, Shanghai, Peoples R China
基金
欧盟地平线“2020”;
关键词
UAV; Power transmission lines inspection; Simulated physical processes; LiDAR; Point clouds; POINT; REGISTRATION; IMAGES;
D O I
10.1016/j.jag.2022.102960
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The stable and reliable supply of electric power is strongly related to the normal social production. In recent years, power transmission lines inspection based on remote sensing methods has made great progress, especially using the UAV-borne LiDAR system. The extraction and identification of power transmission lines (i.e., con-ductors) from 3D point clouds are the basis of LiDAR data-based power grid risk management. However, existing rule-based/traditional machine learning extraction approaches have exposed some limitations, such as the lack of timeliness and generalization. Moreover, the potential of deep learning is seriously overlooked in RoW (Right of Way) LiDAR inspection tasks. Thus, we proposed DCPLD-Net: a diffusion coupled convolution neural network for real-time power transmission lines detection from UAV-borne LiDAR data. To implement efficient 2D convolution on 3D point clouds, we proposed a novel point cloud representation, named Cross Section View (CSV), which transforms the discrete point clouds into 3D tensors constructed by voxels with a deformed geo-metric shape along the flight trajectory. After the CSV feature generation, the encoded features of each voxel are treated as energy (i.e., heat) signals and diffused in space to generate diffusion feature maps. The feature of the power line points are thus enhanced through this simulated physical process (diffusion). Finally, a single-stage detector named PLDNet is proposed for the multiscale detection of conductors on the diffused CSV representa-tions. The experimental results show that the DCPLD-Net achieves an average F1 score of 97.14 % at 8 Hz detection frequency on RoWs inspection LiDAR datasets collected by both mini-UAV LiDAR and large-scale fully autonomous UAV power lines inspection robots, and surpasses compared methods (i.e. PointNet ++, RandLA-Net) in terms of F1 scores and IoU.
引用
收藏
页数:19
相关论文
共 64 条
  • [1] Armeni I., 2017, ARXIV
  • [2] CLASSIFIER-FREE DETECTION OF POWER LINE PYLONS FROM POINT CLOUD DATA
    Awrangjeb, Mohammad
    Islam, Mohammad K.
    [J]. 4TH INTERNATIONAL GEOADVANCES WORKSHOP - GEOADVANCES 2017: ISPRS WORKSHOP ON MULTI-DIMENSIONAL & MULTI-SCALE SPATIAL DATA MODELING, 2017, 4-4 (W4): : 81 - 87
  • [3] LiDAR-Based Real-Time Detection and Modeling of Power Lines for Unmanned Aerial Vehicles
    Azevedo, Fabio
    Dias, Andre
    Almeida, Jose
    Oliveira, Alexandre
    Ferreira, Andre
    Santos, Tiago
    Martins, Alfredo
    Silva, Eduardo
    [J]. SENSORS, 2019, 19 (08)
  • [4] Comparing RIEGL RiCOPTER UAV LiDAR Derived Canopy Height and DBH with Terrestrial LiDAR
    Brede, Benjamin
    Lau, Alvaro
    Bartholomeus, Harm M.
    Kooistra, Lammert
    [J]. SENSORS, 2017, 17 (10)
  • [5] Automatic Clearance Anomaly Detection for Transmission Line Corridors Utilizing UAV-Borne LIDAR Data
    Chen, Chi
    Yang, Bisheng
    Song, Shuang
    Peng, Xiangyang
    Huang, Ronggang
    [J]. REMOTE SENSING, 2018, 10 (04)
  • [6] 机载激光点云数据中电力线自动提取方法
    陈驰
    麦晓明
    宋爽
    彭向阳
    徐文学
    王珂
    [J]. 武汉大学学报(信息科学版), 2015, (12) : 1600 - 1605
  • [7] Multi-View 3D Object Detection Network for Autonomous Driving
    Chen, Xiaozhi
    Ma, Huimin
    Wan, Ji
    Li, Bo
    Xia, Tian
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6526 - 6534
  • [8] 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks
    Choy, Christopher
    Gwak, JunYoung
    Savarese, Silvio
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3070 - 3079
  • [9] 3D-CSTM: A 3D continuous spatio-temporal mapping method
    Cong, Yangzi
    Chen, Chi
    Yang, Bisheng
    Li, Jianping
    Wu, Weitong
    Li, Yuhao
    Yang, Yandi
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 186 : 232 - 245
  • [10] Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis
    Dai, Angela
    Qi, Charles Ruizhongtai
    Niessner, Matthias
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6545 - 6554