Deep Learning-Based Target Point Localization for UAV Inspection of Point Cloud Transmission Towers

被引:0
|
作者
Li, Xuhui [1 ,2 ]
Li, Yongrong [1 ]
Chen, Yiming [1 ]
Zhang, Geng [1 ]
Liu, Zhengjun [1 ]
机构
[1] Chinese Acad Surveying & Mapping, Beijing 100036, Peoples R China
[2] Lanzhou Jiaotong Univ, Fac Geomat, Lanzhou 730070, Peoples R China
关键词
deep learning; point cloud; transmission tower; UAV inspection; part segmentation; instance segmentation; target point localization; attention mechanism;
D O I
10.3390/rs16050817
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
UAV transmission tower inspection is the use of UAV technology for regular inspection and troubleshooting of towers on transmission lines, which helps to improve the safety and reliability of transmission lines and ensures the stability of the power supply. From the traditional manual tower boarding to the current way of manually selecting target camera shooting points from 3D point clouds to plan the inspection path of the UAV, operational efficiency has drastically improved. However, indoor planning work is still labor-consuming and expensive. In this paper, a deep learning-based point cloud transmission tower segmentation (PCTTS) model combined with the corresponding target point localization algorithm is proposed for automatic segmentation of transmission tower point cloud data and automatically localizing the key inspection component as the target point for UAV inspection. First, we utilize octree sampling with unit ball normalization to simplify the data and ensure translation invariance before putting the data into the model. In the feature extraction stage, we encode the point set information and combine Euclidean distance and cosine similarity features to ensure rotational invariance. On this basis, we adopt multi-scale feature extraction, construct a local coordinate system, and introduce the offset-attention mechanism to enhance model performance further. Then, after the feature propagation module, gradual up-sampling is used to obtain the features of each point to complete the point cloud segmentation. Finally, combining the segmentation results with the target point localization algorithm completes the automatic extraction of UAV inspection target points. The method has been applied to six kinds of transmission tower point cloud data of part segmentation results and three kinds of transmission tower point cloud data of instance segmentation results. The experimental results show that the model achieves mIOU of 94.1% on the self-built part segmentation dataset and 86.9% on the self-built instance segmentation dataset, and the segmentation accuracy outperforms that of the methods for point cloud segmentation, such as PointNet++, DGCNN, Point Transformer, and PointMLP. Meanwhile, the experimental results of UAV inspection target point localization also verify the method's effectiveness in this paper.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] DEEP LEARNING-BASED DETECTION FOR TRANSMISSION TOWERS USING UAV IMAGES
    Wu, Huisheng
    Sun, Ruixue
    Ling, Xiaochun
    Zhong, Xianjin
    Gao, Xingguo
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3740 - 3743
  • [2] Survey on Deep Learning-Based Point Cloud Compression
    Quach, Maurice
    Pang, Jiahao
    Tian, Dong
    Valenzise, Giuseppe
    Dufaux, Frederic
    FRONTIERS IN SIGNAL PROCESSING, 2022, 2
  • [3] Deep Learning-Based Auricular Point Localization for Auriculotherapy
    Sun, Xiaoyan
    Dong, Jiagang
    Li, Qingfeng
    Lu, Dongxin
    Yuan, Zhenming
    IEEE ACCESS, 2022, 10 : 112898 - 112908
  • [4] A Review of Deep Learning-Based Semantic Segmentation for Point Cloud
    Zhang, Jiaying
    Zhao, Xiaoli
    Chen, Zheng
    Lu, Zhejun
    IEEE ACCESS, 2019, 7 : 179118 - 179133
  • [5] Deep Learning-based Point Cloud Coding for Immersive Experiences
    Pereira, Fernando
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 7368 - 7370
  • [6] Adaptive Deep Learning-Based Point Cloud Geometry Coding
    Guarda, Andre F. R.
    Rodrigues, Nuno M. M.
    Pereira, Fernando
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2021, 15 (02) : 415 - 430
  • [7] DEEP LEARNING-BASED COMPRESSED DOMAIN POINT CLOUD CLASSIFICATION
    Seleem, Abdelrahman
    Guarda, Andre F. R.
    Rodrigues, Nuno M. M.
    Pereira, Fernando
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2620 - 2624
  • [8] Deep learning-based point cloud registration: a comprehensive investigation
    Cheng, Xiaolong
    Liu, Xinyu
    Li, Jintao
    Zhou, Wei
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (10) : 3412 - 3442
  • [9] Point Cloud Geometry Coding on Deep Learning-based Classification Performance
    Seleem, Abdelrahman
    Guarda, Andre F. R.
    Rodrigues, Nuno M. M.
    Pereira, Fernando
    2022 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2022, : 74 - 81
  • [10] Deep learning-based point cloud upsampling: a review of recent trends
    Soonjo Kwon
    Ji-Hyeon Hur
    Hyungki Kim
    JMST Advances, 2023, 5 (4) : 105 - 111