Weather-Domain Transfer-Based Attention YOLO for Multi-Domain Insulator Defect Detection and Classification in UAV Images

被引:7
作者
Liu, Yue [1 ]
Huang, Xinbo [1 ,2 ]
Liu, Decheng [3 ]
机构
[1] Xian Univ Technol, Sch Elect Engn, Xian 710054, Peoples R China
[2] Xian Polytech Univ, Sch Elect & Informat, Xian 710048, Peoples R China
[3] Xidian Univ, Sch Cyber Engn, Xian 710126, Peoples R China
关键词
cross-modality information; insulator defect detection; classification; image processing;
D O I
10.3390/e26020136
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Insulator defect detection of transmission line insulators is an important task for unmanned aerial vehicle (UAV) inspection, which is of immense importance in ensuring the stable operation of transmission lines. Transmission line insulators exist in complex weather scenarios, with small and inconsistent shapes. These insulators under various weather conditions could result in low-quality images captured, limited data numbers, and imbalanced sample problems. Traditional detection methods often struggle to accurately identify defect information, resulting in missed or false detections in real-world scenarios. In this paper, we propose a weather domain synthesis network for extracting cross-modality discriminative information on multi-domain insulator defect detection and classification tasks. Firstly, we design a novel weather domain synthesis (WDSt) module to convert various weather-conditioned insulator images to the uniform weather domain to decrease the existing domain gap. To further improve the detection performance, we leverage the attention mechanism to construct the Cross-modality Information Attention YOLO (CIA-YOLO) model to improve the detection capability for insulator defects. Here, we fuse both shallow and deep feature maps by adding the extra object detection layer, increasing the accuracy for detecting small targets. The experimental results prove the proposed Cross-modality Information Attention YOLO with the weather domain synthesis algorithm can achieve superior performance in multi-domain insulator datasets (MD-Insulator). Moreover, the proposed algorithm also gives a new perspective for decreasing the multi-domain insulator modality gap with weather-domain transfer, which can inspire more researchers to focus on the field.
引用
收藏
页数:18
相关论文
共 37 条
  • [1] A Defect Detection Method Based on BC-YOLO for Transmission Line Components in UAV Remote Sensing Images
    Bao, Wenxia
    Du, Xiang
    Wang, Nian
    Yuan, Mu
    Yang, Xianjun
    [J]. REMOTE SENSING, 2022, 14 (20)
  • [2] Carion Nicolas, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12346), P213, DOI 10.1007/978-3-030-58452-8_13
  • [3] Cheng H., 2019, Modern Electronics Technique, V42, P98
  • [4] Novel Feature Fusion Module-Based Detector for Small Insulator Defect Detection
    Gao, Zishu
    Yang, Guodong
    Li, En
    Liang, Zize
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (15) : 16807 - 16814
  • [5] Coordinate Attention for Efficient Mobile Network Design
    Hou, Qibin
    Zhou, Daquan
    Feng, Jiashi
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 13708 - 13717
  • [6] Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
  • [7] Huang X., 2018, P EUROPEAN C COMPUTE
  • [8] Hui XL, 2017, 2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE ROBIO 2017), P634, DOI 10.1109/ROBIO.2017.8324488
  • [9] Jocher G., 2023, YOLO by Ultralytics
  • [10] Jocher Glenn, 2020, Zenodo