Self-supervised contrast learning based UAV fault detection and interpretation with spatial-temporal information of multivariate flight data

被引:1
|
作者
Wang, Shengdong [1 ]
Jia, Zhen [1 ]
Liu, Zhenbao [1 ]
Tang, Yong [1 ]
Qin, Xinshang [1 ]
Wang, Xiao [1 ]
机构
[1] Northwestern Polytech Univ, Sch Civil Aeronaut, Intelligent Unmanned Aerial Vehicle Lab, Xian 710072, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
UAV; Fault detection; Flight data analysis; Condition monitoring; Graph neural network; DIAGNOSIS; ACTUATOR; SENSOR; MODEL; PERFORMANCE;
D O I
10.1016/j.eswa.2024.126156
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Precise fault detection and interpretation can effectively enhance the safety of unmanned aerial vehicles (UAV) flight missions. However, sufficient fault data covering all fault modes is generally inaccessible, which poses a formidable challenge to the traditional supervised learning strategy. In this study, a novel UAV fault detection approach based on self-supervised contrast learning and spatial-temporal information of multivariate flight data is proposed. In the contrast learning task, a series of specific sample transformations are first designed, and the feature distribution of normal data can be modeled in self-supervised manner through comparing the similarity of different transformed samples. In above process, an auxiliary classification task that distinguishes different sample transformations is further introduced to facilitate the learning of critical features. In order to extract comprehensive spatial-temporal information from multivariate flight data, a multi-channel spatial-temporal encoder is designed in which two independent graph multi-head attention neural networks (GMAT) are implemented to mine the temporal features and multivariate spatial features, respectively. The extracted spatial-temporal features are then fused with the designed locally-enhanced token fusion module and the powerful multi-headed self-attention module. Finally, the occurrence of faults can be detected by comparing the reconstruction error with the fault threshold. With the box-plot analysis, the flight variables whose reconstruction errors are far from the overall distribution will be regarded as the possible fault sources to implement fault interpretation. Experimental results on the self-developed fixed-wing UAVs demonstrated the prominent performance of our method on fault detection and interpretation.
引用
收藏
页数:20
相关论文
共 40 条
  • [21] A spatial-temporal model for network-wide flight delay prediction based on federated learning
    Shen, Xiuyu
    Chen, Jingxu
    Yan, Ran
    APPLIED SOFT COMPUTING, 2024, 154
  • [22] GraSSRep: Graph-Based Self-supervised Learning for Repeat Detection in Metagenomic Assembly
    Azizpour, Ali
    Balaji, Advait
    Treangen, Todd J.
    Segarra, Santiago
    RESEARCH IN COMPUTATIONAL MOLECULAR BIOLOGY, RECOMB 2024, 2024, 14758 : 372 - 376
  • [23] A Mask Self-Supervised Learning-Based Transformer for Bearing Fault Diagnosis With Limited Labeled Samples
    Cen, Jian
    Yang, Zhuohong
    Wu, Yinbo
    Hu, Xueliang
    Jiang, Liwei
    Chen, Honghua
    Si, Weiwei
    IEEE SENSORS JOURNAL, 2023, 23 (10) : 10359 - 10369
  • [24] A dynamic threshold method for wind turbine fault detection based on spatial-temporal neural network
    Zhang, Yan
    Han, Yinghua
    Wang, Chen
    Wang, Jinkuan
    Zhao, Qiang
    JOURNAL OF RENEWABLE AND SUSTAINABLE ENERGY, 2022, 14 (05)
  • [25] Electric Motor Bearing Fault Noise Detection via Mel-Spectrum-Based Contrastive Self-Supervised Transformer Model
    Zhang, Xiaotian
    Liu, Yunshu
    Gong, Chao
    Nie, Yu
    Rodriguez, Jose
    IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2024, 60 (06) : 8755 - 8765
  • [26] A Spatial-Temporal Variational Graph Attention Autoencoder Using Interactive Information for Fault Detection in Complex Industrial Processes
    Lv, Mingjie
    Li, Yonggang
    Liang, Huiping
    Sun, Bei
    Yang, Chunhua
    Gui, Weihua
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 3062 - 3076
  • [27] Self-Supervised Learning With Limited Labeled Data for Prostate Cancer Detection in High-Frequency Ultrasound
    Wilson, Paul F. R.
    Gilany, Mahdi
    Jamzad, Amoon
    Fooladgar, Fahimeh
    To, Minh Nguyen Nhat
    Wodlinger, Brian
    Abolmaesumi, Purang
    Mousavi, Parvin
    IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2023, 70 (09) : 1073 - 1083
  • [28] Robust Traffic Prediction From Spatial-Temporal Data Based on Conditional Distribution Learning
    Zeng, Zeng
    Zhao, Wei
    Qian, Peisheng
    Zhou, Yingjie
    Zhao, Ziyuan
    Chen, Cen
    Guan, Cuntai
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (12) : 13458 - 13471
  • [29] An Elaborate Container Cascading Fault Detection Strategy Based on Spatial-Temporal Correlation Model and Co-Optimization
    Zhong, Qingwei
    Chen, Ningjiang
    Lian, Linming
    Yao, Xuyi
    PROCEEDINGS OF THE 2021 IEEE 24TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2021, : 127 - 132
  • [30] A Novel Self-Supervised Learning-Based Anomalous Node Detection Method Based on an Autoencoder for Wireless Sensor Networks
    Ye, Miao
    Zhang, Qinghao
    Xue, Xingsi
    Wang, Yong
    Jiang, Qiuxiang
    Qiu, Hongbing
    IEEE SYSTEMS JOURNAL, 2024, 18 (01): : 256 - 267