Self-supervised contrast learning based UAV fault detection and interpretation with spatial-temporal information of multivariate flight data

被引:1
作者
Wang, Shengdong [1 ]
Jia, Zhen [1 ]
Liu, Zhenbao [1 ]
Tang, Yong [1 ]
Qin, Xinshang [1 ]
Wang, Xiao [1 ]
机构
[1] Northwestern Polytech Univ, Sch Civil Aeronaut, Intelligent Unmanned Aerial Vehicle Lab, Xian 710072, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
UAV; Fault detection; Flight data analysis; Condition monitoring; Graph neural network; DIAGNOSIS; ACTUATOR; SENSOR; MODEL; PERFORMANCE;
D O I
10.1016/j.eswa.2024.126156
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Precise fault detection and interpretation can effectively enhance the safety of unmanned aerial vehicles (UAV) flight missions. However, sufficient fault data covering all fault modes is generally inaccessible, which poses a formidable challenge to the traditional supervised learning strategy. In this study, a novel UAV fault detection approach based on self-supervised contrast learning and spatial-temporal information of multivariate flight data is proposed. In the contrast learning task, a series of specific sample transformations are first designed, and the feature distribution of normal data can be modeled in self-supervised manner through comparing the similarity of different transformed samples. In above process, an auxiliary classification task that distinguishes different sample transformations is further introduced to facilitate the learning of critical features. In order to extract comprehensive spatial-temporal information from multivariate flight data, a multi-channel spatial-temporal encoder is designed in which two independent graph multi-head attention neural networks (GMAT) are implemented to mine the temporal features and multivariate spatial features, respectively. The extracted spatial-temporal features are then fused with the designed locally-enhanced token fusion module and the powerful multi-headed self-attention module. Finally, the occurrence of faults can be detected by comparing the reconstruction error with the fault threshold. With the box-plot analysis, the flight variables whose reconstruction errors are far from the overall distribution will be regarded as the possible fault sources to implement fault interpretation. Experimental results on the self-developed fixed-wing UAVs demonstrated the prominent performance of our method on fault detection and interpretation.
引用
收藏
页数:20
相关论文
共 40 条
  • [31] Network intrusion detection via tri-broad learning system based on spatial-temporal granularity
    Li, Jieling
    Zhang, Hao
    Liu, Zhihuang
    Liu, Yanhua
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (08) : 9180 - 9205
  • [32] Multivariate sensor data analysis for fault detection toward feedback loop-based continuous learning in FFF 3D printer
    Baek, Sujeong
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2024, 132 (11-12) : 5975 - 5988
  • [33] Fault Detection for Seismic Data Interpretation Based on Machine Learning: Research Trends and Technological Introduction
    Choi, Woochang
    Lee, Ganghoon
    Cho, Sangin
    Choi, Byunghoon
    Pyun, Sukjoon
    GEOPHYSICS AND GEOPHYSICAL EXPLORATION, 2020, 23 (02): : 97 - 114
  • [34] M2D-VAE: Self-Supervised Probabilistic Temporal- Spatial Latent Representation Learning for Unsupervised Industrial Operational Applications Under Missing Value Interference
    Dai, Qingyang
    Zhao, Chunhui
    Huang, Biao
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [35] Machine learning models for Parkinson's disease detection and stage classification based on spatial-temporal gait parameters
    Ferreira, Marta Isabel A. S. N.
    Barbieri, Fabio Augusto
    Moreno, Vinicius Christianini
    Penedo, Tiago
    Tavares, Joao Manuel R. S.
    GAIT & POSTURE, 2022, 98 : 49 - 55
  • [36] A Quality-Related Fault Detection Method Based on Deep Spatial-Temporal Networks and Canonical Variable Analysis for Industrial Processes
    Li, Daye
    Zhang, Hongjun
    An, Lisha
    Dong, Jie
    Peng, Kaixiang
    IEEE SENSORS JOURNAL, 2024, 24 (18) : 29047 - 29055
  • [37] Forecasting of oil production driven by reservoir spatial-temporal data based on normalized mutual information and Seq2Seq-LSTM
    Cui, Chuanzhi
    Qian, Yin
    Wu, Zhongwei
    Lu, Shuiqingshan
    He, Jiajie
    ENERGY EXPLORATION & EXPLOITATION, 2024, 42 (02) : 444 - 461
  • [38] Spatial-Temporal Development Trends and Influencing Factors of Government Environmental Information Disclosure: Empirical Evidence Based on China's Provincial Panel Data
    Xin, Boda
    Lv, Lianhong
    Dong, Jingjing
    SUSTAINABILITY, 2024, 16 (19)
  • [39] The efficiency of a Machine learning approach based on Spatio-Temporal information in the detection of patent foramen ovale from contrast transthoracic echocardiography Images: A primary study
    Yang, Jing
    Zhang, Shiquan
    Zhou, Yixi
    Yu, Hangyuan
    Zhang, Huiqin
    Lan, Tingyu
    Zhang, Meng
    Huang, Wenyan
    Zhang, Wei
    Cheng, Linggang
    Li, Yongjia
    Tian, Jiawei
    Yuan, Jianjun
    Ran, Haitao
    Guo, Yanli
    Zhang, Ruifang
    Zhang, Hongxia
    Wang, Anxin
    Du, Lijuan
    He, Wen
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 84
  • [40] A hybrid optimization and machine learning based energy-efficient clustering algorithm with self-diagnosis data fault detection and prediction for WSN-IoT application
    Nathiya, N.
    Rajan, C.
    Geetha, K.
    PEER-TO-PEER NETWORKING AND APPLICATIONS, 2025, 18 (02)