A Bayesian Deep Learning RUL Framework Integrating Epistemic and Aleatoric Uncertainties

被引:68
作者
Li, Gaoyang [1 ,2 ]
Yang, Li [3 ]
Lee, Chi-Guhn [4 ]
Wang, Xiaohua [1 ]
Rong, Mingzhe [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Elect Engn, State Key Lab Elect Insulat & Power Equipment, Xian 710049, Peoples R China
[2] State Grid Corp China, Big Date Ctr, Beijing 100052, Peoples R China
[3] Beihang Univ, Sch Reliabil & Syst Engn, Beijing 100191, Peoples R China
[4] Univ Toronto, Dept Mech & Ind Engn, Toronto, ON M5S 3G8, Canada
基金
中国国家自然科学基金;
关键词
Uncertainty; Bayes methods; Prognostics and health management; Probabilistic logic; Machine learning; Modeling; Prediction algorithms; Aleatoric uncertainty; Bayesian neural network; epistemic uncertainty; remaining useful life; USEFUL LIFE PREDICTION; PROGNOSTICS; DROPOUT;
D O I
10.1109/TIE.2020.3009593
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent years have witnessed the prominent advancements of deep learning (DL) in the arsenal of prognostics and health management. However, the prognostic uncertainty problem extensively existed in industrial devices is not addressed by most DL approaches. This article formulates a novel Bayesian Deep Learning (BDL) framework to characterize the prognostic uncertainties. A distinguished advantage of the framework is its capacity of capturing the comprehensive effects of two critical uncertainties: 1) epistemic uncertainty, accounting for the uncertainty in the model, and 2) aleatoric uncertainty, representing the impact of random disturbance, such as measurement errors. The former arises from the variability of the model weights, and the latter is characterized by selected lifetime distributions. We integrate both uncertainties by defining BDL as priors of lifetime parameters. A sequential Bayesian boosting algorithm is executed to improve the estimation accuracy and compress the credible intervals. The superior prediction performance of our framework is validated by a real-world dataset collected from hydraulic mechanisms of circuit breakers.
引用
收藏
页码:8829 / 8841
页数:13
相关论文
共 36 条
  • [1] Ensemble neural network-based particle filtering for prognostics
    Baraldi, P.
    Compare, M.
    Sauco, S.
    Zio, E.
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2013, 41 (1-2) : 288 - 300
  • [2] Bernardo J.M., 1994, BAYESIAN THEORY
  • [3] Berndt DJ, 1994, P KDD WORKSH SEATTL, P359, DOI DOI 10.5555/3000850.3000887
  • [4] Bishop C.M., 2006, Pattern Recognition and Machine Learning
  • [5] Blundell C, 2015, PR MACH LEARN RES, V37, P1613
  • [6] Chung JY, 2015, PR MACH LEARN RES, V37, P2067
  • [7] Coble JB., 2010, TRACE, V1, P1
  • [8] Dugas C, 2001, ADV NEUR IN, V13, P472
  • [9] Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture
    Ellefsen, Andre Listou
    Bjorlykhaug, Emil
    Aesoy, Vilmar
    Ushakov, Sergey
    Zhang, Houxiang
    [J]. RELIABILITY ENGINEERING & SYSTEM SAFETY, 2019, 183 : 240 - 251
  • [10] Gal Y, 2016, PR MACH LEARN RES, V48