Bayesian Neuro-Fuzzy Inference System for Temporal Dependence Estimation

被引:4
作者
Samanta, Subhrajit [1 ]
Pratama, Mahardhika [1 ]
Sundaram, Suresh [2 ]
机构
[1] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
[2] Indian Inst Sci, Dept Aerosp Engn, Bangalore 560012, Karnataka, India
关键词
Time series analysis; Estimation; Task analysis; Bayes methods; Forecasting; Uncertainty; System dynamics; Bayesian learning; Bayesian neuro-fuzzy inference system (BaNFIS); online learning; online time-series forecasting; recurrent fuzzy system; temporal dependence estimation (TDE); LEARNING ALGORITHM; IDENTIFICATION; NETWORK;
D O I
10.1109/TFUZZ.2020.3001667
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
When it comes to time-series forecasting, it is crucial to learn the intricate temporal relationship between past and future, and historical information is of paramount importance for this purpose. Traditional neuro-fuzzy systems generally resort to an empirical (offline) method to determine the number of past instances (i.e., historical information) required for a particular model, hence often unsuitable in an online time-series scenario. In this article, we propose a Bayesian neuro-fuzzy inference system (BaNFIS), where the temporal dependence on past instances is estimated with an online Bayesian probabilistic mechanism, and the uncertainty associated with real-world data is handled by the fuzzy inference system. The BaNFIS retains historical information only as per necessity and employs it in two ways: globally or locally. Moreover, an online learning method is employed here to update the BaNFIS parameters. Hence, the BaNFIS is able to capture both the system dynamics and uncertainty efficiently in an online manner. Three real-world time-series problems are employed here to evaluate the online performance of the BaNFIS compared to seven state-of-the-art neuro-fuzzy methods both under standard train-test and prequential test-train protocols. Numerical results clearly indicate that the BaNFIS provides a statistically improved prediction performance than its peers in terms of accuracy.
引用
收藏
页码:2479 / 2490
页数:12
相关论文
共 37 条
  • [1] Angelov P, 2005, IEEE INT CONF FUZZY, P1068
  • [2] An approach to Online identification of Takagi-Suigeno fuzzy models
    Angelov, PP
    Filev, DP
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (01): : 484 - 498
  • [3] [Anonymous], 2015, ARXIV PREPRINT ARXIV
  • [4] Long short-term memory
    Hochreiter, S
    Schmidhuber, J
    [J]. NEURAL COMPUTATION, 1997, 9 (08) : 1735 - 1780
  • [5] Meta-cognitive RBF Network and its Projection Based Learning algorithm for classification problems
    Babu, G. Sateesh
    Suresh, S.
    [J]. APPLIED SOFT COMPUTING, 2013, 13 (01) : 654 - 666
  • [6] LEARNING LONG-TERM DEPENDENCIES WITH GRADIENT DESCENT IS DIFFICULT
    BENGIO, Y
    SIMARD, P
    FRASCONI, P
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02): : 157 - 166
  • [7] Large-Scale Machine Learning with Stochastic Gradient Descent
    Bottou, Leon
    [J]. COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, : 177 - 186
  • [8] Camacho E. F., 2013, Advanced Textbooks in Control and Signal Processing
  • [9] Cho K., 2014, P C EMP METH NAT LAN, P1724, DOI DOI 10.3115/V1/D14-1179
  • [10] Data mining and wind power prediction: A literature review
    Colak, Ilhami
    Sagiroglu, Seref
    Yesilbudak, Mehmet
    [J]. RENEWABLE ENERGY, 2012, 46 : 241 - 247