Akaike Information Criterion-based conjunctive belief rule base learning for complex system modeling

被引:34
作者
Chang Leilei [1 ,2 ,3 ]
Zhou Zhijie [3 ]
Chen Yuwang [4 ]
Xu Xiaobin [1 ]
Sun Jianbin [5 ]
Liao Tianjun [6 ]
Tan Xu [2 ]
机构
[1] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Zhejiang, Peoples R China
[2] Shenzhen Inst Informat Technol, Sch Software Engn, Shenzhen 518172, Peoples R China
[3] High Tech Inst Xian, Xian 710025, Shaanxi, Peoples R China
[4] Univ Manchester, Manchester Business Sch, Decis & Cognit Sci Res Ctr, Manchester M15 6PB, Lancs, England
[5] Natl Univ Def Technol, Sch Informat Syst & Management, Changsha 410073, Hunan, Peoples R China
[6] Beijing Inst Syst Engn, State Key Lab Complex Syst Simulat, 10 An Xiang Bei Li Rd, Beijing, Peoples R China
基金
美国国家科学基金会;
关键词
Conjunctive belief rule base; Akaike Information Criterion; Complex system modeling; Optimization path; BILEVEL OPTIMIZATION; EXPERT-SYSTEM; INFERENCE; METHODOLOGY;
D O I
10.1016/j.knosys.2018.07.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nonlinear complex system modeling has become the basis of many theoretical and practical problems, which requires balancing the correlations between the modeling accuracy and the modeling complexity. However, the two objectives may not be consistent with each other under many practical conditions, especially for complex systems with multiple influential factors. The belief rule base (BRB) has shown advantages in nonlinear complex system modeling under uncertainty. However, most of current works on BRB has focused only on the modeling accuracy. As such, an Akaike Information Criterion (AIC)-based objective, AIC(BRB), is deduced to represent both the modeling accuracy (denoted by the Mean Square Error (MSE)) and the modeling complexity (denoted by the number of the parameters). Based on the proposed AIC(BRB), a bi-level optimization model and a corresponding bi-level optimization algorithm are developed. Moreover, an empirical optimization path search strategy is proposed for upper-level optimization. The optimization path is comprised of multiple solutions with optimal performance. After the BRB learning process, both the structure and the parameters of BRB are optimized, which identifies the best decision structure of BRB. A numerical multi-extreme function case and a practical pipeline leak detection case are studied. The results show that an optimization path could be identified with a series of optimal solutions. With AIC(BRB) as the objective, the jointly optimized BRB in the best decision structure can be obtained with an improved modeling accuracy as well as reduced modeling complexity.
引用
收藏
页码:47 / 64
页数:18
相关论文
共 43 条
[1]  
Akaike H., 2011, AKAIKES INFORM CRITE, Vfourth
[2]  
Akaike H., 1971, Second International Symposium on Information Theory, P267
[3]  
[Anonymous], 2002, Model selection and multimodel inference: a practical informationtheoretic approach
[4]  
[Anonymous], 2000, P AMS C MATH CHALL 2
[5]   An options-based approach to coordinating distributed decision systems [J].
Ball, Daniel R. ;
Deshmukh, Abhijit ;
Kapadia, Nikunj .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2015, 240 (03) :706-717
[7]   Belief Rule Base Structure and Parameter Joint Optimization Under Disjunctive Assumption for Nonlinear Complex System Modeling [J].
Chang, Lei-Lei ;
Zhou, Zhi-Jie ;
Chen, Yu-Wang ;
Liao, Tian-Jun ;
Hu, Yu ;
Yang, Long-Hao .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2018, 48 (09) :1542-1554
[8]   Belief rule based expert system for classification problems with new rule activation and weight calculation procedures [J].
Chang, Leilei ;
Zhou, ZhiJie ;
You, Yuan ;
Yang, Longhao ;
Zhou, Zhiguo .
INFORMATION SCIENCES, 2016, 336 :75-91
[9]   Structure learning for belief rule base expert system: A comparative study [J].
Chang, Leilei ;
Zhou, Yu ;
Jiang, Jiang ;
Li, Mengjun ;
Zhang, Xiaohang .
KNOWLEDGE-BASED SYSTEMS, 2013, 39 :159-172
[10]   Akaike Information Criterion-based Objective for Belief Rule Base Optimization [J].
Change, Leilei ;
Wang, Liuying ;
Wang, Wei ;
Liu, Gu ;
Ling, Xiaodong .
2016 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL. 1, 2016, :545-549