An adaptive evolutionary modular neural network with intermodule connections

被引:2
作者
Li, Meng [1 ,2 ,3 ,4 ,5 ,6 ]
Li, Wenjing [1 ,3 ,4 ,5 ,6 ]
Chen, Zhiqian [1 ,3 ,4 ,5 ,6 ]
Qiao, Junfei [1 ,3 ,4 ,5 ,6 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, 100 Pingleyuan, Beijing 100124, Peoples R China
[2] CRSC Urban Rail Transit Technol Co Ltd, Beijing, Peoples R China
[3] Beijing Lab Smart Environm Protect, Beijing 100124, Peoples R China
[4] Minist Educ, Engn Res Ctr Intelligent Percept & Autonomous Cont, Beijing 100124, Peoples R China
[5] Beijing Inst Artificial Intelligence, Beijing 100124, Peoples R China
[6] Beijing Lab Computat Intelligence & Intelligent Sy, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
Modular neural network; Multiobjective optimization algorithm; Intermodule connection; Self-organization evolution; GENETIC ALGORITHM; OPTIMIZATION; DESIGN;
D O I
10.1007/s10489-024-05308-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To approach the brain-like neural network and further improve the performance of the modular neural network (MNN), an adaptive evolutionary modular neural network with intermodule connections (EA-ICMNN) is proposed in this study. The EA-ICMNN is composed of a group of multilayer neural networks. Unlike traditional MNNs, in addition to the intramodule connections of subnetworks, intermodule connections are built for EA-ICMNN. All the parameters of the EA-ICMNN are learned by the improved Levenberg-Marquardt algorithm, and the optimal structure is adaptively determined by the improved mutation operator in the multiobjective optimization algorithm NSGAII. To verify the effectiveness of the proposed model, the EA-ICMNN is tested on several benchmark datasets and a practical prediction problem for biochemical oxygen demand in wastewater treatment process. The experimental results show that the proposed model has better generalization ability than other MNNs and that its structure is simplified by its sparse intermodule connections.
引用
收藏
页码:4121 / 4139
页数:19
相关论文
共 35 条
[1]   Hybrid optimization approach using evolutionary neural network & genetic algorithm in a real-world waterflood development [J].
Al-Aghbari, Mohammed ;
Gujarathi, Ashish M. .
JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2022, 216
[2]   A fast and elitist multiobjective genetic algorithm: NSGA-II [J].
Deb, K ;
Pratap, A ;
Agarwal, S ;
Meyarivan, T .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) :182-197
[3]   Multi-objective optimization of fiber laser cutting based on generalized regression neural network and non-dominated sorting genetic algorithm [J].
Ding, Hua ;
Wang, Zongcheng ;
Guo, Yicheng .
INFRARED PHYSICS & TECHNOLOGY, 2020, 108
[4]   From Brain Science to Artificial Intelligence [J].
Fan, Jingtao ;
Fang, Lu ;
Wu, Jiamin ;
Guo, Yuchen ;
Dai, Qionghai .
ENGINEERING, 2020, 6 (03) :248-252
[5]   Multiple-deme parallel genetic algorithm based on modular neural network for effective load shedding [J].
Gholami-Rahimabadi, Ali ;
Razmi, Hadi ;
Doagou-Mojarrad, Hasan .
SOFT COMPUTING, 2021, 25 (21) :13779-13794
[6]   Modular neural networks with Hebbian learning rule [J].
Goltsev, Alexander ;
Gritsenko, Vladimir .
NEUROCOMPUTING, 2009, 72 (10-12) :2477-2482
[7]   Fuzzy logic in the gravitational search algorithm for the optimization of modular neural networks in pattern recognition [J].
Gonzalez, Beatriz ;
Valdez, Fevrier ;
Melin, Patricia ;
Prado-Arechiga, German .
EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (14) :5839-5847
[8]   Data augmentation based estimation for the censored quantile regression neural network model [J].
Hao, Ruiting ;
Weng, Chengwei ;
Liu, Xinyu ;
Yang, Xiaorong .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 214
[9]   Thermoplasmonic neural chip platform for in situ manipulation of neuronal connections in vitro [J].
Hong, Nari ;
Nam, Yoonkey .
NATURE COMMUNICATIONS, 2020, 11 (01)
[10]   Intra- and Inter-Modular Connectivity Alterations in the Brain Structural Network of Spinocerebellar Ataxia Type 3 [J].
Jao, Chi-Wen ;
Soong, Bing-Wen ;
Wang, Tzu-Yun ;
Wu, Hsiu-Mei ;
Lu, Chia-Feng ;
Wang, Po-Shan ;
Wu, Yu-Te .
ENTROPY, 2019, 21 (03)