A multi-objective evolutionary algorithm with mutual-information-guided improvement phase for feature selection in complex manufacturing processes

被引:0
作者
Li, An-Da [1 ,2 ]
He, Zhen [3 ]
Wang, Qing [1 ,2 ]
Zhang, Yang [1 ,2 ]
Ma, Yanhui [4 ]
机构
[1] Tianjin Univ Commerce, Sch Management, Tianjin 300134, Peoples R China
[2] Tianjin Univ Commerce, Res Ctr Management Innovat & Evaluat, Tianjin 300134, Peoples R China
[3] Tianjin Univ, Coll Management & Econ, Tianjin 300072, Peoples R China
[4] Tianjin Univ Technol, Sch Management, Tianjin 300384, Peoples R China
基金
中国国家自然科学基金;
关键词
Evolutionary computations; Multi-objective optimization; Feature selection; Improvement phase; Quality prediction; QUALITY CHARACTERISTICS SELECTION; PARTICLE SWARM OPTIMIZATION; HYBRID GENETIC ALGORITHMS; VARIABLE SELECTION; PLS-REGRESSION; CLASSIFICATION; PREDICTION; RELEVANCE; TOOL;
D O I
10.1016/j.ejor.2024.12.036
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
Complex manufacturing processes (CMP) involve numerous features that impact product quality. Therefore, selecting key process features (KPF) is crucial for effective quality prediction and control in CMPs. This paper proposes a KPF (feature) selection method for the high-dimensional CMP data. The KPF selection problem is formulated as a bi-objective combinatorial optimization task of maximizing the geometric mean measure and minimizing the number of selected features. To solve this challenging high-dimensional KPF selection problem, we propose a novel multi-objective evolutionary algorithm (MOEA) called NSGAII-MIIP. NSGAIIMIIP applies an improvement phase (called MIIP) to purify the non-dominated solutions obtained by genetic operators during the iteration process to improve the FS performance. The improvement phase is guided by a mutual-information-based feature importance measure considering both a feature's relevance degree to class (product quality level) and its redundancy degree to selected features. This allows MIIP to efficiently update non-dominated solutions by selecting relevant features and eliminating redundant features. Moreover, MIIP is seamlessly integrated into the solution ranking process of NSGAII-MIIP so that solutions from the improvement phase can be ranked together with original solutions in the population efficiently. Experiments on eight datasets show that NSGAII-MIIP has better KPF selection performance than eight state-of-the-art multi- objective FS methods. Moreover, NSGAII-MIIP exhibits superior search performance compared to eight typical multi-objective optimization algorithms.
引用
收藏
页码:952 / 965
页数:14
相关论文
共 59 条
[1]   SFE: A Simple, Fast, and Efficient Feature Selection Algorithm for High-Dimensional Data [J].
Ahadzadeh, Behrouz ;
Abdar, Moloud ;
Safara, Fatemeh ;
Khosravi, Abbas ;
Menhaj, Mohammad Bagher ;
Suganthan, Ponnuthurai Nagaratnam .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2023, 27 (06) :1896-1911
[2]   On the approximability of minimizing nonzero variables or unsatisfied relations in linear systems [J].
Amaldi, E ;
Kann, V .
THEORETICAL COMPUTER SCIENCE, 1998, 209 (1-2) :237-260
[3]  
[Anonymous], 2003, Journal of Machine Learning Research, DOI DOI 10.1162/153244303322753616
[4]   Multicriteria variable selection for classification of production batches [J].
Anzanello, Michel J. ;
Albin, Susan L. ;
Chaovalitwongse, Wanpracha A. .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2012, 218 (01) :97-105
[5]   Selecting the best variables for classifying production batches into two quality levels [J].
Anzanello, Michel J. ;
Albin, Susan L. ;
Chaovalitwongse, Wanpracha A. .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2009, 97 (02) :111-117
[6]  
Arthur D, 2007, PROCEEDINGS OF THE EIGHTEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P1027
[7]   USING MUTUAL INFORMATION FOR SELECTING FEATURES IN SUPERVISED NEURAL-NET LEARNING [J].
BATTITI, R .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (04) :537-550
[8]   Decision-based virtual metrology for advanced process control to empower smart production and an empirical study for semiconductor manufacturing [J].
Chien, Chen-Fu ;
Hung, Wei-Tse ;
Pan, Chin-Wei ;
Nguyen, Tran Hong Van .
COMPUTERS & INDUSTRIAL ENGINEERING, 2022, 169
[9]   On bi-objective combinatorial optimization with heterogeneous objectives [J].
Cosson, Raphael ;
Santana, Roberto ;
Derbel, Bilel ;
Liefooghe, Arnaud .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2024, 319 (01) :89-101
[10]   A fast and elitist multiobjective genetic algorithm: NSGA-II [J].
Deb, K ;
Pratap, A ;
Agarwal, S ;
Meyarivan, T .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) :182-197