Meta-heuristic multi- and many-objective optimization techniques for solution of machine learning problems

被引:33
作者
Rodrigues, Douglas [1 ]
Papa, Joao P. [2 ]
Adeli, Hojjat [3 ,4 ,5 ]
机构
[1] Univ Fed Sao Carlos, Dept Comp, Sao Carlos, SP, Brazil
[2] Sao Paulo State Univ, Dept Comp, Bauru, SP, Brazil
[3] Ohio State Univ, Dept Civil Environm & Geodet Engn, Columbus, OH 43210 USA
[4] Ohio State Univ, Dept Biomed Engn, Columbus, OH 43210 USA
[5] Ohio State Univ, Dept Neurosci, Columbus, OH 43210 USA
基金
巴西圣保罗研究基金会;
关键词
machine learning; meta-heuristic algorithms; multi-objective optimization; PARTICLE SWARM OPTIMIZATION; MULTIOBJECTIVE OPTIMIZATION; FEATURE-SELECTION; GENETIC ALGORITHMS; COST OPTIMIZATION; DIFFERENTIAL EVOLUTION; MODEL SELECTION; OPTIMUM DESIGN; NETWORK; TIME;
D O I
10.1111/exsy.12255
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, multi- and many-objective meta-heuristic algorithms have received considerable attention due to their capability to solve optimization problems that require more than one fitness function. This paper presents a comprehensive study of these techniques applied in the context of machine learning problems. Three different topics are reviewed in this work: (a) feature extraction and selection, (b) hyper-parameter optimization and model selection in the context of supervised learning, and (c) clustering or unsupervised learning. The survey also highlights future research towards related areas.
引用
收藏
页数:12
相关论文
共 119 条
[1]   Speeding up backpropagation using multiobjective evolutionary algorithms [J].
Abbass, HA .
NEURAL COMPUTATION, 2003, 15 (11) :2705-2726
[2]   Optimal control of adaptive/smart bridge structures [J].
Adeli, H ;
Saleh, A .
JOURNAL OF STRUCTURAL ENGINEERING-ASCE, 1997, 123 (02) :218-226
[3]   Cost optimization of composite floors using neural dynamics model [J].
Adeli, H ;
Kim, H .
COMMUNICATIONS IN NUMERICAL METHODS IN ENGINEERING, 2001, 17 (11) :771-787
[4]  
Adeli H., 1995, MACHINE LEARNING NEU
[5]   Diversity Management in Evolutionary Many-Objective Optimization [J].
Adra, Salem F. ;
Fleming, Peter J. .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2011, 15 (02) :183-195
[6]   Evolutionary Multiobjective Image Feature Extraction in the Presence of Noise [J].
Albukhanajer, Wissam A. ;
Briffa, Johann A. ;
Jin, Yaochu .
IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (09) :1757-1768
[7]   A particle swarm optimization approach in printed circuit board thermal design [J].
Alexandridis, Alex ;
Paizis, Evangelos ;
Chondrodima, Eva ;
Stogiannos, Marios .
INTEGRATED COMPUTER-AIDED ENGINEERING, 2017, 24 (02) :143-155
[8]  
Amezquita-Sanchez JP, 2015, SCI IRAN, V22, P1931
[9]  
[Anonymous], 1999, PROC C EVOL COMPUT C
[10]  
[Anonymous], 2010, PRACTICAL GOAL PROGR