Class Dependent Feature Construction as a Bi-level Optimization Problem

被引:0
作者
Hammami, Marwa [1 ]
Bechikh, Slim [1 ]
Makhlouf, Mohamed [2 ]
Hung, Chih-Cheng [3 ,4 ]
Ben Said, Lamjed [1 ]
机构
[1] Univ Tunis, SMART Lab, ISG, Tunis, Tunisia
[2] Kedge Business Sch, Talence, France
[3] Kennesaw State Univ, Kennesaw, GA 30144 USA
[4] Anyang Normal Univ, Anyang, Peoples R China
来源
2020 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC) | 2020年
关键词
Class dependent features; features construction; bi-level optimization; evolutionary algorithms; FEATURE-SELECTION; CLASSIFICATION; EVOLUTIONARY;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature selection and construction are important pre-processing techniques in data mining. They allow not only dimensionality reduction but also classification accuracy and efficiency improvement. While feature selection consists in selecting a subset of relevant features from the original feature set, feature construction corresponds to the generation of new high-level features, called constructed features, where each one of them is a combination of a subset of original features. However, different features can have different abilities to distinguish different classes. Therefore, it may be more difficult to construct a better discriminating feature when combining features that are relevant to different classes. Based on these definitions, feature construction could be seen as a BLOP (Bi-Level Optimization Problem) where the feature subset should be defined in the upper level and the feature construction is applied in the lower level by performing mutliple followers, each of which generates a set class dependent constructed features. In this paper, we propose a new bi-level evolutionary approach for feature construction called BCDFC that constructs multiple features which focuses on distinguishing one class from other classes using Genetic Programming (GP). A detailed experimental study has been conducted on six high-dimensional datasets. The statistical analysis of the obtained results shows the competitiveness and the outperformance of our bi-level feature construction approach with respect to many state-of-art algorithms.
引用
收藏
页数:8
相关论文
共 50 条
[31]   A bi-level encoding scheme for the clustered shortest-path tree problem in multifactorial optimization [J].
Huynh Thi Thanh Binh ;
Ta Bao Thang ;
Nguyen Duc Thai ;
Pham Dinh Thanh .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 100
[32]   A bi-level optimization model of distribution automation terminal configuration [J].
Liu X. ;
Wu H. ;
Li Y. ;
Wang L. ;
Wang C. .
Dianli Xitong Baohu yu Kongzhi/Power System Protection and Control, 2020, 48 (24) :136-144
[33]   A Bi-Level Evolutionary Optimization for Coordinated Transmission Expansion Planning [J].
Gupta, Neeraj ;
Khosravy, Mahdi ;
Patel, Nilesh ;
Senjyu, Tomonobu .
IEEE ACCESS, 2018, 6 :48455-48477
[34]   A game-theoretic model for wind farm planning problem: A bi-level stochastic optimization approach [J].
Alshamrani, Ahmad M. ;
Alrasheedi, Adel F. ;
Alnowibet, Khalid A. .
SUSTAINABLE ENERGY TECHNOLOGIES AND ASSESSMENTS, 2022, 53
[35]   B-POP: Bi-level parametric optimization toolbox [J].
Avraamidou, Styliani ;
Pistikopoulos, Efstratios N. .
COMPUTERS & CHEMICAL ENGINEERING, 2019, 122 :193-202
[36]   Bi-Level Optimization Model for Greener Transportation by Vehicular Networks [J].
Liu, Kun ;
Li, Jianqing ;
Li, Wenting ;
Zheng, Zhigao .
MOBILE NETWORKS & APPLICATIONS, 2023, 28 (04) :1349-1361
[37]   An efficient chemical reaction algorithm for multi-objective combinatorial bi-level optimization [J].
Abbassi, Malek ;
Chaabani, Abir ;
Said, Lamjed Ben .
ENGINEERING OPTIMIZATION, 2022, 54 (04) :665-686
[38]   A Hybrid Bi-level Metaheuristic for Credit Scoring [J].
Doruk Şen ;
Cem Çağrı Dönmez ;
Umman Mahir Yıldırım .
Information Systems Frontiers, 2020, 22 :1009-1019
[39]   A Hybrid Bi-level Metaheuristic for Credit Scoring [J].
Sen, Doruk ;
Donmez, Cem Cagri ;
Yildirim, Umman Mahir .
INFORMATION SYSTEMS FRONTIERS, 2020, 22 (05) :1009-1019
[40]   Bi-level Optimization of Electricity Tariffs and PV Distributed Generation Investments [J].
Cervilla, Carles ;
Villar, Jose ;
Campos, Fco. Alberto .
2015 12TH INTERNATIONAL CONFERENCE ON THE EUROPEAN ENERGY MARKET (EEM), 2015,