Feature Selection Method Using Multi-Agent Reinforcement Learning Based on Guide Agents

被引:5
作者
Kim, Minwoo [1 ,2 ]
Bae, Jinhee [3 ]
Wang, Bohyun [1 ]
Ko, Hansol [1 ]
Lim, Joon S. [1 ]
机构
[1] Gachon Univ, Dept Comp Sci, Seongnam Si 13557, Gyeonggi Do, South Korea
[2] MEZOO Co Ltd, R&D Ctr 2, AI Team, Gieopdosi Ro 200,Jijeong Myeon, Wonju 26354, Gangwon Do, South Korea
[3] Univ Southern Calif, Dept Comp Sci, Los Angeles, CA 90007 USA
基金
新加坡国家研究基金会;
关键词
feature selection; guide agents; main agents; multi-agent; reinforcement learning (RL); rewards; ALGORITHM;
D O I
10.3390/s23010098
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In this study, we propose a method to automatically find features from a dataset that are effective for classification or prediction, using a new method called multi-agent reinforcement learning and a guide agent. Each feature of the dataset has one of the main and guide agents, and these agents decide whether to select a feature. Main agents select the optimal features, and guide agents present the criteria for judging the main agents' actions. After obtaining the main and guide rewards for the features selected by the agents, the main agent that behaves differently from the guide agent updates their Q-values by calculating the learning reward delivered to the main agents. The behavior comparison helps the main agent decide whether its own behavior is correct, without using other algorithms. After performing this process for each episode, the features are finally selected. The feature selection method proposed in this study uses multiple agents, reducing the number of actions each agent can perform and finding optimal features effectively and quickly. Finally, comparative experimental results on multiple datasets show that the proposed method can select effective features for classification and increase classification accuracy.
引用
收藏
页数:14
相关论文
共 34 条
[11]   Using reinforcement learning to find an optimal set of features [J].
Fard, Seyed Mehdi Hazrati ;
Hamzeh, Ali ;
Hashemi, Sattar .
COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2013, 66 (10) :1892-1904
[12]   An Introduction to Deep Reinforcement Learning [J].
Francois-Lavet, Vincent ;
Henderson, Peter ;
Islam, Riashat ;
Bellemare, Marc G. ;
Pineau, Joelle .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2018, 11 (3-4) :219-354
[13]   Feature selection for support vector machines by means of genetic algorithms [J].
Fröhlich, H ;
Chapelle, O ;
Schölkopf, B .
15TH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2003, :142-148
[14]   Two stage forecast engine with feature selection technique and improved meta-heuristic algorithm for electricity load forecasting [J].
Ghadimi, Noradin ;
Akbarimajd, Adel ;
Shayeghi, Hossein ;
Abedinia, Oveis .
ENERGY, 2018, 161 :130-142
[15]   Deluge based Genetic Algorithm for feature selection [J].
Guha, Ritam ;
Ghosh, Manosij ;
Kapri, Souvik ;
Shaw, Sushant ;
Mutsuddi, Shyok ;
Bhateja, Vikrant ;
Sarkar, Ram .
EVOLUTIONARY INTELLIGENCE, 2021, 14 (02) :357-367
[16]   Big data with cognitive computing: A review for the future [J].
Gupta, Shivam ;
Kar, Arpan Kumar ;
Baabdullah, Abdullah ;
Al-Khowaiter, Wassan A. A. .
INTERNATIONAL JOURNAL OF INFORMATION MANAGEMENT, 2018, 42 :78-89
[17]  
Guyon I., 2003, J. Mach. Learn. Res., V3, P1157
[18]   Uncertainty in big data analytics: survey, opportunities, and challenges [J].
Hariri, Reihaneh H. ;
Fredericks, Erik M. ;
Bowers, Kate M. .
JOURNAL OF BIG DATA, 2019, 6 (01)
[19]  
Khurana U, 2018, AAAI CONF ARTIF INTE, P3407
[20]  
KIRA K, 1992, MACHINE LEARNING /, P249