Active noise control system via multi-agent credit assignment

被引:4
作者
Raeisy, Behrooz [1 ,2 ]
Haghighi, Shapoor Golbahar [1 ]
Safavi, Ali Akbar [1 ]
机构
[1] Shiraz Univ, Sch Elect & Comp Engn, Shiraz, Iran
[2] Iranian Space Res Ctr, Inst Mech, Shiraz, Iran
关键词
Active Noise Control (ANC); Knowledge Evaluation Based Critic Assignment (KEBCA); Multi-Agent Credit Assignment (MCA); Multi-agent system; Q-Learning (QL); Reinforcement Learning (RL);
D O I
10.3233/IFS-130797
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-Agent systems have proved powerful in various sciences and engineering problems. This paper proposes a novel Multi-Agent Active Noise Control (ANC) formulation via the credit assignment approach. The introduced ANC removes multitonal acoustic noises in the environment invoking reinforcement learning techniques. In some multi-agent systems, for the training of all agents, only one reward is available. It is clear that this reward does not belong to one particular agent. The assignment of this reward to the agents is a problem which is known as Multi-Agent Credit Assignment (MCA). In this research, each agent is responsible for reducing the noise power of one single harmonic, while only the total noise power of the signals is known. Therefore, it is required to assign a power contribution to each single harmonic. To resolve this problem, at first, the Knowledge Evaluation Based Critic Assignment (KEBCA) idea with proper modification is used and then a new method is introduced for this special problem. Simulation results show good improvement in the system performance by switching the single agent into the multi-agent system.
引用
收藏
页码:1051 / 1063
页数:13
相关论文
共 29 条
[1]   Expertness based cooperative Q-learning [J].
Ahmadabadi, MN ;
Asadpour, M .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2002, 32 (01) :66-76
[2]  
Aliev RA, 2000, J INTELL FUZZY SYST, V9, P1
[3]   A study on expertise of agents and its effects on cooperative Q-learning [J].
Araabi, Babak Nadjar ;
Mastoureshgh, Sahar ;
Ahmadabadi, Majid Nili .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2007, 37 (02) :398-409
[4]  
Biswas Rupak., 2010, Parallel Computational Fluid Dynamics: Recent Advances and Future Directions
[5]  
Busoniu L., 2006, Proceedings of the 9th International Conference on Control, Automation, Robotics and Vision, Singapore, P527
[6]  
CHANG YH, 2003, P NEUR INF PROC SYST
[7]   Active noise control in a forced-air cooling system [J].
de Callafon, R. A. ;
Zeng, J. ;
Kinney, C. E. .
CONTROL ENGINEERING PRACTICE, 2010, 18 (09) :1045-1052
[8]   A novel approach to coordination of multiple robots with communication failures via proximity graph [J].
Fan, Yuan ;
Feng, Gang ;
Wang, Yong ;
Qiu, Jianbin .
AUTOMATICA, 2011, 47 (08) :1800-1805
[9]   COMBINATION FRAMEWORK OF RENDEZVOUS ALGORITHM FOR MULTI-AGENT SYSTEMS WITH LIMITED SENSING RANGES [J].
Fan, Yuan ;
Feng, Gang ;
Wang, Yong .
ASIAN JOURNAL OF CONTROL, 2011, 13 (02) :283-294
[10]  
Harati, 2002, SYST MAN CYB IEEE IN