Deep brain emotional learning-based intelligent controller applied to an inverted pendulum system

被引:4
作者
Silva, Jeydson [1 ]
Aquino, Ronaldo [1 ]
Ferreira, Aida [2 ]
Marques, Davidson [1 ]
机构
[1] Univ Fed Pernambuco, Dept Elect Engn, Recife, PE, Brazil
[2] Fed Inst Pernambuco, Recife, PE, Brazil
关键词
Reinforcement learning; Deep learning; Emotional learning; Emotional controller;
D O I
10.1007/s11227-021-04200-w
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Biologically inspired controllers demonstrate great success in several applications, mainly in situations that present disturbances and uncertainties in the dynamics of the system. In recent times, several works have appeared in the area of emotional learning which occurs in the human brain, thus allowing to the emergence of new theories and applications in control engineering. In control engineering, it is possible to highlight the BELBIC (Brain Emotional Learning-Based Intelligent Controller). However, the design and commissioning of this type of controller still represents a major challenge for researchers, since it is necessary to determine some characteristic signals to this system (stimuli), which can vary from application to application. This work presents a methodology for the construction of architectures for BELBIC stimulus signals, using as a basis the DRL (Deep Reinforcement Learning) techniques. The DRL allows extracting characteristic patterns from the dynamics of systems which, perhaps, may have high dimensionality and possibly nonlinear dynamics, as is the case of most problems involving real-world dynamic systems. The resulting controller model is validated by applying an inverted pendulum dynamic system in order to demonstrate a new approach to the architectures of the BELBIC that allows to achieve a greater generalization in its application, as well as providing a viable alternative to the traditional models in use.
引用
收藏
页码:8346 / 8366
页数:21
相关论文
共 32 条
[1]  
Aggleton J.P., 1992, The amygdala: neurobiological aspects of emotion, memory, and mental dysfunction
[2]  
[Anonymous], 2016, Openai gym
[3]  
Antonin Raffin, 2018, RL BASELINES ZOO
[4]   Deep Reinforcement Learning A brief survey [J].
Arulkumaran, Kai ;
Deisenroth, Marc Peter ;
Brundage, Miles ;
Bharath, Anil Anthony .
IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (06) :26-38
[5]   NEURONLIKE ADAPTIVE ELEMENTS THAT CAN SOLVE DIFFICULT LEARNING CONTROL-PROBLEMS [J].
BARTO, AG ;
SUTTON, RS ;
ANDERSON, CW .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05) :834-846
[6]   Design of a multivariable stimulus for Emotional-Learning based control of a 2-DOF laboratory helicopter [J].
Debnath, Biswajit ;
Mija, S. J. .
ISA TRANSACTIONS, 2021, 118 :189-206
[7]   A comparative study of various intelligent based controllers for speed control of IPMSM drives in the field-weakening region [J].
Dehkordi, Behzad Mirzaeian ;
Kiyoumarsi, Arash ;
Hamedani, Pegah ;
Lucas, Caro .
EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (10) :12643-12653
[8]  
Fujimoto S, 2018, PR MACH LEARN RES, V80
[9]  
Goodfellow I, 2016, ADAPT COMPUT MACH LE, P1
[10]  
Jafari M, 2017, INT CONF UNMAN AIRCR, P1470