ABE: An Agent-Based Software Architecture for A Multimodal Emotion Recognition Framework

被引：19

作者：

Gonzalez-Sanchez, Javier ^{[1
]}

Chavez-Echeagaray, Maria Elena ^{[1
]}

Atkinson, Robert ^{[1
]}

Burleson, Winslow ^{[1
]}

机构：

[1] Arizona State Univ, Sch Comp Informat & Decis Syst Engn, Tempe, AZ 85069 USA

来源：

2011 9TH WORKING IEEE/IFIP CONFERENCE ON SOFTWARE ARCHITECTURE (WICSA) | 2011年

基金：

美国国家科学基金会;

关键词：

affective computing; architecture; framework; agent-based; multimodal; emotion recognition; empathetic systems;

D O I：

10.1109/WICSA.2011.32

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

The computer's ability to recognize human emotional states given physiological signals is gaining in popularity to create empathetic systems such as learning environments, health care systems and videogames. Despite that, there are few frameworks, libraries, architectures, or software tools, which allow systems developers to easily integrate emotion recognition into their software projects. The work reported here offers a first step to fill this gap in the lack of frameworks and models, addressing: (a) the modeling of an agent-driven component-based architecture for multimodal emotion recognition, called ABE, and (b) the use of ABE to implement a multimodal emotion recognition framework to support third-party systems becoming empathetic systems.

引用

页码：187 / 193

页数：7

共 50 条

[31] A high speed inference architecture for multimodal emotion recognition based on sparse cross modal encoder [J].

Cui, Lin ;

Zhang, Yuanbang ;

Cui, Yingkai ;

Wang, Boyan ;

Sun, Xiaodong .

JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2024, 36 (05)

[32] Software Architecture for Smart Emotion Recognition and Regulation of the Ageing Adult [J].

José Carlos Castillo ;

Álvaro Castro-González ;

Antonio Fernández-Caballero ;

José Miguel Latorre ;

José Manuel Pastor ;

Alicia Fernández-Sotos ;

Miguel A. Salichs .

Cognitive Computation, 2016, 8 :357-367

[33] Software Architecture for Smart Emotion Recognition and Regulation of the Ageing Adult [J].

Carlos Castillo, Jose ;

Castro-Gonzalez, Alvaro ;

Fernandez-Caballero, Antonio ;

Miguel Latorre, Jose ;

Manuel Pastor, Jose ;

Fernandez-Sotos, Alicia ;

Salichs, Miguel A. .

COGNITIVE COMPUTATION, 2016, 8 (02) :357-367

[34] A Multimodal Facial Emotion Recognition Framework through the Fusion of Speech with Visible and Infrared Images [J].

Siddiqui, Mohammad Faridul Haque ;

Javaid, Ahmad Y. .

MULTIMODAL TECHNOLOGIES AND INTERACTION, 2020, 4 (03) :1-21

[35] An agent-based approach for crowdsourcing software design [J].

Li, Hui ;

Hao, Li-Ying ;

Ge, Xin ;

Gao, Jian ;

Guo, Shikai .

PROCEEDINGS OF THE 28TH CHINESE CONTROL AND DECISION CONFERENCE (2016 CCDC), 2016, :4497-4501

[36] Multimodal emotion recognition based on manifold learning and convolution neural network [J].

Zhang, Yong ;

Cheng, Cheng ;

Zhang, YiDie .

MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (23) :33253-33268

[37] Multimodal emotion recognition based on manifold learning and convolution neural network [J].

Yong Zhang ;

Cheng Cheng ;

YiDie Zhang .

Multimedia Tools and Applications, 2022, 81 :33253-33268

[38] Emotion recognition based on brain-like multimodal hierarchical perception [J].

Zhu X. ;

Huang Y. ;

Wang X. ;

Wang R. .

Multimedia Tools and Applications, 2024, 83 (18) :56039-56057

[39] Multimodal emotion recognition algorithm based on edge network emotion element compensation and data fusion [J].

Yu Wang .

Personal and Ubiquitous Computing, 2019, 23 :383-392

[40] Multimodal emotion recognition algorithm based on edge network emotion element compensation and data fusion [J].

Wang, Yu .

PERSONAL AND UBIQUITOUS COMPUTING, 2019, 23 (3-4) :383-392

← 1 2 3 4 5 →