ABE: An Agent-Based Software Architecture for A Multimodal Emotion Recognition Framework

被引：19

作者：

Gonzalez-Sanchez, Javier ^{[1
]}

Chavez-Echeagaray, Maria Elena ^{[1
]}

Atkinson, Robert ^{[1
]}

Burleson, Winslow ^{[1
]}

机构：

[1] Arizona State Univ, Sch Comp Informat & Decis Syst Engn, Tempe, AZ 85069 USA

来源：

2011 9TH WORKING IEEE/IFIP CONFERENCE ON SOFTWARE ARCHITECTURE (WICSA) | 2011年

基金：

美国国家科学基金会;

关键词：

affective computing; architecture; framework; agent-based; multimodal; emotion recognition; empathetic systems;

D O I：

10.1109/WICSA.2011.32

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

The computer's ability to recognize human emotional states given physiological signals is gaining in popularity to create empathetic systems such as learning environments, health care systems and videogames. Despite that, there are few frameworks, libraries, architectures, or software tools, which allow systems developers to easily integrate emotion recognition into their software projects. The work reported here offers a first step to fill this gap in the lack of frameworks and models, addressing: (a) the modeling of an agent-driven component-based architecture for multimodal emotion recognition, called ABE, and (b) the use of ABE to implement a multimodal emotion recognition framework to support third-party systems becoming empathetic systems.

引用

页码：187 / 193

页数：7

共 50 条

[41] Reward-Based Gradient Modulation for Multimodal Emotion Recognition With LoRA [J].

Liu, Feng ;

Fu, Ziwang ;

Wang, Yunlong .

IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2025,

[42] Advances in Multimodal Emotion Recognition Based on Brain-Computer Interfaces [J].

He, Zhipeng ;

Li, Zina ;

Yang, Fuzhou ;

Wang, Lei ;

Li, Jingcong ;

Zhou, Chengju ;

Pan, Jiahui .

BRAIN SCIENCES, 2020, 10 (10) :1-29

[43] A BAYESIAN NONPARAMETRIC MULTIMODAL DATA MODELING FRAMEWORK FOR VIDEO EMOTION RECOGNITION [J].

Xue, Jianfei ;

Luo, Zhaojie ;

Eguchi, Koji ;

Takiguchi, Tetsuya ;

Omoto, Tsukasa .

2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, :601-606

[44] An Agent-based Framework for Matching Buyers and Sellers [J].

Li, Yu-hua ;

Fan, Zhi-ping ;

Chen, Xi ;

Kang, Feng .

2008 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-31, 2008, :9526-9529

[45] Human Emotion Recognition by Integrating Facial and Speech Features: An Implementation of Multimodal Framework using CNN [J].

Srinivas, P. V. V. S. ;

Mishra, Pragnyaban .

INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (01) :592-603

[46] A multimodal fusion emotion recognition method based on multitask learning and attention mechanism [J].

Xie, Jinbao ;

Wang, Jiyu ;

Wang, Qingyan ;

Yang, Dali ;

Gu, Jinming ;

Tang, Yongqiang ;

Varatnitski, Yury I. .

NEUROCOMPUTING, 2023, 556

[47] A methodological framework for the integration of machine learning algorithms into agent-based simulation [J].

Zornic, Nikola ;

Markovic, Aleksandar .

JOURNAL OF UNIVERSAL COMPUTER SCIENCE, 2022, 28 (05) :540-562

[48] Multimodal EEG Emotion Recognition Based on the Attention Recurrent Graph Convolutional Network [J].

Chen, Jingxia ;

Liu, Yang ;

Xue, Wen ;

Hu, Kailei ;

Lin, Wentao .

INFORMATION, 2022, 13 (11)

[49] Emotion contagion in agent-based simulations of crowds: a systematic review [J].

van Haeringen, E. S. ;

Gerritsen, C. ;

Hindriks, K., V .

AUTONOMOUS AGENTS AND MULTI-AGENT SYSTEMS, 2023, 37 (01)

[50] Emotion contagion in agent-based simulations of crowds: a systematic review [J].

E. S. van Haeringen ;

C. Gerritsen ;

K. V. Hindriks .

Autonomous Agents and Multi-Agent Systems, 2023, 37

← 1 2 3 4 5 →