ABE: An Agent-Based Software Architecture for A Multimodal Emotion Recognition Framework

被引:19
作者
Gonzalez-Sanchez, Javier [1 ]
Chavez-Echeagaray, Maria Elena [1 ]
Atkinson, Robert [1 ]
Burleson, Winslow [1 ]
机构
[1] Arizona State Univ, Sch Comp Informat & Decis Syst Engn, Tempe, AZ 85069 USA
来源
2011 9TH WORKING IEEE/IFIP CONFERENCE ON SOFTWARE ARCHITECTURE (WICSA) | 2011年
基金
美国国家科学基金会;
关键词
affective computing; architecture; framework; agent-based; multimodal; emotion recognition; empathetic systems;
D O I
10.1109/WICSA.2011.32
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The computer's ability to recognize human emotional states given physiological signals is gaining in popularity to create empathetic systems such as learning environments, health care systems and videogames. Despite that, there are few frameworks, libraries, architectures, or software tools, which allow systems developers to easily integrate emotion recognition into their software projects. The work reported here offers a first step to fill this gap in the lack of frameworks and models, addressing: (a) the modeling of an agent-driven component-based architecture for multimodal emotion recognition, called ABE, and (b) the use of ABE to implement a multimodal emotion recognition framework to support third-party systems becoming empathetic systems.
引用
收藏
页码:187 / 193
页数:7
相关论文
共 50 条
[21]   AN AGENT-BASED ARCHITECTURE FOR CONCURRENT ENGINEERING [J].
GOLDSTEIN, D .
CONCURRENT ENGINEERING-RESEARCH AND APPLICATIONS, 1994, 2 (02) :117-123
[22]   Research on Multimodal Emotion Recognition Based on Fusion of Electroencephalogram and Electrooculography [J].
Yin, Jialai ;
Wu, Minchao ;
Yang, Yan ;
Li, Ping ;
Li, Fan ;
Liang, Wen ;
Lv, Zhao .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 :1-12
[23]   A review on EEG-based multimodal learning for emotion recognition [J].
Pillalamarri, Rajasekhar ;
Shanmugam, Udhayakumar .
ARTIFICIAL INTELLIGENCE REVIEW, 2025, 58 (05)
[24]   EEG-based Multimodal Representation Learning for Emotion Recognition [J].
Yin, Kang ;
Shin, Hye-Bin ;
Li, Dan ;
Lee, Seong-Whan .
2025 13TH INTERNATIONAL CONFERENCE ON BRAIN-COMPUTER INTERFACE, BCI, 2025,
[25]   Multimodal Emotion Recognition Based on the Decoupling of Emotion and Speaker Information [J].
Gajsek, Rok ;
Struc, Vitomir ;
Mihelic, France .
TEXT, SPEECH AND DIALOGUE, 2010, 6231 :275-282
[26]   An End-To-End Emotion Recognition Framework Based on Temporal Aggregation of Multimodal Information [J].
Radoi, Anamaria ;
Birhala, Andreea ;
Ristea, Nicolae-Catalin ;
Dutu, Liviu-Cristian .
IEEE ACCESS, 2021, 9 :135559-135570
[27]   Towards a Multimodal Emotion Recognition Framework to Be Integrated in a Computer Based Speech Therapy System [J].
Schipor, Ovidiu-Andrei ;
Pentiuc, Stefan-Gheorghe ;
Schipor, Maria-Doina .
2011 6TH CONFERENCE ON SPEECH TECHNOLOGY AND HUMAN-COMPUTER DIALOGUE (SPED), 2011,
[28]   Driver Emotion Recognition With a Hybrid Attentional Multimodal Fusion Framework [J].
Mou, Luntian ;
Zhao, Yiyuan ;
Zhou, Chao ;
Nakisa, Bahareh ;
Rastgoo, Mohammad Naim ;
Ma, Lei ;
Huang, Tiejun ;
Yin, Baocai ;
Jain, Ramesh ;
Gao, Wen .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (04) :2970-2981
[29]   Deep learning-based dimensional emotion recognition for conversational agent-based cognitive behavioral therapy [J].
Striegl, Julian ;
Richter, Jordan Wenzel ;
Grossmann, Leoni ;
Brastad, Bjorn ;
Gotthardt, Marie ;
Ruck, Christian ;
Wallert, John ;
Loitsch, Claudia .
PEERJ COMPUTER SCIENCE, 2024, 10
[30]   Agent-based framework for grid computing [J].
Zhang, ZH ;
Wang, SQ .
GRID AND COOPERATIVE COMPUTING, PT 1, 2004, 3032 :629-632