ABE: An Agent-Based Software Architecture for A Multimodal Emotion Recognition Framework

被引:19
作者
Gonzalez-Sanchez, Javier [1 ]
Chavez-Echeagaray, Maria Elena [1 ]
Atkinson, Robert [1 ]
Burleson, Winslow [1 ]
机构
[1] Arizona State Univ, Sch Comp Informat & Decis Syst Engn, Tempe, AZ 85069 USA
来源
2011 9TH WORKING IEEE/IFIP CONFERENCE ON SOFTWARE ARCHITECTURE (WICSA) | 2011年
基金
美国国家科学基金会;
关键词
affective computing; architecture; framework; agent-based; multimodal; emotion recognition; empathetic systems;
D O I
10.1109/WICSA.2011.32
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The computer's ability to recognize human emotional states given physiological signals is gaining in popularity to create empathetic systems such as learning environments, health care systems and videogames. Despite that, there are few frameworks, libraries, architectures, or software tools, which allow systems developers to easily integrate emotion recognition into their software projects. The work reported here offers a first step to fill this gap in the lack of frameworks and models, addressing: (a) the modeling of an agent-driven component-based architecture for multimodal emotion recognition, called ABE, and (b) the use of ABE to implement a multimodal emotion recognition framework to support third-party systems becoming empathetic systems.
引用
收藏
页码:187 / 193
页数:7
相关论文
共 50 条
  • [21] Research on Multimodal Emotion Recognition Based on Fusion of Electroencephalogram and Electrooculography
    Yin, Jialai
    Wu, Minchao
    Yang, Yan
    Li, Ping
    Li, Fan
    Liang, Wen
    Lv, Zhao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 12
  • [22] A review on EEG-based multimodal learning for emotion recognition
    Pillalamarri, Rajasekhar
    Shanmugam, Udhayakumar
    ARTIFICIAL INTELLIGENCE REVIEW, 2025, 58 (05)
  • [23] An End-To-End Emotion Recognition Framework Based on Temporal Aggregation of Multimodal Information
    Radoi, Anamaria
    Birhala, Andreea
    Ristea, Nicolae-Catalin
    Dutu, Liviu-Cristian
    IEEE ACCESS, 2021, 9 : 135559 - 135570
  • [24] Multimodal Emotion Recognition Based on the Decoupling of Emotion and Speaker Information
    Gajsek, Rok
    Struc, Vitomir
    Mihelic, France
    TEXT, SPEECH AND DIALOGUE, 2010, 6231 : 275 - 282
  • [25] Towards a Multimodal Emotion Recognition Framework to Be Integrated in a Computer Based Speech Therapy System
    Schipor, Ovidiu-Andrei
    Pentiuc, Stefan-Gheorghe
    Schipor, Maria-Doina
    2011 6TH CONFERENCE ON SPEECH TECHNOLOGY AND HUMAN-COMPUTER DIALOGUE (SPED), 2011,
  • [26] Driver Emotion Recognition With a Hybrid Attentional Multimodal Fusion Framework
    Mou, Luntian
    Zhao, Yiyuan
    Zhou, Chao
    Nakisa, Bahareh
    Rastgoo, Mohammad Naim
    Ma, Lei
    Huang, Tiejun
    Yin, Baocai
    Jain, Ramesh
    Gao, Wen
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (04) : 2970 - 2981
  • [27] Deep learning-based dimensional emotion recognition for conversational agent-based cognitive behavioral therapy
    Striegl, Julian
    Richter, Jordan Wenzel
    Grossmann, Leoni
    Brastad, Bjorn
    Gotthardt, Marie
    Ruck, Christian
    Wallert, John
    Loitsch, Claudia
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [28] Agent-based framework for grid computing
    Zhang, ZH
    Wang, SQ
    GRID AND COOPERATIVE COMPUTING, PT 1, 2004, 3032 : 629 - 632
  • [29] A high speed inference architecture for multimodal emotion recognition based on sparse cross modal encoder
    Cui, Lin
    Zhang, Yuanbang
    Cui, Yingkai
    Wang, Boyan
    Sun, Xiaodong
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2024, 36 (05)
  • [30] Software Architecture for Smart Emotion Recognition and Regulation of the Ageing Adult
    José Carlos Castillo
    Álvaro Castro-González
    Antonio Fernández-Caballero
    José Miguel Latorre
    José Manuel Pastor
    Alicia Fernández-Sotos
    Miguel A. Salichs
    Cognitive Computation, 2016, 8 : 357 - 367