Multimodal Emotion and Sentiment Modeling From Unstructured Big Data: Challenges, Architecture, & Techniques

被引:22
作者
Seng, Jasmine Kah Phooi [1 ]
Ang, Kenneth Li-Minn [2 ]
机构
[1] Univ New South Wales, Sch Engn & IT, Sydney, NSW 2052, Australia
[2] Griffith Univ, Sch Informat & Commun Technol, Brisbane, Qld 4215, Australia
关键词
Big data; affective analytics; emotion recognition; sentiment modeling; unstructured data; LINEAR DISCRIMINANT-ANALYSIS; CLASSIFICATION; SATISFACTION; RECOGNITION; INTEGRATION;
D O I
10.1109/ACCESS.2019.2926751
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The exponential growth of multimodal content in today's competitive business environment leads to a huge volume of unstructured data. Unstructured big data has no particular format or structure and can be in any form, such as text, audio, images, and video. In this paper, we address the challenges of emotion and sentiment modeling due to unstructured big data with different modalities. We first include an up-to-date review on emotion and sentiment modeling including the state-of-the-art techniques. We then propose a new architecture of multimodal emotion and sentiment modeling for big data. The proposed architecture consists of five essential modules: data collection module, multimodal data aggregation module, multimodal data feature extraction module, fusion and decision module, and application module. Novel feature extraction techniques called the divide-and-conquer principal component analysis (Div-ConPCA) and the divide-and-conquer linear discriminant analysis (Div-ConLDA) are proposed for the multimodal data feature extraction module in the architecture. The experiments on a multicore machine architecture are performed to validate the performance of the proposed techniques.
引用
收藏
页码:90982 / 90998
页数:17
相关论文
共 88 条
  • [1] Big Sensor Data Applications in Urban Environments
    Ang, Li-Minn
    Seng, Kah Phooi
    [J]. BIG DATA RESEARCH, 2016, 4 : 1 - 12
  • [2] [Anonymous], P IEEE INT C SYST MA
  • [3] [Anonymous], 2008, P 2008 16 EUR SIGN P
  • [4] [Anonymous], 1998, MATRIX ALGORITHMS BA
  • [5] [Anonymous], 2012, C RES PRACTICE INFRO
  • [6] [Anonymous], 2006, 22 INT C DATA ENG WO
  • [7] [Anonymous], IEEE T AFFECT COMPUT
  • [8] [Anonymous], P 8 INT C MULT INT N
  • [9] [Anonymous], IEEE T AFFECTIVE COM
  • [10] [Anonymous], P 51 ANN M ASS COMP