Multimodal sentiment analysis: A survey

被引:9
作者
Lai, Songning [1 ]
Hu, Xifeng [1 ]
Xu, Haoxuan [1 ]
Ren, Zhaoxia [2 ]
Liu, Zhi [1 ]
机构
[1] Shandong Univ, Sch Informat Sci & Engn, Qingdao, Peoples R China
[2] Shandong Univ, Assets & Lab Management Dept, Qingdao, Peoples R China
关键词
Multimodal sentiment analysis; Multimodal fusion; Affective computing; Computer vision;
D O I
10.1016/j.displa.2023.102563
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Multimodal sentiment analysis has emerged as a prominent research field within artificial intelligence, benefiting immensely from recent advancements in deep learning. This technology has unlocked unprecedented possibilities for application and research, rendering it a highly sought-after area of study. In this review, we aim to present a comprehensive overview of multimodal sentiment analysis by delving into its definition, historical context, and evolutionary trajectory. Furthermore, we explore recent datasets and state-of-the-art models, with a particular focus on the challenges encountered and the future prospects that lie ahead. By offering constructive suggestions for promising research directions and the development of more effective multimodal sentiment analysis models, this review intends to provide valuable guidance to researchers in this dynamic field.
引用
收藏
页数:11
相关论文
共 76 条
[1]   What You Say or How You Say It? Depression Detection Through Joint Modeling of Linguistic and Acoustic Aspects of Speech [J].
Aloshban, Nujud ;
Esposito, Anna ;
Vinciarelli, Alessandro .
COGNITIVE COMPUTATION, 2022, 14 (05) :1585-1598
[2]  
[Anonymous], 2004, Proceedings of the 20th International Conference on Computational Linguistics (COLING)
[3]   IEMOCAP: interactive emotional dyadic motion capture database [J].
Busso, Carlos ;
Bulut, Murtaza ;
Lee, Chi-Chun ;
Kazemzadeh, Abe ;
Mower, Emily ;
Kim, Samuel ;
Chang, Jeannette N. ;
Lee, Sungbok ;
Narayanan, Shrikanth S. .
LANGUAGE RESOURCES AND EVALUATION, 2008, 42 (04) :335-359
[4]   New Avenues in Opinion Mining and Sentiment Analysis [J].
Cambria, Erik ;
Schuller, Bjoern ;
Xia, Yunqing ;
Havasi, Catherine .
IEEE INTELLIGENT SYSTEMS, 2013, 28 (02) :15-21
[5]   State of the art: a review of sentiment analysis based on sequential transfer learning [J].
Chan, Jireh Yi-Le ;
Bea, Khean Thye ;
Leow, Steven Mun Hong ;
Phoong, Seuk Wai ;
Cheng, Wai Khuen .
ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (01) :749-780
[6]   Multimodal sentimental analysis for social media applications: A comprehensive review [J].
Chandrasekaran, Ganesh ;
Nguyen, Tu N. ;
Hemanth, D. Jude .
WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2021, 11 (05)
[7]   Deception detection using multimodal fusion approaches [J].
Chebbi, Safa ;
Ben Jebara, Sofia .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (09) :13073-13102
[8]  
Chen F., 2019, arXiv
[9]  
Dai Rong, 2020, J. Chongqing Univ. Technol. (Natural Science), V34, P146
[10]  
Deonna J. A., 2012, EMOTIONS PHILOS INTR