CONTEXT-AWARE MULTI-STREAM NETWORKS FOR DIMENSIONAL EMOTION PREDICTION IN IMAGES

被引:1
作者
Nagappan, Sidharrth [1 ]
Tan, Jia Qi [1 ]
Wong, Lai-Kuan [1 ]
See, John [2 ]
机构
[1] Multimedia Univ, Fac Comp & Informat, Cyberjaya, Malaysia
[2] Heriot Watt Univ, Sch Math & Comp Sci, Putrajaya, Malaysia
来源
2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2023年
关键词
dimensional emotion; image emotion prediction; emotional analysis; deep neural networks; DES;
D O I
10.1109/ICIP49359.2023.10221960
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Teaching machines to comprehend the nuances of emotion from photographs is a particularly challenging task. Emotion perception- naturally a subjective problem, is often simplified for computational purposes into categorical states or valence-arousal dimensional space, the latter being a lesser-explored problem in the literature. This paper proposes a multi-stream context-aware neural network model for dimensional emotion prediction in images. Models were trained using a set of object and scene data along with deep features for valence, arousal, and dominance estimation. Experimental evaluation on a large-scale image emotion dataset demonstrates the viability of our proposed approach. Our analysis postulates that the understanding of the depicted object in an image is vital for successful predictions whilst relying on scene information can lead to somewhat confounding effects.
引用
收藏
页码:2480 / 2484
页数:5
相关论文
共 21 条
  • [1] [Anonymous], 2022, COMPUTATIONAL EMOTIO, DOI DOI 10.1007/978-3-030-81465-6
  • [2] Multimodal Deep Networks for Text and Image-Based Document Classification
    Audebert, Nicolas
    Herold, Catherine
    Slimani, Kuider
    Vidal, Cedric
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2019, PT I, 2020, 1167 : 427 - 443
  • [3] Bayoudh Khaled, 2022, VISUAL COMPUTER, V38
  • [4] Deep Learning Based Detection Tool for Impacted Mandibular Third Molar Teeth
    Celik, Mahmut Emin
    [J]. DIAGNOSTICS, 2022, 12 (04)
  • [5] Dosovitskiy A., 2021, INT C LEARN REPRESEN
  • [6] Fan Y.C., 2018, I2MTC 2018 - 2018 IEEE International Instrumentation and Measurement Technology Conference: Discovering New Horizons in Instrumentation and Measurement, Proceedings, P1
  • [7] Han XF, 2015, PROC CVPR IEEE, P3279, DOI 10.1109/CVPR.2015.7298948
  • [8] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [9] Howard A. G., 2017, ARXIV
  • [10] Building Emotional Machines: Recognizing Image Emotions Through Deep Neural Networks
    Kim, Hye-Rin
    Kim, Yeong-Seok
    Kim, Seon Joo
    Lee, In-Kwon
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (11) : 2980 - 2992