Image-Based Sentiment Analysis Using InceptionV3 Transfer Learning Approach

被引:0
作者
Meena G. [1 ]
Mohbey K.K. [1 ]
Kumar S. [1 ,3 ]
Chawda R.K. [2 ]
Gaikwad S.V. [4 ]
机构
[1] Department of Computer Science, Central University of Rajasthan, Ajmer
[2] Department of Computer Science, Assam University, Silchar
[3] School of Business, Woxsen University, Hyderabad
[4] Faculty of Computer Science and Application, SMPICA, Charotar University of Science and Technology, Gujrat, Anand
关键词
Artificial Intelligence; Deep learning; Image sentiment analysis; InceptionV3; Transfer learning;
D O I
10.1007/s42979-023-01695-3
中图分类号
学科分类号
摘要
There has been a recent shift from using text-based sentiment analysis in favor of an image-based method. In recent years, transfer learning methods have been widely utilized in developing a comprehensive image sentiment analysis approach. Deep learning algorithms have produced remarkable outcomes in a variety of contexts. Image-based sentiment analysis presents many difficulties, but there also appears to be much space for development. A significant improvement over prior work is provided by an InceptionV3 approach that can easily focus on huge body portions like a human face. This research improves image categorization performance with InceptionV3, a popular deep convolutional neural network, and other deep features. Using a Convolutional Neural Network based on InceptionV3 architecture, we identify and classify emotions using the famous CK + , FER2013, and JAFFE datasets. Experiments reveal that the proposed model achieves 99.5% accuracy on the CK + dataset. Also, the accuracies of JAFFE and FER2013 are 86% and 73%, respectively. A person’s emotional patterns and mental health can be evaluated using this approach. © 2023, The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd.
引用
收藏
相关论文
共 31 条
  • [1] Meena G., Mohbey K.K., Indian A., Categorizing sentiment polarities in social networks data using convolutional neural network, SN Compt Sci, 3, 2, pp. 1-9, (2022)
  • [2] Gajarla V., Gupta A., Emotion detection and sentiment analysis of images, (2015)
  • [3] Gao Y., Mosalam K.M., Deep transfer learning for image-based structural damage recognition, Compt-Aided Civil Infrastruct Eng, 33, 9, pp. 748-768, (2018)
  • [4] Szegedy C., Vanhoucke V., Ioffe S., Shlens J., Wojna Z., Rethinking the inception architecture for computer vision, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818-2826, (2016)
  • [5] Litjens G., Kooi T., Bejnordi B.E., Setio A.A.A., Ciompi F., Ghafoorian M., Sanchez C.I., A survey on deep learning in medical image analysis, Med Image Anal, 42, pp. 60-88, (2017)
  • [6] Kaur H., Ahsaan S.U., Alankar B., Chang V., A proposed sentiment analysis deep learning algorithm for analyzing COVID-19 tweets, Inf Syst Front, 23, 6, pp. 1417-1429, (2021)
  • [7] Porusniuc G.C., Leon F., Timofte R., Miron C., ) Convolutional neural networks architectures for facial expression recognition, In: 2019 E-Health and Bioengineering Conference (EHB). IEEE, pp. 1-6, (2019)
  • [8] Hua W., Dai F., Huang L., Xiong J., Gui G., HERO: Human emotions recognition for realizing intelligent Internet of Things, IEEE Access, 7, pp. 24321-24332, (2019)
  • [9] Zheng H., Wang R., Ji W., Zong M., Wong W.K., Lai Z., Lv H., Discriminative deep multi-task learning for facial expression recognition, Inf Sci, 533, pp. 60-71, (2020)
  • [10] Boughida A., Kouahla M.N., Lafifi Y., A novel approach for facial expression recognition based on Gabor filters and genetic algorithm, Evol Syst, 13, 2, pp. 331-345, (2022)