Intelligent System for Bi-Modal Recognition of Apparent Personality Traits (iSMART)

被引:0
|
作者
Patel, Cdr Devraj [1 ]
Dhavale, Sunita V. [1 ]
机构
[1] Def Inst Adv Technol DIAT, Dept CSE, Pune, India
关键词
1ST IMPRESSIONS;
D O I
10.1007/978-981-19-2821-5_66
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Personality of an individual has been a promising variable to understand himself and furthermore the others in the society. It is the logical arrangement of an individual's attributes like thoughts, feelings, attitudes, behaviour and capability that makes an individual selective. Our personality likewise influences our decisions, medical conditions, assumptions, inclinations and prerequisites. In the scenario of 4G/5G and COVID pandemic, the majority of individuals are dependent on the web gateways as their essential intuitive vehicle for their own and expert necessities; accordingly, it has been a fundamental significance for us to consequently perceive the personality traits of the individual on the opposite side of the screen. Mental analysts have tracked down that an interaction of just 100 ms is adequate to shape judgement about any individual. Thinking about a similar idea towards execution of profound learning for recognition of personality traits, in this work, we propose an intelligent model (iSMART), a combination of depth-wise separable convolution neural network (2D-CNN) and long short-term memory with attention (LSTMwA), that extracts audio and video features through parallel networks and predicts the ultimate personality score of a person. With the top to bottom trial and error, it has been seen that the depth-wise separable CNN reduces the quantity of trainable parameters without compromising the test precision. It is a compelling and lightweight model for recognition of personality traits utilising bi-modular data sources. It likewise accomplishes better accuracy as compared with the outcomes got by the top scoring teams in the ChaLearn Looking at People challenge ECCV 2016. Our proposed model can possibly empower the system with better psychological understandings and improved human-computer interaction.
引用
收藏
页码:781 / 794
页数:14
相关论文
共 50 条
  • [31] Design and characterisation of a bi-modal solar thermal propulsion and power system for small satellites
    Leverone, Fiona
    Cervone, Angelo
    Pini, Matteo
    Gill, Eberhard
    APPLIED THERMAL ENGINEERING, 2021, 189 (189)
  • [32] An Assistive Bi-modal User Interface Integrating Multi-channel Speech Recognition and Computer Vision
    Karpov, Alexey
    Ronzhin, Andrey
    Kipyatkova, Irina
    HUMAN-COMPUTER INTERACTION: INTERACTION TECHNIQUES AND ENVIRONMENTS, PT II, 2011, 6762 : 454 - 463
  • [33] Bi-modal First Impressions Recognition Using Temporally Ordered Deep Audio and Stochastic Visual Features
    Subramaniam, Arulkumar
    Patel, Vismay
    Mishra, Ashish
    Balasubramanian, Prashanth
    Mittal, Anurag
    COMPUTER VISION - ECCV 2016 WORKSHOPS, PT III, 2016, 9915 : 337 - 348
  • [34] Fusion of hand-shape and palm-print traits using morphology for bi-modal biometric authentication
    Chen, Wen-Shiung
    Wang, Wei-Chang
    INTERNATIONAL JOURNAL OF BIOMETRICS, 2018, 10 (04) : 368 - 390
  • [35] Quantum reversibility in cooperative interaction of the atom system with bi-modal cavity field in Raman conversion
    Starodub, E.
    Enaki, N.
    PHYSICA SCRIPTA, 2020, 95 (05)
  • [36] Applying Segment-Level Attention on Bi-Modal Transformer Encoder for Audio-Visual Emotion Recognition
    Hsu, Jia-Hao
    Wu, Chung-Hsien
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (04) : 3231 - 3243
  • [37] Numerical Simulation of Heat Transfer Characteristics of Regenerative Solar Thermophotovoltaic-Propulsion Bi-Modal System
    Zhang, Yan-Xin
    Bao, Chuang
    Xia, Hai-Feng
    Song, Fang-Zhou
    Gao, Peng
    Liu, Xiang-Lei
    Tuijin Jishu/Journal of Propulsion Technology, 2021, 42 (12): : 2866 - 2880
  • [38] Bi-modal system-on-chip platform for bilirubin monitoring by using photometric and temporal degradation approaches
    Ndabakuranye, Jean Pierre
    Prawer, Steven
    Ahnood, Arman
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 85
  • [39] A Recognition Method for Components of Space Target Based on Bi-modal Fusion of 3D Point Cloud and Image
    Yuan M.
    Zhang Z.
    Yuhang Xuebao/Journal of Astronautics, 2023, 44 (05): : 796 - 804
  • [40] Generation of high-frequency radiation in bi-modal electrodynamic system filled by asymmetric multilayer heterostructure
    Kozyrev, AB
    TWENTY SEVENTH INTERNATIONAL CONFERENCE ON INFRARED AND MILLIMETER WAVES, CONFERENCE DIGEST, 2002, : 251 - 252