The Truth and Nothing but the Truth: Multimodal Analysis for Deception Detection

被引：0
作者：
Jaiswal, Mimansa [1 ]
Tabibu, Sairam [2 ]
Bajpai, Rajiv [3 ]
机构：
[1] DA Univ, Inst Engn & Technol, Indore, Madhya Pradesh, India
[2] IIT BHU, Elect Engn, Varanasi, Uttar Pradesh, India
[3] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
来源：
2016 IEEE 16TH INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW) | 2016年
关键词：
face tracking; support vector machine; multimodal analysis; deception; POS weighted vector; SENTIMENT; CLUES;
D O I：
10.1109/ICDMW.2016.156
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
We propose a data-driven method for automatic deception detection in real-life trial data using visual and verbal cues. Using OpenFace with facial action unit recognition, we analyze the movement of facial features of the witness when posed with questions and the acoustic patterns using OpenSmile. We then perform a lexical analysis on the spoken words, emphasizing the use of pauses and utterance breaks, feeding that to a Support Vector Machine to test deceit or truth prediction. We then try out a method to incorporate utterance-based fusion of visual and lexical analysis, using string based matching.
引用
收藏
页码：938 / 943
页数：6
相关论文
共 49 条
  • [1] Abouelenien Mohamed., 2014, P 16 INT C MULTIMODA, P58, DOI 10.1145/2663204.2663229
  • [2] Abouelenin Mohamed, 2016, P 9 ACM C PERV TECHN
  • [3] Almela Angela., 2012, Workshop on Computational Approaches to Deception Detection, P15, DOI DOI 10.5195/LESLI.2013.5
  • [4] [Anonymous], 2013, Proceedings of the 21st ACM International Conference on Multimedia, DOI DOI 10.1145/2502081.2502224
  • [5] Cambria E., 2012, P 26 AAAI C ART INT, P186, DOI DOI 10.1609/AAAI.V26I1.8154
  • [6] Cambria E., 2016, P COLING OS
  • [7] Affective Computing and Sentiment Analysis
    Cambria, Erik
    [J]. IEEE INTELLIGENT SYSTEMS, 2016, 31 (02) : 102 - 107
  • [8] Cambria E, 2015, AAAI CONF ARTIF INTE, P508
  • [9] Cambria E, 2013, PROCEEDINGS OF THE 2013 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE FOR HUMAN-LIKE INTELLIGENCE (CIHLI), P108, DOI 10.1109/CIHLI.2013.6613272
  • [10] Cambria E, 2011, LECT NOTES COMPUT SC, V6677, P601, DOI 10.1007/978-3-642-21111-9_68
12345