Identity Unbiased Deception Detection by 2D-to-3D Face Reconstruction

被引:9
作者
Ngo, Le Minh [1 ,4 ]
Wang, Wei [1 ]
Mandira, Burak [2 ]
Karaoglu, Sezer [1 ,4 ]
Bouma, Henri [3 ]
Dibeklioglu, Hamdi [2 ]
Gevers, Theo [1 ,4 ]
机构
[1] Univ Amsterdam, Amsterdam, Netherlands
[2] Bilkent Univ, Ankara, Turkey
[3] TNO, The Hague, Netherlands
[4] 3DUniversum, Amsterdam, Netherlands
来源
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021) | 2021年
关键词
CUES;
D O I
10.1109/WACV48630.2021.00019
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deception is a common phenomenon in society, both in our private and professional lives. However, humans are notoriously bad at accurate deception detection. Based on the literature, human accuracy of distinguishing between lies and truthful statements is 54% on average, in other words, it is slightly better than a random guess. While people do not much care about this issue, in high-stakes situations such as interrogations for series crimes and for evaluating the testimonies in court cases, accurate deception detection methods are highly desirable. To achieve a reliable, covert, and non-invasive deception detection, we propose a novel method that disentangles facial expression and head pose related features using 2D-to-3D face reconstruction technique from a video sequence and uses them to learn characteristics of deceptive behavior. We evaluate the proposed method on the Real-Life Trial (RLT) dataset that contains high-stakes deceits recorded in courtrooms. Our results show that the proposed method (with an accuracy of 68%) improves the state of the art. Besides, a new dataset has been collected, for the first time, for low-stake deceit detection. In addition, we compare high-stake deceit detection methods on the newly collected low-stake deceits.
引用
收藏
页码:145 / 154
页数:10
相关论文
共 41 条
[21]  
Kay W., 2017, arXiv preprint arXiv:1705.06950
[22]   InverseFaceNet: Deep Monocular Inverse Face Rendering [J].
Kim, Hyeongwoo ;
Zollhoefer, Michael ;
Tewari, Ayush ;
Thies, Justus ;
Richardt, Christian ;
Theobalt, Christian .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4625-4634
[23]  
King DE, 2009, J MACH LEARN RES, V10, P1755
[24]   "Look Ma, No Landmarks!" - Unsupervised, Model-Based Dense Face Alignment [J].
Koizumi, Tatsuro ;
Smith, William A. P. .
COMPUTER VISION - ECCV 2020, PT II, 2020, 12347 :690-706
[25]   Beliefs about the cues to deception in high- and low-stake situations [J].
Lakhani, M ;
Taylor, R .
PSYCHOLOGY CRIME & LAW, 2003, 9 (04) :357-368
[26]   Deep Learning Face Attributes in the Wild [J].
Liu, Ziwei ;
Luo, Ping ;
Wang, Xiaogang ;
Tang, Xiaoou .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :3730-3738
[27]   OpenMM: An Open-source Multimodal Feature Extraction Tool [J].
Morales, Michelle Renee ;
Scherer, Stefan ;
Levitan, Rivka .
18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, :3354-3358
[28]   Police Lie Detection Accuracy: The Effect of Lie Scenario [J].
O'Sullivan, Maureen ;
Frank, Mark G. ;
Hurley, Carolyn M. ;
Tiwana, Jaspreet .
LAW AND HUMAN BEHAVIOR, 2009, 33 (06) :530-538
[29]   A Video-Based Screening System for Automated Risk Assessment Using Nuanced Facial Features [J].
Pentland, Steven J. ;
Twyman, Nathan W. ;
Burgoon, Judee K. ;
Nunamaker, Jay F., Jr. ;
Diller, Christopher B. R. .
JOURNAL OF MANAGEMENT INFORMATION SYSTEMS, 2017, 34 (04) :970-993
[30]   Deception Detection using Real-life Trial Data [J].
Perez-Rosas, Veronica ;
Abouelenien, Mohamed ;
Mihalcea, Rada ;
Burzo, Mihai .
ICMI'15: PROCEEDINGS OF THE 2015 ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2015, :59-66