Identity Unbiased Deception Detection by 2D-to-3D Face Reconstruction

被引:9
作者
Ngo, Le Minh [1 ,4 ]
Wang, Wei [1 ]
Mandira, Burak [2 ]
Karaoglu, Sezer [1 ,4 ]
Bouma, Henri [3 ]
Dibeklioglu, Hamdi [2 ]
Gevers, Theo [1 ,4 ]
机构
[1] Univ Amsterdam, Amsterdam, Netherlands
[2] Bilkent Univ, Ankara, Turkey
[3] TNO, The Hague, Netherlands
[4] 3DUniversum, Amsterdam, Netherlands
来源
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021) | 2021年
关键词
CUES;
D O I
10.1109/WACV48630.2021.00019
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deception is a common phenomenon in society, both in our private and professional lives. However, humans are notoriously bad at accurate deception detection. Based on the literature, human accuracy of distinguishing between lies and truthful statements is 54% on average, in other words, it is slightly better than a random guess. While people do not much care about this issue, in high-stakes situations such as interrogations for series crimes and for evaluating the testimonies in court cases, accurate deception detection methods are highly desirable. To achieve a reliable, covert, and non-invasive deception detection, we propose a novel method that disentangles facial expression and head pose related features using 2D-to-3D face reconstruction technique from a video sequence and uses them to learn characteristics of deceptive behavior. We evaluate the proposed method on the Real-Life Trial (RLT) dataset that contains high-stakes deceits recorded in courtrooms. Our results show that the proposed method (with an accuracy of 68%) improves the state of the art. Besides, a new dataset has been collected, for the first time, for low-stake deceit detection. In addition, we compare high-stake deceit detection methods on the newly collected low-stake deceits.
引用
收藏
页码:145 / 154
页数:10
相关论文
共 41 条
[1]  
Abouelenien M., 2014, Proceedings of the 16th International Conference on Multimodal Interaction, P58
[2]  
[Anonymous], 2015, ACS SYM SER
[3]  
Baltrusaitis T., 2016, WACV, P1, DOI [DOI 10.1109/WACV.2016.7477553, 10.1109/WACV.2016.7477553]
[4]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[5]   Accuracy of deception judgments [J].
Bond, Charles F., Jr. ;
DePaulo, Bella M. .
PERSONALITY AND SOCIAL PSYCHOLOGY REVIEW, 2006, 10 (03) :214-234
[6]   Measuring cues for stand-off deception detection based on full-body non-verbal features in body-worn cameras [J].
Bouma, Henri ;
Burghouts, Gertjan ;
den Hollander, Richard ;
Van Der Zee, Sophie ;
Baan, Jan ;
ten Hove, Johan-Martijn ;
van Diepen, Sjaak ;
van den Haak, Paul ;
van Rest, Jeroen .
OPTICS AND PHOTONICS FOR COUNTERTERRORISM, CRIME FIGHTING, AND DEFENCE XII, 2016, 9995
[7]   How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks) [J].
Bulat, Adrian ;
Tzimiropoulos, Georgios .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1021-1030
[8]  
BURGOON J. K., 2017, Social Signal Processing
[9]   A Comprehensive Performance Evaluation of Deformable Face Tracking "In-the-Wild" [J].
Chrysos, Grigorios G. ;
Antonakos, Epameinondas ;
Snape, Patrick ;
Asthana, Akshay ;
Zafeiriou, Stefanos .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (2-4) :198-232
[10]  
Deng Y, 2019, IEEE C ELEC DEVICES