Humans have idiosyncratic and task-specific scanpaths for judging faces

被引:75
作者
Kanan, Christopher [1 ]
Bseiso, Dina N. F. [2 ]
Ray, Nicholas A. [2 ]
Hsiao, Janet H. [3 ]
Cottrell, Garrison W. [2 ]
机构
[1] CALTECH, Jet Prop Lab, Pasadena, CA 91125 USA
[2] Univ Calif San Diego, Dept Comp Sci & Engn, La Jolla, CA 92093 USA
[3] Univ Hong Kong, Dept Psychol, Hong Kong, Hong Kong, Peoples R China
关键词
Eye movements; Machine learning; Scanpath routines; Face perception; EYE-MOVEMENTS; RECOGNITION; YARBUS; INFORMATION; REVEAL;
D O I
10.1016/j.visres.2015.01.013
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Since Yarbus's seminal work, vision scientists have argued that our eye movement patterns differ depending upon our task. This has recently motivated the creation of multi-fixation pattern analysis algorithms that try to infer a person's task (or mental state) from their eye movements alone. Here, we introduce new algorithms for multi-fixation pattern analysis, and we use them to argue that people have scanpath routines for judging faces. We tested our methods on the eye movements of subjects as they made six distinct judgments about faces. We found that our algorithms could detect whether a participant is trying to distinguish angriness, happiness, trustworthiness, tiredness, attractiveness, or age. However, our algorithms were more accurate at inferring a subject's task when only trained on data from that subject than when trained on data gathered from other subjects, and we were able to infer the identity of our subjects using the same algorithms. These results suggest that (1) individuals have scanpath routines for judging faces, and that (2) these are diagnostic of that subject, but that (3) at least for the tasks we used, subjects do not converge on the same "ideal" scanpath pattern. Whether universal scanpath patterns exist for a task, we suggest, depends on the task's constraints and the level of expertise of the subject. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:67 / 76
页数:10
相关论文
共 49 条
[1]   Eye-movement-based memory effect: A reprocessing effect in face perception [J].
Althoff, RR ;
Cohen, NJ .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 1999, 25 (04) :997-1010
[2]  
[Anonymous], 2008, VLFeat: An open and portable library of computer vision algorithms
[3]   Simple Viewing Tests Can Detect Eye Movement Abnormalities That Distinguish Schizophrenia Cases from Controls with Exceptional Accuracy [J].
Benson, Philip J. ;
Beedie, Sara A. ;
Shephard, Elizabeth ;
Giegling, Ina ;
Rujescu, Dan ;
St Clair, David .
BIOLOGICAL PSYCHIATRY, 2012, 72 (09) :716-724
[4]   Defending Yarbus: Eye movements reveal observers' task [J].
Borji, Ali ;
Itti, Laurent .
JOURNAL OF VISION, 2014, 14 (03)
[5]  
Botev Z.I., 2006, NOVEL NONPARAMETRIC
[6]   The psychophysics toolbox [J].
Brainard, DH .
SPATIAL VISION, 1997, 10 (04) :433-436
[7]   BEAUTY OR THE BEAST - THE EFFECTS OF APPEARANCE, PERSONALITY, AND ISSUE INFORMATION ON EVALUATIONS OF POLITICAL CANDIDATES [J].
BUDESHEIM, TL ;
DEPAOLA, SJ .
PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN, 1994, 20 (04) :339-348
[8]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[9]   The Eyelink Toolbox: Eye tracking with MATLAB and the psychophysics toolbox [J].
Cornelissen, FW ;
Peters, EM ;
Palmer, J .
BEHAVIOR RESEARCH METHODS INSTRUMENTS & COMPUTERS, 2002, 34 (04) :613-617
[10]   Optimal habits can develop spontaneously through sensitivity to local cost [J].
Desrochers, Theresa M. ;
Jin, Dezhe Z. ;
Goodman, Noah D. ;
Graybiel, Ann M. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2010, 107 (47) :20512-20517