Humans have idiosyncratic and task-specific scanpaths for judging faces

被引:71
作者
Kanan, Christopher [1 ]
Bseiso, Dina N. F. [2 ]
Ray, Nicholas A. [2 ]
Hsiao, Janet H. [3 ]
Cottrell, Garrison W. [2 ]
机构
[1] CALTECH, Jet Prop Lab, Pasadena, CA 91125 USA
[2] Univ Calif San Diego, Dept Comp Sci & Engn, La Jolla, CA 92093 USA
[3] Univ Hong Kong, Dept Psychol, Hong Kong, Hong Kong, Peoples R China
关键词
Eye movements; Machine learning; Scanpath routines; Face perception; EYE-MOVEMENTS; RECOGNITION; YARBUS; INFORMATION; REVEAL;
D O I
10.1016/j.visres.2015.01.013
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Since Yarbus's seminal work, vision scientists have argued that our eye movement patterns differ depending upon our task. This has recently motivated the creation of multi-fixation pattern analysis algorithms that try to infer a person's task (or mental state) from their eye movements alone. Here, we introduce new algorithms for multi-fixation pattern analysis, and we use them to argue that people have scanpath routines for judging faces. We tested our methods on the eye movements of subjects as they made six distinct judgments about faces. We found that our algorithms could detect whether a participant is trying to distinguish angriness, happiness, trustworthiness, tiredness, attractiveness, or age. However, our algorithms were more accurate at inferring a subject's task when only trained on data from that subject than when trained on data gathered from other subjects, and we were able to infer the identity of our subjects using the same algorithms. These results suggest that (1) individuals have scanpath routines for judging faces, and that (2) these are diagnostic of that subject, but that (3) at least for the tasks we used, subjects do not converge on the same "ideal" scanpath pattern. Whether universal scanpath patterns exist for a task, we suggest, depends on the task's constraints and the level of expertise of the subject. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:67 / 76
页数:10
相关论文
共 49 条
[31]   SCANPATHS IN SACCADIC EYE MOVEMENTS WHILE VIEWING AND RECOGNIZING PATTERNS [J].
NOTON, D ;
STARK, L .
VISION RESEARCH, 1971, 11 (09) :929-&
[32]   THE ASSESSMENT AND ANALYSIS OF HANDEDNESS: THE EDINBURGH INVENTORY [J].
OLDFIELD, RC .
NEUROPSYCHOLOGIA, 1971, 9 (01) :97-113
[33]   Improving the Fisher Kernel for Large-Scale Image Classification [J].
Perronnin, Florent ;
Sanchez, Jorge ;
Mensink, Thomas .
COMPUTER VISION-ECCV 2010, PT IV, 2010, 6314 :143-156
[34]   Individual Differences in Eye Movements During Face Identification Reflect Observer-Specific Optimal Points of Fixation [J].
Peterson, Matthew F. ;
Eckstein, Miguel P. .
PSYCHOLOGICAL SCIENCE, 2013, 24 (07) :1216-1225
[35]   Looking just below the eyes is optimal across face recognition tasks [J].
Peterson, Matthew F. ;
Eckstein, Miguel P. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2012, 109 (48) :E3314-E3323
[36]   Eyetracking and selective attention in category learning [J].
Rehder, B ;
Hoffman, AB .
COGNITIVE PSYCHOLOGY, 2005, 51 (01) :1-41
[37]   Show me the features! Understanding recognition from the use of visual information [J].
Schyns, PG ;
Bonnar, L ;
Gosselin, F .
PSYCHOLOGICAL SCIENCE, 2002, 13 (05) :402-409
[38]   LEARNING AND MEMORIZATION OF CLASSIFICATIONS [J].
SHEPARD, RN ;
HOVLAND, CI ;
JENKINS, HM .
PSYCHOLOGICAL MONOGRAPHS, 1961, 75 (13) :1-42
[39]  
Simoyan K., 2013, BRIT MACH VIS C BMVC
[40]  
SPITZ HH, 1971, SCIENCE, V173, P753, DOI 10.1126/science.173.3998.753