Humans have idiosyncratic and task-specific scanpaths for judging faces

被引:71
作者
Kanan, Christopher [1 ]
Bseiso, Dina N. F. [2 ]
Ray, Nicholas A. [2 ]
Hsiao, Janet H. [3 ]
Cottrell, Garrison W. [2 ]
机构
[1] CALTECH, Jet Prop Lab, Pasadena, CA 91125 USA
[2] Univ Calif San Diego, Dept Comp Sci & Engn, La Jolla, CA 92093 USA
[3] Univ Hong Kong, Dept Psychol, Hong Kong, Hong Kong, Peoples R China
关键词
Eye movements; Machine learning; Scanpath routines; Face perception; EYE-MOVEMENTS; RECOGNITION; YARBUS; INFORMATION; REVEAL;
D O I
10.1016/j.visres.2015.01.013
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Since Yarbus's seminal work, vision scientists have argued that our eye movement patterns differ depending upon our task. This has recently motivated the creation of multi-fixation pattern analysis algorithms that try to infer a person's task (or mental state) from their eye movements alone. Here, we introduce new algorithms for multi-fixation pattern analysis, and we use them to argue that people have scanpath routines for judging faces. We tested our methods on the eye movements of subjects as they made six distinct judgments about faces. We found that our algorithms could detect whether a participant is trying to distinguish angriness, happiness, trustworthiness, tiredness, attractiveness, or age. However, our algorithms were more accurate at inferring a subject's task when only trained on data from that subject than when trained on data gathered from other subjects, and we were able to infer the identity of our subjects using the same algorithms. These results suggest that (1) individuals have scanpath routines for judging faces, and that (2) these are diagnostic of that subject, but that (3) at least for the tasks we used, subjects do not converge on the same "ideal" scanpath pattern. Whether universal scanpath patterns exist for a task, we suggest, depends on the task's constraints and the level of expertise of the subject. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:67 / 76
页数:10
相关论文
共 49 条
  • [1] Eye-movement-based memory effect: A reprocessing effect in face perception
    Althoff, RR
    Cohen, NJ
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 1999, 25 (04) : 997 - 1010
  • [2] [Anonymous], 2008, VLFeat: An open and portable library of computer vision algorithms
  • [3] Simple Viewing Tests Can Detect Eye Movement Abnormalities That Distinguish Schizophrenia Cases from Controls with Exceptional Accuracy
    Benson, Philip J.
    Beedie, Sara A.
    Shephard, Elizabeth
    Giegling, Ina
    Rujescu, Dan
    St Clair, David
    [J]. BIOLOGICAL PSYCHIATRY, 2012, 72 (09) : 716 - 724
  • [4] Defending Yarbus: Eye movements reveal observers' task
    Borji, Ali
    Itti, Laurent
    [J]. JOURNAL OF VISION, 2014, 14 (03):
  • [5] Botev Z.I., 2006, NOVEL NONPARAMETRIC
  • [6] The psychophysics toolbox
    Brainard, DH
    [J]. SPATIAL VISION, 1997, 10 (04): : 433 - 436
  • [7] BEAUTY OR THE BEAST - THE EFFECTS OF APPEARANCE, PERSONALITY, AND ISSUE INFORMATION ON EVALUATIONS OF POLITICAL CANDIDATES
    BUDESHEIM, TL
    DEPAOLA, SJ
    [J]. PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN, 1994, 20 (04) : 339 - 348
  • [8] LIBSVM: A Library for Support Vector Machines
    Chang, Chih-Chung
    Lin, Chih-Jen
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
  • [9] The Eyelink Toolbox: Eye tracking with MATLAB and the psychophysics toolbox
    Cornelissen, FW
    Peters, EM
    Palmer, J
    [J]. BEHAVIOR RESEARCH METHODS INSTRUMENTS & COMPUTERS, 2002, 34 (04): : 613 - 617
  • [10] Optimal habits can develop spontaneously through sensitivity to local cost
    Desrochers, Theresa M.
    Jin, Dezhe Z.
    Goodman, Noah D.
    Graybiel, Ann M.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2010, 107 (47) : 20512 - 20517