An Examination of Recording Accuracy and Precision From Eye Tracking Data From Toddlerhood to Adulthood

被引:57
作者
Dalrymple, Kirsten A. [1 ]
Manner, Marie D. [2 ]
Harmelink, Katherine A. [3 ]
Teska, Elayne P. [4 ]
Elison, Jed T. [1 ,5 ]
机构
[1] Univ Minnesota, Inst Child Dev, Coll Educ & Human Dev, 51 E River Rd, Minneapolis, MN 55455 USA
[2] Univ Minnesota, Coll Sci & Engn, Dept Comp Sci & Engn, Minneapolis, MN USA
[3] North Dakota State Univ, Sch Educ, Dept Sch Counseling, Fargo, ND 58105 USA
[4] Univ Chicago, Dept Comparat Human Dev, Chicago, IL 60637 USA
[5] Univ Minnesota, Sch Med, Dept Pediat, Minneapolis, MN 55455 USA
关键词
eye tracking; calibration; development; methods; quality assessment; toddlers; DATA QUALITY; ATTENTION; AUTISM; SIGNAL; PUPIL;
D O I
10.3389/fpsyg.2018.00803
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The quantitative assessment of eye tracking data quality is critical for ensuring accuracy and precision of gaze position measurements. However, researchers often report the eye tracker's optimal manufacturer's specifications rather than empirical data about the accuracy and precision of the eye tracking data being presented. Indeed, a recent report indicates that less than half of eye tracking researchers surveyed take the eye tracker's accuracy into account when determining areas of interest for analysis, an oversight that could impact the validity of reported results and conclusions. Accordingly, we designed a calibration verification protocol to augment independent quality assessment of eye tracking data and examined whether accuracy and precision varied between three age groups of participants. We also examined the degree to which our externally quantified quality assurance metrics aligned with those reported by the manufacturer. We collected data in standard laboratory conditions to demonstrate our method, to illustrate how data quality can vary with participant age, and to give a simple example of the degree to which data quality can differ from manufacturer reported values. In the sample data we collected, accuracy for adults was within the range advertised by the manufacturer, but for school-aged children, accuracy and precision measures were outside this range. Data from toddlers were less accurate and less precise than data from adults. Based on an a priori inclusion criterion, we determined that we could exclude approximately 20% of toddler participants for poor calibration quality quantified using our calibration assessment protocol. We recommend implementing and reporting quality assessment protocols for any eye tracking tasks with participants of any age or developmental ability. We conclude with general observations about our data, recommendations for what factors to consider when establishing data inclusion criteria, and suggestions for stimulus design that can help accommodate variability in calibration. The methods outlined here may be particularly useful for developmental psychologists who use eye tracking as a tool, but who are not experts in eye tracking per se. The calibration verification stimuli and data processing scripts that we developed, along with step-by-step instructions, are freely available for other researchers.
引用
收藏
页数:12
相关论文
共 25 条
[1]   What's in a look? [J].
Aslin, Richard N. .
DEVELOPMENTAL SCIENCE, 2007, 10 (01) :48-53
[2]   Eye-tracking data quality as affected by ethnicity and experimental design [J].
Blignaut, Pieter ;
Wium, Daniel .
BEHAVIOR RESEARCH METHODS, 2014, 46 (01) :67-80
[3]   Enhanced Social Attention in Female Infant Siblings at Risk for Autism [J].
Chawarska, Katarzyna ;
Macari, Suzanne ;
Powell, Kelly ;
DiNicola, Lauren ;
Shic, Frederick .
JOURNAL OF THE AMERICAN ACADEMY OF CHILD AND ADOLESCENT PSYCHIATRY, 2016, 55 (03) :188-195
[4]   Measuring the Development of Social Attention Using Free-Viewing [J].
Frank, Michael C. ;
Vul, Edward ;
Saxe, Rebecca .
INFANCY, 2012, 17 (04) :355-375
[5]   Development of infants' attention to faces during the first year [J].
Frank, Michael C. ;
Vul, Edward ;
Johnson, Scott P. .
COGNITION, 2009, 110 (02) :160-170
[6]   Noise-robust fixation detection in eye movement data: Identification by two-means clustering (I2MC) [J].
Hessels, Roy S. ;
Niehorster, Diederick C. ;
Kemner, Chantal ;
Hooge, Ignace T. C. .
BEHAVIOR RESEARCH METHODS, 2017, 49 (05) :1802-1823
[7]   The area-of-interest problem in eyetracking research: A noise-robust solution for face and sparse stimuli [J].
Hessels, Roy S. ;
Kemner, Chantal ;
van den Boomen, Carlijn ;
Hooge, Ignace T. C. .
Behavior Research Methods, 2016, 48 (04) :1694-1712
[8]   Consequences of Eye Color, Positioning, and Head Movement for Eye-Tracking Data Quality in Infant Research [J].
Hessels, Roy S. ;
Andersson, Richard ;
Hooge, Ignace T. C. ;
Nystrom, Marcus ;
Kemner, Chantal .
INFANCY, 2015, 20 (06) :601-633
[9]  
Holmqvist K., 2012, EYE TRACK RES APPL S, P45, DOI [10.1145/2168556.2168563, DOI 10.1145/2168556.2168563]
[10]  
Holmqvist K, 2011, EYE TRACKING COMPREH