RETRACTED: Eye tracking: empirical foundations for a minimal reporting guideline (Retracted Article)

被引:121
作者
Holmqvist, Kenneth [1 ,2 ,3 ]
Oerbom, Saga Lee [3 ]
Hooge, Ignace T. C. [4 ]
Niehorster, Diederick C. [5 ,6 ]
Alexander, Robert G. [7 ]
Andersson, Richard [8 ]
Benjamins, Jeroen S. [4 ,9 ]
Blignaut, Pieter [2 ]
Brouwer, Anne-Marie [10 ]
Chuang, Lewis L. [11 ,12 ]
Dalrymple, Kirsten A. [13 ]
Drieghe, Denis [14 ]
Dunn, Matt J. [15 ]
Ettinger, Ulrich [16 ]
Fiedler, Susann [17 ]
Foulsham, Tom [18 ]
van der Geest, Jos N. [19 ]
Hansen, Dan Witzner [20 ]
Hutton, Samuel B. [21 ]
Kasneci, Enkelejda [22 ]
Kingstone, Alan [23 ]
Knox, Paul C. [24 ]
Kok, Ellen M. [25 ,26 ]
Lee, Helena [27 ]
Lee, Joy Yeonjoo [28 ]
Leppanen, Jukka M. [29 ]
Macknik, Stephen [7 ]
Majaranta, Paivi [30 ]
Martinez-Conde, Susana [7 ]
Nuthmann, Antje [31 ]
Nystrom, Marcus [5 ]
Orquin, Jacob L. [32 ,33 ]
Otero-Millan, Jorge [34 ]
Park, Soon Young [35 ]
Popelka, Stanislav [36 ]
Proudlock, Frank [37 ]
Renkewitz, Frank [38 ]
Roorda, Austin [34 ]
Schulte-Mecklenbeck, Michael [39 ,40 ]
Sharif, Bonita [41 ]
Shic, Frederick [42 ,43 ]
Shovman, Mark [44 ,45 ]
Thomas, Mervyn G. [37 ]
Venrooij, Ward [46 ]
Zemblys, Raimondas [47 ]
Hessels, Roy S. [4 ]
机构
[1] Nicolaus Copernicus Univ, Dept Psychol, Torun, Poland
[2] Univ Free State, Dept Comp Sci & Informat, Bloemfontein, South Africa
[3] Regensburg Univ, Dept Psychol, Regensburg, Germany
[4] Univ Utrecht, Helmholtz Inst, Expt Psychol, Utrecht, Netherlands
[5] Lund Univ, Lund Univ Humanities Lab, Lund, Sweden
[6] Lund Univ, Dept Psychol, Lund, Sweden
[7] SUNY Downstate Hlth Sci Univ, Dept Ophthalmol, Brooklyn, NY USA
[8] Tobii Pro AB, Danderyd, Sweden
[9] Univ Utrecht, Social Hlth & Org Psychol, Utrecht, Netherlands
[10] TNO, Soesterberg, Netherlands
[11] Leibniz Inst Working Environm & Human Factors, Dept Ergon, Dortmund, Germany
[12] Ludwig Maximilians Univ Munchen, Inst Informat, Munich, Germany
[13] Univ Minnesota, Inst Child Dev, 51 E River Rd, Minneapolis, MN 55455 USA
[14] Univ Southampton, Sch Psychol, Southampton, Hants, England
[15] Cardiff Univ, Sch Optometry & Vis Sci, Cardiff, Wales
[16] Univ Bonn, Dept Psychol, Bonn, Germany
[17] Vienna Univ Econ & Business, Vienna, Austria
[18] Univ Essex, Dept Psychol, Colchester, Essex, England
[19] Erasmus MC, Dept Neurosci, Rotterdam, Netherlands
[20] IT Univ Copenhagen, Dept Comp Sci, Machine Learning Grp, Copenhagen, Denmark
[21] SR Res Ltd, Ottawa, ON, Canada
[22] Univ Tubingen, Human Comp Interact, Tubingen, Germany
[23] Univ British Columbia, Vancouver, BC, Canada
[24] Univ Liverpool, Inst Life Course & Med Sci, Dept Eye & Vis Sci, Liverpool, Merseyside, England
[25] Univ Utrecht, Fac Social & Behav Sci, Dept Educ & Pedag, Div Educ, Utrecht, Netherlands
[26] Open Univ Netherlands, Fac Educ Sci, Dept Online Learning & Instruct, Heerlen, Netherlands
[27] Univ Southampton, Southampton, Hants, England
[28] Maastricht Univ, Fac Hlth Med & Life Sci, Sch Hlth Profess Educ, Maastricht, Netherlands
[29] Univ Turku, Dept Psychol & Speed Language Pathol, Turku, Finland
[30] Tampere Univ, Fac Informat Technol & Commun Sci, TAUCHI Res Ctr, Comp Sci, Tampere, Finland
[31] Univ Kiel, Inst Psychol, Kiel, Germany
[32] Aarhus Univ, Dept Management, Aarhus, Denmark
[33] Reykjavik Univ, Ctr Res Mkt & Consumer Psychol, Reykjavik, Iceland
[34] Univ Calif Berkeley, Herbert Wertheim Sch Optometry & Vis Sci, Berkeley, CA 94720 USA
[35] Med Univ Vienna, Univ Vet Med Vienna, Messerli Res Inst, Comparat Cognit, Vienna, Austria
[36] Palacky Univ Olomouc, Dept Geoinformat, Olomouc, Czech Republic
[37] Univ Leicester, Univ Leicester Ulverscroft Eye Unit, Dept Neurosci Psychol & Behav, Leicester, Leics, England
[38] Univ Erfurt, Dept Psychol, Erfurt, Germany
[39] Univ Bern, Bern, Switzerland
[40] Max Planck Inst Human Dev, Berlin, Germany
[41] Univ Nebraska, Sch Comp, Lincoln, NE USA
[42] Seattle Childrens Res Inst, Ctr Child Hlth Behav & Dev, Seattle, WA USA
[43] Univ Washington, Sch Med, Dept Gen Pediat, Seattle, WA USA
[44] Eyeviat Syst, Herzliyya, Israel
[45] Bezalel Acad Arts & Design, Dept Ind Design, Jerusalem, Israel
[46] Univ Twente, Elect Engn Math & Comp Sci EEMCS, Enschede, Netherlands
[47] Smart Eye AB, Gothenburg, Sweden
关键词
Eye movements; Eye tracking; Data quality; Reporting guidelines; Reporting standards; Reporting practices; Replicability; Reproducibility; SCLERAL SEARCH COIL; POST-SACCADIC OSCILLATIONS; PUPIL SIZE; SMOOTH-PURSUIT; VISUAL-ATTENTION; GAZE BEHAVIOR; TIME-COURSE; BINOCULAR COORDINATION; INDIVIDUAL-DIFFERENCES; FIXATION DURATION;
D O I
10.3758/s13428-021-01762-8
中图分类号
B841 [心理学研究方法];
学科分类号
040201 ;
摘要
In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section "empirically based minimal reporting guideline").
引用
收藏
页码:364 / 416
页数:53
相关论文
共 435 条
  • [1] Estimating the reproducibility of psychological science
    Aarts, Alexander A.
    Anderson, Joanna E.
    Anderson, Christopher J.
    Attridge, Peter R.
    Attwood, Angela
    Axt, Jordan
    Babel, Molly
    Bahnik, Stepan
    Baranski, Erica
    Barnett-Cowan, Michael
    Bartmess, Elizabeth
    Beer, Jennifer
    Bell, Raoul
    Bentley, Heather
    Beyan, Leah
    Binion, Grace
    Borsboom, Denny
    Bosch, Annick
    Bosco, Frank A.
    Bowman, Sara D.
    Brandt, Mark J.
    Braswell, Erin
    Brohmer, Hilmar
    Brown, Benjamin T.
    Brown, Kristina
    Bruening, Jovita
    Calhoun-Sauls, Ann
    Callahan, Shannon P.
    Chagnon, Elizabeth
    Chandler, Jesse
    Chartier, Christopher R.
    Cheung, Felix
    Christopherson, Cody D.
    Cillessen, Linda
    Clay, Russ
    Cleary, Hayley
    Cloud, Mark D.
    Cohn, Michael
    Cohoon, Johanna
    Columbus, Simon
    Cordes, Andreas
    Costantini, Giulio
    Alvarez, Leslie D. Cramblet
    Cremata, Ed
    Crusius, Jan
    DeCoster, Jamie
    DeGaetano, Michelle A.
    Della Penna, Nicolas
    den Bezemer, Bobby
    Deserno, Marie K.
    [J]. SCIENCE, 2015, 349 (6251)
  • [2] Developmental changes in natural viewing behavior: bottom-up and top-down differences between children, young adults and older adults
    Acik, Alper
    Sarwary, Adjmal
    Schultze-Kraft, Rafael
    Onat, Selim
    Koenig, Peter
    [J]. FRONTIERS IN PSYCHOLOGY, 2010, 1
  • [3] Effects of luminance contrast and its modifications on fixation behavior during free viewing of images from different categories
    Acik, Alper
    Onat, Selim
    Schumann, Frank
    Einhaeuser, Wolfgang
    Koenig, Peter
    [J]. VISION RESEARCH, 2009, 49 (12) : 1541 - 1553
  • [4] PUPILLARY RESPONSES DURING INFORMATION-PROCESSING VARY WITH SCHOLASTIC APTITUDE-TEST SCORES
    AHERN, S
    BEATTY, J
    [J]. SCIENCE, 1979, 205 (4412) : 1289 - 1292
  • [5] Fit-for-duty test for estimation of drivers' sleepiness level: Eye movements improve the sleep/wake predictor
    Ahlstrom, Christer
    Nystrom, Marcus
    Holmqvist, Kenneth
    Fors, Carina
    Sandberg, David
    Anund, Anna
    Kecklund, Goran
    Akerstedt, Torbjorn
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2013, 26 : 20 - 32
  • [6] Using eye movement activity as a correlate of cognitive workload
    Ahlstrom, Ulf
    Friedman-Berg, Ferne J.
    [J]. INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS, 2006, 36 (07) : 623 - 636
  • [7] Pupil Center as a Function of Pupil Diameter
    Ahmed, Zaheer
    Mardanbegi, Diako
    Hansen, Dan Witzner
    [J]. 2016 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS (ETRA 2016), 2016, : 283 - 286
  • [8] Akkil D., 2014, Proceedings of the Symposium on Eye Tracking Research and Applications, P327, DOI DOI 10.1145/2578153.2578192
  • [9] What do radiologists look for? Advances and limitations of perceptual learning in radiologic search
    Alexander, Robert G.
    Waite, Stephen
    Macknik, Stephen L.
    Martinez-Conde, Susana
    [J]. JOURNAL OF VISION, 2020, 20 (10): : 1 - 13
  • [10] Microsaccade Characteristics in Neurological and Ophthalmic Disease
    Alexander, Robert G.
    Macknik, Stephen L.
    Martinez-Conde, Susana
    [J]. FRONTIERS IN NEUROLOGY, 2018, 9