Which Experimental Design is Better Suited for VQA Tasks? Eye Tracking Study on Cognitive Load, Performance, and Gaze Allocations

被引：3

作者：

Vriend, Sita A. ^{[1
]}

Vidyapu, Sandeep ^{[1
]}

Rama, Amer ^{[1
]}

Chen, Kun-Ting ^{[1
,2
]}

Weiskopf, Daniel ^{[1
]}

机构：

[1] Univ Stuttgart, Stuttgart, Germany

[2] Univ Adelaide, Adelaide, SA, Australia

来源：

PROCEEDINGS OF THE 2024 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, ETRA 2024 | 2024年

关键词：

Eye tracking; cognitive load; visual exploration; VQA; task performance; experimental design; INFORMATION;

D O I：

10.1145/3649902.3653519

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We conducted an eye-tracking user study with 13 participants to investigate the influence of stimulus-question ordering and question modality on participants using visual question-answering (VQA) tasks. We examined cognitive load, task performance, and gaze allocations across five distinct experimental designs, aiming to identify setups that minimize the cognitive burden on participants. The collected performance and gaze data were analyzed using quantitative and qualitative methods. Our results indicate a significant impact of stimulus-question ordering on cognitive load and task performance, as well as a noteworthy effect of question modality on task performance. These findings offer insights for the experimental design of controlled user studies in visualization research.

引用

页数：7

共 27 条

[1] Investigating Cognitive Load in Energy Network Control Rooms: Recommendations for Future Designs [J].

Afzal, Umair ;

Prouzeau, Arnaud ;

Lawrence, Lee ;

Dwyer, Tim ;

Bichinepally, Saikiranrao ;

Liebman, Ariel ;

Goodwin, Sarah .

FRONTIERS IN PSYCHOLOGY, 2022, 13

[2] VQA: Visual Question Answering [J].

Antol, Stanislaw ;

Agrawal, Aishwarya ;

Lu, Jiasen ;

Mitchell, Margaret ;

Batra, Dhruv ;

Zitnick, C. Lawrence ;

Parikh, Devi .

2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2425-2433

[3] Counterbalancing for Serial Order Carryover Effects in Experimental Condition Orders [J].

Brooks, Joseph L. .

PSYCHOLOGICAL METHODS, 2012, 17 (04) :600-614

[4] Initial scene representations facilitate eye movement guidance in visual search [J].

Castelhano, Monica S. ;

Henderson, John M. .

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2007, 33 (04) :753-763

[5] Gazealytics: A Unified and Flexible Visual Toolkit for Exploratory and Comparative Gaze Analysis [J].

Chen, Kun-Ting ;

Prouzeau, Arnaud ;

Langmead, Joshua ;

Whitelock-Jones, Ryan T. ;

Lawrence, Lee ;

Dwyer, Tim ;

Hurter, Christophe ;

Weiskopf, Daniel ;

Goodwin, Sarah .

ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, ETRA 2023, 2023,

[6] Reading Strategies for Graph Visualizations thatWrap Around in Torus Topology [J].

Chen, Kun-Ting ;

Ngo, Quynh Quang ;

Kurzhals, Kuno ;

Marriott, Kim ;

Dwyer, Tim ;

Sedlmair, Michael ;

Weiskopf, Daniel .

ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, ETRA 2023, 2023,

[7]

Chen Shanshan., 2011, Proceedings of the 2nd Conference on Wireless Health, P1

[8] AiR: Attention with Reasoning Capability [J].

Chen, Shi ;

Jiang, Ming ;

Yang, Jinhui ;

Zhao, Qi .

COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :91-107

[9] Predicting Human Scanpaths in Visual Question Answering [J].

Chen, Xianyu ;

Jiang, Ming ;

Zhao, Qi .

2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :10871-10880

[10] Structure of presented stimuli influences gazing behavior and choice [J].

Gere, Attila ;

Danner, Lukas ;

Durrschmid, Klaus ;

Kokai, Zoltan ;

Sipos, Laszlo ;

Huzsvai, Laszlo ;

Kovacs, Sandor .

FOOD QUALITY AND PREFERENCE, 2020, 83

← 1 2 3 →