A gaze-based interactive system to explore artwork imagery

被引:18
作者
Dondi, Piercarlo [1 ]
Porta, Marco [1 ]
Donvito, Angelo [2 ]
Volpe, Giovanni [2 ]
机构
[1] Univ Pavia, Dept Elect Comp & Biomed Engn, Via Ferrata 5, I-27100 Pavia, Italy
[2] COMITES Srl, Via Cifra 29, I-20159 Milan, Italy
关键词
Eye tracking; Gaze interaction; Digital humanities; Paintings; EYE-TRACKING; CULTURAL-HERITAGE; LARGE POPULATIONS; MOVEMENTS; ART;
D O I
10.1007/s12193-021-00373-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Interactive and immersive technologies can significantly enhance the fruition of museums and exhibits. Several studies have proved that multimedia installations can attract visitors, presenting cultural and scientific information in an appealing way. In this article, we present our workflow for achieving a gaze-based interaction with artwork imagery. We designed both a tool for creating interactive "gaze-aware" images and an eye tracking application conceived to interact with those images with the gaze. Users can display different pictures, perform pan and zoom operations, and search for regions of interest with associated multimedia content (text, image, audio, or video). Besides being an assistive technology for motor impaired people (like most gaze-based interaction applications), our solution can also be a valid alternative to the common touch screen panels present in museums, in accordance with the new safety guidelines imposed by the COVID-19 pandemic. Experiments carried out with a panel of volunteer testers have shown that the tool is usable, effective, and easy to learn.
引用
收藏
页码:55 / 67
页数:13
相关论文
共 51 条
[1]  
Al-Thani LK, 2018, 2018 3RD DIGITAL HERITAGE INTERNATIONAL CONGRESS (DIGITALHERITAGE) HELD JOINTLY WITH 2018 24TH INTERNATIONAL CONFERENCE ON VIRTUAL SYSTEMS & MULTIMEDIA (VSMM 2018), P175
[2]  
Antropova M, P 10 ANN C INT COMP, P3
[3]   Computer Graphics and Cultural Heritage From One-Way Inspiration to Symbiosis, Part 1 [J].
Arnold, David .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2014, 34 (03) :75-85
[4]   Computer Graphics and Cultural Heritage, Part 2 Continuing Inspiration for Future Tools [J].
Arnold, David .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2014, 34 (04) :70-79
[5]  
Bangor A, 2009, J USABILITY STUD, V4, P114
[6]  
Barbieri S, P RETH TECHN MUS 201, P1
[7]   A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage [J].
Bekele, Mafkereseb Kassahun ;
Pierdicca, Roberto ;
Frontoni, Emanuele ;
Malinverni, Eva Savina ;
Gain, James .
ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE, 2018, 11 (02)
[8]  
Brooke J, 1996, Usability Evaluation in Industry, P189, DOI DOI 10.1201/9781498710411-35/SUS-QUICK-DIRTY-USABILITY-SCALE-JOHN-BROOKE
[9]   EYE C. U.: an Emotional eYe trackEr for Cultural heritage sUpport [J].
Calandra, Davide Maria ;
Di Mauro, Dario ;
D'Auria, Daniela ;
Cutugno, Francesco .
EMPOWERING ORGANIZATIONS: ENABLING PLATFORMS AND ARTEFACTS, 2016, 11 :161-172
[10]   Eye Tracking for Cultural Heritage: a Gaze-controlled System for Handless Interaction with Artworks [J].
Cantoni, Virginio ;
Merlano, Lorenzo ;
Nugrahaningsih, Nahumi ;
Porta, Marco .
COMPUTER SYSTEMS AND TECHNOLOGIES, COMPSYSTECH'16, 2016, :307-314