Analysis and Visualization of Medical Images using Eye-tracking

被引:0
作者
Islam, Akib Jayed [1 ]
Salehin, Sultanus [2 ]
Alam, S. U. [2 ]
Paul, Shreya [3 ]
Ananna, Kaniz Fatema [4 ]
机构
[1] Norwegian Univ Sci & Technol, Computat Colour & Spectral Imaging, Gjovik, Norway
[2] Univ Alabama, Dept ECE, Tuscaloosa, AL USA
[3] Natl Inst Technol Trichy, Elect & Elect Engn, Trichy, Tamil Nadu, India
[4] Natl Inst Technol Warangal, Mech Engn, Warangal, Telangana, India
来源
2024 IEEE INTERNATIONAL WOMEN IN ENGINEERING (WIE) CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, WIECON-ECE | 2024年
关键词
capsule endoscopy; eye tracking; search patterns; visual diagnosis; fixation; saccade; gaze; EXPERTISE; LOOKING;
D O I
10.1109/WIECON-ECE64149.2024.10914794
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Clinical procedures rely heavily on visual data, particularly in diagnostic radiology. Eye-tracking technology was employed in this study to examine the relationship between visual search features and diagnostic performance in capsule endoscopy. Conventional visual search models, developed for static 2D images, may not be suitable for cross-sectional stack imaging used in computed tomography (CT) and magnetic resonance imaging (MRI) due to their dynamic nature. The study aimed to address this gap by analyzing the visual search patterns of an expert examining capsule endoscopy images. A framework integrating an eye tracker was developed, and a dataset of 536 images was collected. The eye-tracking system showed high accuracy in capturing gaze data. Expert visual search patterns were found to follow predominantly circular trajectories, with distinct optical flow characteristics. Variations in fixation du ration and location were noted, with certain image types exhibiting drilling and scanning patterns. These findings highlight the potential for using eye-tracking data to improve diagnostic accuracy and contribute to radiology education.
引用
收藏
页码:111 / 116
页数:6
相关论文
共 12 条
[1]   FINDING LUNG NODULES WITH AND WITHOUT COMPARATIVE VISUAL SCANNING [J].
CARMODY, DP ;
NODINE, CF ;
KUNDEL, HL .
PERCEPTION & PSYCHOPHYSICS, 1981, 29 (06) :594-598
[2]   Looking for Cancer: Expertise Related Differences in Searching and Decision Making [J].
Donovan, Tim ;
Litchfield, Damien .
APPLIED COGNITIVE PSYCHOLOGY, 2013, 27 (01) :43-49
[3]   Scanners and drillers: Characterizing expert visual search through volumetric images [J].
Drew, Trafton ;
Vo, Melissa Le-Hoa ;
Olwal, Alex ;
Jacobson, Francine ;
Seltzer, Steven E. ;
Wolfe, Jeremy M. .
JOURNAL OF VISION, 2013, 13 (10)
[4]  
Hu C H, 1994, Acad Radiol, V1, P25, DOI 10.1016/S1076-6332(05)80780-9
[5]   Known-Item Search in Video: An Eye Tracking-Based Study [J].
Joos, Lucas ;
Jaeckl, Bastian ;
Keim, Daniel A. ;
Fischer, Maximilian T. ;
Peska, Ladislav ;
Lokoc, Jakub .
PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, :311-319
[6]   Looking in the Same Manner but Seeing it Differently: Bottom-up and Expertise Effects in Radiology [J].
Kok, Ellen M. ;
De Bruin, Anique B. H. ;
Robben, Simon G. F. ;
Van Merrienboer, Jeroen J. G. .
APPLIED COGNITIVE PSYCHOLOGY, 2012, 26 (06) :854-862
[7]   Visual scanning patterns of radiologists searching mammograms [J].
Krupinski, EA .
ACADEMIC RADIOLOGY, 1996, 3 (02) :137-144
[8]  
Online, Gazepoint gp3
[9]   Kvasir-Capsule, a video capsule endoscopy dataset [J].
Smedsrud, Pia H. ;
Thambawita, Vajira ;
Hicks, Steven A. ;
Gjestang, Henrik ;
Nedrejord, Oda Olsen ;
Naess, Espen ;
Borgli, Hanna ;
Jha, Debesh ;
Berstad, Tor Jan Derek ;
Eskeland, Sigrun L. ;
Lux, Mathias ;
Espeland, Havard ;
Petlund, Andreas ;
Nguyen, Duc Tien Dang ;
Garcia-Ceja, Enrique ;
Johansen, Dag ;
Schmidt, Peter T. ;
Toth, Ervin ;
Hammer, Hugo L. ;
de Lange, Thomas ;
Riegler, Michael A. ;
Halvorsen, Pal .
SCIENTIFIC DATA, 2021, 8 (01)
[10]   How visual search relates to visual diagnostic performance: a narrative systematic review of eye-tracking research in radiology [J].
van der Gijp, A. ;
Ravesloot, C. J. ;
Jarodzka, H. ;
van der Schaaf, M. F. ;
van der Schaaf, I. C. ;
van Schaik, J. P. J. ;
ten Cate, Th. J. .
ADVANCES IN HEALTH SCIENCES EDUCATION, 2017, 22 (03) :765-787