More Than Meets the Eye: Physicians' Visual Attention in the Operating Room

被引:0
作者
Gershov, Sapir [1 ]
Mahameed, Fadi [1 ,2 ]
Raz, Aeyal [2 ]
Laufer, Shlomi [1 ]
机构
[1] Technion Israel Inst Technol, IL-3200003 Haifa, Israel
[2] Rambam Hlth Care Campus, IL-3109601 Haifa, Israel
来源
APPLICATIONS OF MEDICAL ARTIFICIAL INTELLIGENCE, AMAI 2023 | 2024年 / 14313卷
关键词
Eye-tracking; Surgery; Anesthesia; Visual Attention; Operation Room; Webcams; Deep Learning; TRACKING;
D O I
10.1007/978-3-031-47076-9_2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
During surgery, the patient's vital signs and the field of endoscopic view are displayed on multiple screens. As a result, both surgeons' and anesthesiologists' visual attention (VA) is crucial. Moreover, the distribution of said VA and the acquisition of specific cues might directly impact patient outcomes. Recent research utilizes portable, head-mounted eye-tracking devices to gather precise and comprehensive information. Nevertheless, these technologies are not feasible for enduring data acquisition in an operating room (OR) environment. This is particularly the case during medical emergencies. This study presents an alternative methodology: a webcam-based gaze target prediction model. Such an approach may provide continuous visual behavioral data with minimal interference to the physicians' workflow in the OR. The proposed end-to-end framework is suitable for both standard and emergency surgeries. In the future, such a platform may serve as a crucial component of context-aware assistive technologies in the OR.
引用
收藏
页码:11 / 20
页数:10
相关论文
共 21 条
  • [1] Collaborative eye tracking: a potential training tool in laparoscopic surgery
    Chetwood, Andrew S. A.
    Kwok, Ka-Wai
    Sun, Loi-Wah
    Mylonas, George P.
    Clark, James
    Darzi, Ara
    Yang, Guang-Zhong
    [J]. SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2012, 26 (07): : 2003 - 2009
  • [2] Detecting Attended Visual Targets in Video
    Chong, Eunji
    Wang, Yongxin
    Ruiz, Nataniel
    Rehg, James M.
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5395 - 5405
  • [3] RetinaFace: Single-shot Multi-level Face Localisation in the Wild
    Deng, Jiankang
    Guo, Jia
    Ververas, Evangelos
    Kotsia, Irene
    Zafeiriou, Stefanos
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 5202 - 5211
  • [4] Dual Attention Guided Gaze Target Detection in the Wild
    Fang, Yi
    Tang, Jiapeng
    Shen, Wang
    Shen, Wei
    Gu, Xiao
    Song, Li
    Zhai, Guangtao
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 11385 - 11394
  • [5] Wing Loss for Robust Facial Landmark Localisation with Convolutional Neural Networks
    Feng, Zhen-Hua
    Kittler, Josef
    Awais, Muhammad
    Huber, Patrik
    Wu, Xiao-Jun
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2235 - 2245
  • [6] Eye Tracking Use in Surgical Research: A Systematic Review
    Gil, Amalia M.
    Birdi, Sharon
    Kishibe, Teruko
    Grantcharov, Teodor P.
    [J]. JOURNAL OF SURGICAL RESEARCH, 2022, 279 : 774 - 787
  • [7] King DE, 2009, J MACH LEARN RES, V10, P1755
  • [8] Qi Delong, 2021, arXiv, DOI DOI 10.48550/ARXIV.2105.12931
  • [9] A Context-Aware Capsule Network for Multi-label Classification
    Ramasinghe, Sameera
    Athuraliya, C. D.
    Khan, Salman H.
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT III, 2019, 11131 : 546 - 554
  • [10] You Only Look Once: Unified, Real-Time Object Detection
    Redmon, Joseph
    Divvala, Santosh
    Girshick, Ross
    Farhadi, Ali
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 779 - 788