Comparing Automatic Simulator Assessment with Expert Assessment of Virtual Surgical Procedures

被引:0
作者
Tuchschmid, Stefan [1 ]
Bajka, Michael [2 ]
Harders, Matthias [1 ]
机构
[1] Swiss Fed Inst Technol, Comp Vis Lab, Zurich, Switzerland
[2] Univ Zurich Hosp, Clin Gynecol, Zurich, Switzerland
来源
BIOMEDICAL SIMULATION, PROCEEDINGS | 2010年 / 5958卷
基金
瑞士国家科学基金会;
关键词
MINIMALLY INVASIVE SURGERY; TECHNICAL SKILLS; REALITY SIMULATION; HYSTEROSCOPY; RELIABILITY;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This study focuses on the comparison of expert assessment of virtual surgical procedures through Objective Structured Assessment of Technical Skills (OSATS) with the automatic assessment and feedback provided by a surgical simulator for hysteroscopic procedures. The existing multi-metric scoring system of the simulator was extended to include hysteroscopic myomectomy. The original OSATS was also modified for the examined surgical procedure. OSATS reliability, expert coherence, and interrater agreement with simulator feedback were investigated in a study with eight experts. The same selection of six movies showing virtual procedures performed at a hysteroscopy training course was rated by each expert. For the task-specific checklist, the reliability of the simulator was significantly higher than that of the individual human raters (p=0.006). In addition, the ranked order of the overall scores of all movies was the same for both simulator and expert consensus opinion. This is a first step to providing simulator feedback with the same reliability as an expert panel, thus facilitating competency-based surgical education and assessment in the near future.
引用
收藏
页码:181 / +
页数:4
相关论文
共 21 条
  • [1] BAJKA M, 2009, SURG ENDOSC
  • [2] Evaluation of a new virtual-reality training simulator for hysteroscopy
    Bajka, Michael
    Tuchschmid, Stefan
    Streich, Matthias
    Fink, Daniel
    Szekely, Gabor
    Harders, Matthias
    [J]. SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2009, 23 (09): : 2026 - 2033
  • [3] Global Rating Assessment of Skills in Intraocular Surgery (GRASIS)
    Cremers, SL
    Lora, AN
    Ferrufino-Ponce, ZK
    [J]. OPHTHALMOLOGY, 2005, 112 (10) : 1655 - 1660
  • [4] Assessing operative skill - Needs to become more objective
    Darzi, A
    Smith, S
    Taffinder, N
    [J]. BRITISH MEDICAL JOURNAL, 1999, 318 (7188) : 887 - 888
  • [5] Toward reliable operative assessment - The reliability and feasibility of videotaped assessment of laparoscopic technical skills
    Dath, D
    Regehr, G
    Birch, D
    Schlachta, C
    Poulin, E
    Mamazza, J
    Reznick, R
    MacRae, HM
    [J]. SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2004, 18 (12): : 1800 - 1804
  • [6] Virtual reality simulation for the operating room - Proficiency-based training as a paradigm shift in surgical skills training
    Gallagher, AG
    Ritter, EM
    Champion, H
    Higgins, G
    Fried, MP
    Moses, G
    Smith, CD
    Satava, RM
    [J]. ANNALS OF SURGERY, 2005, 241 (02) : 364 - 372
  • [7] Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training
    Gallagher, AG
    Ritter, EM
    Satava, RM
    [J]. SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2003, 17 (10): : 1525 - 1529
  • [8] Randomized clinical trial of virtual reality simulation for laparoscopic skills training
    Grantcharov, TP
    Kristiansen, VB
    Bendix, J
    Bardram, L
    Rosenberg, J
    Funch-Jensen, P
    [J]. BRITISH JOURNAL OF SURGERY, 2004, 91 (02) : 146 - 150
  • [9] Virtual reality based simulation of hysteroscopic interventions
    Harders, M.
    Bachofen, D.
    Grassi, M.
    Bajka, M.
    Spaelter, U.
    Teschner, M.
    Heidelberger, B.
    Sierra, R.
    Steinemann, D.
    Tuchschmid, S.
    Zatonyi, J.
    Szekely, G.
    [J]. PRESENCE-TELEOPERATORS AND VIRTUAL ENVIRONMENTS, 2008, 17 (05) : 441 - 462
  • [10] Teaching and evaluating surgical skills
    Mandel, LP
    Lentz, GM
    Goff, BA
    [J]. OBSTETRICS AND GYNECOLOGY, 2000, 95 (05) : 783 - 785