Learning Skill Characteristics From Manipulations

被引:10
|
作者
Zhou, Xiao-Hu [1 ]
Xie, Xiao-Liang [1 ]
Liu, Shi-Qi [1 ]
Ni, Zhen-Liang [2 ]
Zhou, Yan-Jie [2 ]
Li, Rui-Qi [2 ]
Gui, Mei-Jiang [2 ]
Fan, Chen-Chen [2 ]
Feng, Zhen-Qiu [1 ]
Bian, Gui-Bin [1 ]
Hou, Zeng-Guang [1 ,3 ,4 ,5 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] CAS Ctr Excellence Brain Sci & Intelligence Techn, Beijing 100190, Peoples R China
[4] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[5] Macau Univ Sci & Technol, Inst Syst Engn, MUST CASIA Joint Lab Intelligence Sci & Technol, Taipa, Macau, Peoples R China
基金
中国国家自然科学基金;
关键词
Surgery; Sensors; In vivo; Task analysis; Arteries; Measurement; Sensor phenomena and characterization; Ensemble learning; in vivo porcine studies; percutaneous coronary intervention; skill characteristics; wavelet packet decomposition (WPD); FEATURE-EXTRACTION; NEURAL-NETWORK; MOTION; RECOGNITION; SURGERY; SIMULATOR; FUSION; FORCE; GLOVE;
D O I
10.1109/TNNLS.2022.3160159
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Percutaneous coronary intervention (PCI) has increasingly become the main treatment for coronary artery disease. The procedure requires high experienced skills and dexterous manipulations. However, there are few techniques to model PCI skill so far. In this study, a learning framework with local and ensemble learning is proposed to learn skill characteristics of different skill-level subjects from their PCI manipulations. Ten interventional cardiologists (four experts and six novices) were recruited to deliver a medical guidewire to two target arteries on a porcine model for in vivo studies. Simultaneously, translation and twist manipulations of thumb, forefinger, and wrist are acquired with electromagnetic (EM) and fiber-optic bend (FOB) sensors, respectively. These behavior data are then processed with wavelet packet decomposition (WPD) under 1-10 levels for feature extraction. The feature vectors are further fed into three candidate individual classifiers in the local learning layer. Furthermore, the local learning results from different manipulation behaviors are fused in the ensemble learning layer with three rule-based ensemble learning algorithms. In subject-dependent skill characteristics learning, the ensemble learning can achieve 100% accuracy, significantly outperforming the best local result (90%). Furthermore, ensemble learning can also maintain 73% accuracy in subject-independent schemes. These promising results demonstrate the great potential of the proposed method to facilitate skill learning in surgical robotics and skill assessment in clinical practice.
引用
收藏
页码:9727 / 9741
页数:15
相关论文
共 50 条
  • [21] Learning Human Activity From Visual Data Using Deep Learning
    Alhersh, Taha
    Stuckenschmidt, Heiner
    Rehman, Atiq Ur
    Belhaouari, Samir Brahim
    IEEE ACCESS, 2021, 9 : 106245 - 106253
  • [22] Characteristics predicting laparoscopic skill in medical students: nine years' experience in a single center
    Nomura, Tsutomu
    Matsutani, Takeshi
    Hagiwara, Nobutoshi
    Fujita, Itsuo
    Nakamura, Yoshiharu
    Kanazawa, Yoshikazu
    Makino, Hiroshi
    Mamada, Yasuhiro
    Fujikura, Terumichi
    Miyashita, Masao
    Uchida, Eiji
    SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2018, 32 (01): : 96 - 104
  • [23] Human-Robot Interactive Skill Learning and Correction for Polishing Based on Dynamic Time Warping Iterative Learning Control
    Zhang, Ruiqing
    Xia, Jingkang
    Ma, Junjie
    Huang, Deqing
    Zhang, Xin
    Li, Yanan
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2024, 32 (06) : 2310 - 2320
  • [24] Designing an Active Motor Skill Learning Platform with a Robot-Assisted Laparoscopic Trainer
    Lee, Chun Siong
    Yang, Liangjing
    Yang, Tao
    Chui, Chee Kong
    Liu, Jiang
    Huang, Weimin
    Su, Yi
    Chang, Stephen K. Y.
    2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2011, : 4534 - 4537
  • [25] The Effect of Observational Practice by a Point-Light Model on Learning a Novel Motor Skill
    Farsi, A.
    Bahmanbegloo, Zeinab H.
    Abdoli, B.
    Ghorbani, S.
    PERCEPTUAL AND MOTOR SKILLS, 2016, 123 (02) : 477 - 488
  • [26] Skill transference and learning curves in novice learners: a randomized comparison of robotic and laparoscopic platforms
    Quinn, Kristen M.
    Chen, Xiaodong
    Griffiths, Claire
    Chen, Grace
    Osayi, Sylvester
    Husain, Syed
    SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2023, 37 (11): : 8483 - 8488
  • [27] An insight of pathological anatomy of urethral stricture and surgical manipulations for children suffered from hypospadias
    Yuanhong Xiao
    BMC Urology, 23
  • [28] Learning Target-Directed Skill and Variable Impedance Control From Interactive Demonstrations for Robot-Assisted Soft Tissue Puncture Tasks
    Zhai, Xueqian
    Jiang, Li
    Wu, Hongmin
    Zheng, Haochen
    Liu, Dong
    Wu, Xinyu
    Xu, Zhihao
    Zhou, Xuefeng
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, : 5238 - 5250
  • [29] An insight of pathological anatomy of urethral stricture and surgical manipulations for children suffered from hypospadias
    Xiao, Yuanhong
    BMC UROLOGY, 2023, 23 (01)
  • [30] Hand Pose-based Task Learning from Visual Observations with Semantic Skill Extraction
    Qiu, Zeju
    Eiband, Thomas
    Li, Shile
    Lee, Dongheui
    2020 29TH IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2020, : 596 - 603