Learning Skill Characteristics From Manipulations

被引:10
|
作者
Zhou, Xiao-Hu [1 ]
Xie, Xiao-Liang [1 ]
Liu, Shi-Qi [1 ]
Ni, Zhen-Liang [2 ]
Zhou, Yan-Jie [2 ]
Li, Rui-Qi [2 ]
Gui, Mei-Jiang [2 ]
Fan, Chen-Chen [2 ]
Feng, Zhen-Qiu [1 ]
Bian, Gui-Bin [1 ]
Hou, Zeng-Guang [1 ,3 ,4 ,5 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] CAS Ctr Excellence Brain Sci & Intelligence Techn, Beijing 100190, Peoples R China
[4] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[5] Macau Univ Sci & Technol, Inst Syst Engn, MUST CASIA Joint Lab Intelligence Sci & Technol, Taipa, Macau, Peoples R China
基金
中国国家自然科学基金;
关键词
Surgery; Sensors; In vivo; Task analysis; Arteries; Measurement; Sensor phenomena and characterization; Ensemble learning; in vivo porcine studies; percutaneous coronary intervention; skill characteristics; wavelet packet decomposition (WPD); FEATURE-EXTRACTION; NEURAL-NETWORK; MOTION; RECOGNITION; SURGERY; SIMULATOR; FUSION; FORCE; GLOVE;
D O I
10.1109/TNNLS.2022.3160159
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Percutaneous coronary intervention (PCI) has increasingly become the main treatment for coronary artery disease. The procedure requires high experienced skills and dexterous manipulations. However, there are few techniques to model PCI skill so far. In this study, a learning framework with local and ensemble learning is proposed to learn skill characteristics of different skill-level subjects from their PCI manipulations. Ten interventional cardiologists (four experts and six novices) were recruited to deliver a medical guidewire to two target arteries on a porcine model for in vivo studies. Simultaneously, translation and twist manipulations of thumb, forefinger, and wrist are acquired with electromagnetic (EM) and fiber-optic bend (FOB) sensors, respectively. These behavior data are then processed with wavelet packet decomposition (WPD) under 1-10 levels for feature extraction. The feature vectors are further fed into three candidate individual classifiers in the local learning layer. Furthermore, the local learning results from different manipulation behaviors are fused in the ensemble learning layer with three rule-based ensemble learning algorithms. In subject-dependent skill characteristics learning, the ensemble learning can achieve 100% accuracy, significantly outperforming the best local result (90%). Furthermore, ensemble learning can also maintain 73% accuracy in subject-independent schemes. These promising results demonstrate the great potential of the proposed method to facilitate skill learning in surgical robotics and skill assessment in clinical practice.
引用
收藏
页码:9727 / 9741
页数:15
相关论文
共 50 条
  • [41] Muscle synergies are modified with improved task performance in skill learning
    Park, Sangsoo
    Caldwell, Graham E.
    HUMAN MOVEMENT SCIENCE, 2022, 83
  • [42] Robotic Manipulation Skill Acquisition Via Demonstration Policy Learning
    Liu, Dong
    Lu, Binpeng
    Cong, Ming
    Yu, Honghua
    Zou, Qiang
    Du, Yu
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (03) : 1054 - 1065
  • [43] Robot Motor Skill Transfer With Alternate Learning in Two Spaces
    Fu, Jian
    Teng, Xiang
    Cao, Ce
    Ju, Zhaojie
    Lou, Ping
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (10) : 4553 - 4564
  • [44] Machine learning for technical skill assessment in surgery: a systematic review
    Lam, Kyle
    Chen, Junhong
    Wang, Zeyu
    Iqbal, Fahad M.
    Darzi, Ara
    Lo, Benny
    Purkayastha, Sanjay
    Kinross, James M.
    NPJ DIGITAL MEDICINE, 2022, 5 (01)
  • [45] RLingua: Improving Reinforcement Learning Sample Efficiency in Robotic Manipulations With Large Language Models
    Chen, Liangliang
    Lei, Yutian
    Jin, Shiyu
    Zhang, Ying
    Zhang, Liangjun
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (07): : 6075 - 6082
  • [46] Cued memory reactivation during sleep influences skill learning
    Antony, James W.
    Gobel, Eric W.
    O'Hare, Justin K.
    Reber, Paul J.
    Paller, Ken A.
    NATURE NEUROSCIENCE, 2012, 15 (08) : 1114 - +
  • [47] The Role of Simulator Promis2 in Learning Laparoscopic Skill
    Shrestha, S. K.
    Nomura, T.
    Tajiri, T.
    Akagi, I
    Aso, R.
    Miyashita, M.
    Yoshimura, A.
    Shimura, T.
    JOURNAL OF NEPAL MEDICAL ASSOCIATION, 2009, 48 (03) : 221 - 225
  • [48] CIRCUIT CHANGES IN MOTOR CORTEX DURING MOTOR SKILL LEARNING
    Papale, Andrew E.
    Hooks, Bryan M.
    NEUROSCIENCE, 2018, 368 : 283 - 297
  • [49] Learning Freehand Ultrasound Through Multimodal Representation and Skill Adaptation
    Deng, Xutian
    Jiang, Junnan
    Cheng, Wen
    Yang, Chenguang
    Li, Miao
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, : 5117 - 5130
  • [50] Dynamic Skill Learning From Human Demonstration Based on the Human Arm Stiffness Estimation Model and Riemannian DMP
    Liao, Zhiwei
    Jiang, Gedong
    Zhao, Fei
    Wu, Yuqiang
    Yue, Yang
    Mei, Xuesong
    IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2023, 28 (02) : 1149 - 1160