Learning Skill Characteristics From Manipulations

被引:10
|
作者
Zhou, Xiao-Hu [1 ]
Xie, Xiao-Liang [1 ]
Liu, Shi-Qi [1 ]
Ni, Zhen-Liang [2 ]
Zhou, Yan-Jie [2 ]
Li, Rui-Qi [2 ]
Gui, Mei-Jiang [2 ]
Fan, Chen-Chen [2 ]
Feng, Zhen-Qiu [1 ]
Bian, Gui-Bin [1 ]
Hou, Zeng-Guang [1 ,3 ,4 ,5 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] CAS Ctr Excellence Brain Sci & Intelligence Techn, Beijing 100190, Peoples R China
[4] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[5] Macau Univ Sci & Technol, Inst Syst Engn, MUST CASIA Joint Lab Intelligence Sci & Technol, Taipa, Macau, Peoples R China
基金
中国国家自然科学基金;
关键词
Surgery; Sensors; In vivo; Task analysis; Arteries; Measurement; Sensor phenomena and characterization; Ensemble learning; in vivo porcine studies; percutaneous coronary intervention; skill characteristics; wavelet packet decomposition (WPD); FEATURE-EXTRACTION; NEURAL-NETWORK; MOTION; RECOGNITION; SURGERY; SIMULATOR; FUSION; FORCE; GLOVE;
D O I
10.1109/TNNLS.2022.3160159
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Percutaneous coronary intervention (PCI) has increasingly become the main treatment for coronary artery disease. The procedure requires high experienced skills and dexterous manipulations. However, there are few techniques to model PCI skill so far. In this study, a learning framework with local and ensemble learning is proposed to learn skill characteristics of different skill-level subjects from their PCI manipulations. Ten interventional cardiologists (four experts and six novices) were recruited to deliver a medical guidewire to two target arteries on a porcine model for in vivo studies. Simultaneously, translation and twist manipulations of thumb, forefinger, and wrist are acquired with electromagnetic (EM) and fiber-optic bend (FOB) sensors, respectively. These behavior data are then processed with wavelet packet decomposition (WPD) under 1-10 levels for feature extraction. The feature vectors are further fed into three candidate individual classifiers in the local learning layer. Furthermore, the local learning results from different manipulation behaviors are fused in the ensemble learning layer with three rule-based ensemble learning algorithms. In subject-dependent skill characteristics learning, the ensemble learning can achieve 100% accuracy, significantly outperforming the best local result (90%). Furthermore, ensemble learning can also maintain 73% accuracy in subject-independent schemes. These promising results demonstrate the great potential of the proposed method to facilitate skill learning in surgical robotics and skill assessment in clinical practice.
引用
收藏
页码:9727 / 9741
页数:15
相关论文
共 50 条
  • [1] Surgical Skill Assessment Based on Dynamic Warping Manipulations
    Zhou, Xiao-Hu
    Xie, Xiao-Liang
    Liu, Shi-Qi
    Feng, Zhen-Qiu
    Gui, Mei-Jiang
    Wang, Jin-Li
    Li, Hao
    Xiang, Tian-Yu
    Bian, Gui-Bin
    Hou, Zeng-Guang
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2022, 4 (01): : 50 - 61
  • [2] Efficiently Learning Manipulations by Selecting Structured Skill Representations
    Sharma, Mohit
    Kroemer, Oliver
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 1039 - 1046
  • [3] Learning Age From Gait: A Survey
    Aderinola, Timilehin B.
    Connie, Tee
    Ong, Thian Song
    Yau, Wei-Chuen
    Teoh, Andrew Beng Jin
    IEEE ACCESS, 2021, 9 : 100352 - 100368
  • [4] Helps from flipped classroom in learning suturing skill: The medical students' perspective
    Wu, Jen-Chieh
    Chi, Sheng-Chu
    Wu, Chien-Chih
    Kang, Yi-No
    PLOS ONE, 2018, 13 (10):
  • [5] A review on manipulation skill acquisition through teleoperation-based learning from demonstration
    Si, Weiyong
    Wang, Ning
    Yang, Chenguang
    COGNITIVE COMPUTATION AND SYSTEMS, 2021, 3 (01) : 1 - 16
  • [6] Multitask training promotes automaticity of a fundamental laparoscopic skill without compromising the rate of skill learning
    Poolton, Jamie M.
    Zhu, Frank F.
    Malhotra, Neha
    Leung, Gilberto K. K.
    Fan, Joe K. M.
    Masters, Rich S. W.
    SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2016, 30 (09): : 4011 - 4018
  • [7] Automated Design of Neural Network Architectures With Reinforcement Learning for Detection of Global Manipulations
    Chen, Yifang
    Wang, Zheng
    Wang, Z. Jane
    Kang, Xiangui
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (05) : 997 - 1011
  • [8] A taxonomy of perioperative surgical learning: Trending resident skill acquisition
    Hardaway, John C.
    Basson, Marc D.
    Ali, Muhammad
    Davis, Alan T.
    Haan, Pam S.
    Gupta, Rama N.
    Peshkepija, Andi N.
    Nebeker, Cody A.
    McLeod, Michael K.
    Osmer, Robert L.
    Anderson, Cheryl I.
    AMERICAN JOURNAL OF SURGERY, 2017, 213 (02) : 260 - 267
  • [9] Enhancing skill learning with dual-user haptic feedback: insights from a task-specific approach
    Zhang, Yao
    Wang, Olyvia
    Wang, Yanqing
    Tavakoli, Mahdi
    Zheng, Bin
    FRONTIERS IN ROBOTICS AND AI, 2023, 10
  • [10] Adaptive Graph Learning From Spatial Information for Surgical Workflow Anticipation
    Zhang, Francis Xiatian
    Deng, Jingjing
    Lieck, Robert
    Shum, Hubert P. H.
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2025, 7 (01): : 266 - 280