Virtual Reality-Enabled Intuitive Magnetic Manipulation of Microrobots and Nanoparticles

被引:2
作者
Chowdhury, A. M. Masum Bulbul [1 ]
Abbasi, Sarmad Ahmad [1 ]
Gharamaleki, Nader Latifi [1 ]
Kim, Jin-young [2 ]
Choi, Hongsoo [1 ,3 ]
机构
[1] Daegu Gyeong buk Inst Sci & Technol DGIST, Dept Robot & Mechatron Engn, DGIST ETH Microrobot Res Ctr, Daegu 42988, South Korea
[2] DGIST, Div Biotechnol, Daegu 42988, South Korea
[3] DGIST ETH Microrobot Res Ctr, Dept Robot & Mechatron Engn, Daegu 42988, South Korea
基金
新加坡国家研究基金会;
关键词
electromagnetic actuation systems; microrobots; nanoparticles; virtual realities; NAVIGATION; DELIVERY; ARTERIES; SWARMS;
D O I
10.1002/aisy.202300793
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Magnetic microrobots and nanoparticles offer unique capabilities for medical applications by granting unprecedented access to intricate and delicate anatomical structures. Nevertheless, an intuitive manipulation approach remains a challenge due to their small size and limited feedback. This study presents a new method for magnetic microrobot and nanoparticle control that employs virtual reality (VR), creating an immersive and realistic view of the bodily anatomy and the microrobot within. This study compares three manipulation modes: a traditional mode using 2D displays, VR mode using a VR headset and touch controllers, and VR autonomous programmed maneuvering. It is shown that VR-assisted modes reduce the manipulation time by improving spatial awareness. Nanoparticles in a VR environment are also manipulated. The proposed method will find applications in terms of intuitive, immersive microrobots or magnetic nanoparticle control in complex biological environments, thus in many medical procedures and for drug and cell delivery. The immersive nature of this approach enhances the ability of the user to perceive and understand complex anatomical structures, facilitating better navigation within delicate environments; both dexterity and spatial awareness are improved. Thus, it is shown how microrobots and magnetic nanoparticles can be controlled using immersive simulations to improve both visualization and manipulation. A novel virtual reality-assisted approach enables intuitive control of magnetic microrobots and nanoparticles within simulated vascular anatomies. Quantitative experiments demonstrate enhanced user manipulation dexterity, precision, spatial awareness, and efficiency versus traditional 2D visualization methods lacking immersive realism and situational presence. This platform promises more natural control in complex environments.image (c) 2024 WILEY-VCH GmbH
引用
收藏
页数:13
相关论文
共 67 条
  • [1] Virtual reality simulation training can improve inexperienced surgeons' endovascular skills
    Aggarwal, R
    Black, SA
    Hance, JR
    Darzi, A
    Cheshire, NJW
    [J]. EUROPEAN JOURNAL OF VASCULAR AND ENDOVASCULAR SURGERY, 2006, 31 (06) : 588 - 593
  • [2] Bioinspired acousto-magnetic microswarm robots with upstream motility
    Ahmed, Daniel
    Sukhov, Alexander
    Hauri, David
    Rodrigue, Dubon
    Maranta, Gian
    Harting, Jens
    Nelson, Bradley J.
    [J]. NATURE MACHINE INTELLIGENCE, 2021, 3 (02) : 116 - 124
  • [3] Navigation of a magnetic micro-robot through a cerebral aneurysm phantom with magnetic particle imaging
    Bakenecker, Anna C.
    von Gladiss, Anselm
    Schwenke, Hannes
    Behrends, Andre
    Friedrich, Thomas
    Luedtke-Buzug, Kerstin
    Neumann, Alexander
    Barkhausen, Joerg
    Wegner, Franz
    Buzug, Thorsten M.
    [J]. SCIENTIFIC REPORTS, 2021, 11 (01)
  • [4] The Rotation of Microrobot Simplifies 3D Control Inside Microchannels
    Barbot, Antoine
    Decanini, Dominique
    Hwang, Gilgueng
    [J]. SCIENTIFIC REPORTS, 2018, 8
  • [5] Epidemiology and management of aortic disease: aortic aneurysms and acute aortic syndromes
    Bossone, Eduardo
    Eagle, Kim A.
    [J]. NATURE REVIEWS CARDIOLOGY, 2021, 18 (05) : 331 - 348
  • [6] Bozuyuk U., 2023, Adv Intell Syst, V5, P2300099
  • [7] Bueno-Vesga J. A., 2021, 2021 IEEE VIRT REAL, P645
  • [8] Recent Progress of Micro/Nanorobots for Cell Delivery and Manipulation
    Chen, Wenjun
    Zhou, Hao
    Zhang, Bin
    Cao, Qinghua
    Wang, Bo
    Ma, Xing
    [J]. ADVANCED FUNCTIONAL MATERIALS, 2022, 32 (18)
  • [9] Combination of Augmented Reality Based Brain- Computer Interface and Computer Vision for High-Level Control of a Robotic Arm
    Chen, Xiaogang
    Huang, Xiaoshan
    Wang, Yijun
    Gao, Xiaorong
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (12) : 3140 - 3147
  • [10] Recent Progress in Magnetically Actuated Microrobots for Targeted Delivery of Therapeutic Agents
    Choi, Junhee
    Hwang, Junsun
    Kim, Jin-young
    Choi, Hongsoo
    [J]. ADVANCED HEALTHCARE MATERIALS, 2021, 10 (06)