Virtual Reality-Enabled Intuitive Magnetic Manipulation of Microrobots and Nanoparticles

被引:4
作者
Chowdhury, A. M. Masum Bulbul [1 ]
Abbasi, Sarmad Ahmad [1 ]
Gharamaleki, Nader Latifi [1 ]
Kim, Jin-young [2 ]
Choi, Hongsoo [1 ,3 ]
机构
[1] Daegu Gyeong buk Inst Sci & Technol DGIST, Dept Robot & Mechatron Engn, DGIST ETH Microrobot Res Ctr, Daegu 42988, South Korea
[2] DGIST, Div Biotechnol, Daegu 42988, South Korea
[3] DGIST ETH Microrobot Res Ctr, Dept Robot & Mechatron Engn, Daegu 42988, South Korea
基金
新加坡国家研究基金会;
关键词
electromagnetic actuation systems; microrobots; nanoparticles; virtual realities; NAVIGATION; DELIVERY; ARTERIES; SWARMS;
D O I
10.1002/aisy.202300793
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Magnetic microrobots and nanoparticles offer unique capabilities for medical applications by granting unprecedented access to intricate and delicate anatomical structures. Nevertheless, an intuitive manipulation approach remains a challenge due to their small size and limited feedback. This study presents a new method for magnetic microrobot and nanoparticle control that employs virtual reality (VR), creating an immersive and realistic view of the bodily anatomy and the microrobot within. This study compares three manipulation modes: a traditional mode using 2D displays, VR mode using a VR headset and touch controllers, and VR autonomous programmed maneuvering. It is shown that VR-assisted modes reduce the manipulation time by improving spatial awareness. Nanoparticles in a VR environment are also manipulated. The proposed method will find applications in terms of intuitive, immersive microrobots or magnetic nanoparticle control in complex biological environments, thus in many medical procedures and for drug and cell delivery. The immersive nature of this approach enhances the ability of the user to perceive and understand complex anatomical structures, facilitating better navigation within delicate environments; both dexterity and spatial awareness are improved. Thus, it is shown how microrobots and magnetic nanoparticles can be controlled using immersive simulations to improve both visualization and manipulation. A novel virtual reality-assisted approach enables intuitive control of magnetic microrobots and nanoparticles within simulated vascular anatomies. Quantitative experiments demonstrate enhanced user manipulation dexterity, precision, spatial awareness, and efficiency versus traditional 2D visualization methods lacking immersive realism and situational presence. This platform promises more natural control in complex environments.image (c) 2024 WILEY-VCH GmbH
引用
收藏
页数:13
相关论文
共 67 条
[51]   Development of metaverse for intelligent healthcare [J].
Wang, Ge ;
Badal, Andreu ;
Jia, Xun ;
Maltz, Jonathan S. ;
Mueller, Klaus ;
Myers, Kyle J. ;
Niu, Chuang ;
Vannier, Michael ;
Yan, Pingkun ;
Yu, Zhou ;
Zeng, Rongping .
NATURE MACHINE INTELLIGENCE, 2022, 4 (11) :922-929
[52]   Guiding Drug Through Interrupted Bloodstream for Potentiated Thrombolysis by C-Shaped Magnetic Actuation System In Vivo [J].
Wang, Longchen ;
Wang, Jienan ;
Hao, Junnian ;
Dong, Ziliang ;
Wu, Jianrong ;
Shen, Guofeng ;
Ying, Tao ;
Feng, Liangzhu ;
Cai, Xiaojun ;
Liu, Zhuang ;
Zheng, Yuanyi .
ADVANCED MATERIALS, 2021, 33 (51)
[53]   Ultrasound Doppler-guided real-time navigation of a magnetic microswarm for active endovascular delivery [J].
Wang, Qianqian ;
Chan, Kai Fung ;
Schweizer, Kathrin ;
Du, Xingzhou ;
Jin, Dongdong ;
Yu, Simon Chun Ho ;
Nelson, Bradley J. ;
Zhang, Li .
SCIENCE ADVANCES, 2021, 7 (09)
[54]   Real-Time Magnetic Navigation of a Rotating Colloidal Microswarm Under Ultrasound Guidance [J].
Wang, Qianqian ;
Yang, Lidong ;
Yu, Jiangfan ;
Chiu, Philip Wai Yan ;
Zheng, Yong-Ping ;
Zhang, Li .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2020, 67 (12) :3403-3412
[55]   Facile Fabrication of Magnetic Microrobots Based on Spirulina Templates for Targeted Delivery and Synergistic Chemo-Photothermal Therapy [J].
Wang, Xu ;
Cai, Jun ;
Sun, Lili ;
Zhang, Shuo ;
Gong, De ;
Li, Xinghao ;
Yue, Shuhua ;
Feng, Lin ;
Zhang, Deyuan .
ACS APPLIED MATERIALS & INTERFACES, 2019, 11 (05) :4745-4756
[56]   Stable Nanomanipulation Using Atomic Force Microscopy A virtual nanohand for a robotic nanomanipulation system [J].
Wang, Zhiyu ;
Liu, Lianqing ;
Wang, Yuechao ;
Wang, Zhidong ;
Xi, Ning ;
Hou, Jing ;
Wang, Wenxue ;
Yuan, Shuai .
IEEE NANOTECHNOLOGY MAGAZINE, 2013, 7 (04) :6-11
[57]   Multi-View Merging for Robot Teleoperation With Virtual Reality [J].
Wei, Dong ;
Huan, Bidan ;
Li, Qiang .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) :8537-8544
[58]   Atherosclerosis of the aorta is common in patients with severe aortic stenosis: An intraoperative transesophageal echocardiographic study [J].
Weisenberg, D ;
Sahar, Y ;
Sahar, G ;
Shapira, Y ;
Iakobishvili, Z ;
Vidne, BA ;
Sagie, A .
JOURNAL OF THORACIC AND CARDIOVASCULAR SURGERY, 2005, 130 (01) :29-32
[59]   Multimodal Locomotion Control of Needle-Like Microrobots Assembled by Ferromagnetic Nanoparticles [J].
Xu, Tiantian ;
Hao, Zhiming ;
Huang, Chenyang ;
Yu, Jiangfan ;
Zhang, Li ;
Wu, Xinyu .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2022, 27 (06) :4327-4338
[60]   Cooperative Control Strategy of Magnetic Microrobots in Bifurcated Microfluidic Channels [J].
Xu, Yanhua ;
Huang, Chenyang ;
Li, Dong ;
Liu, Jia ;
Fu, Shixiong ;
Wu, Xinyu ;
Xu, Tiantian .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (04) :1889-1896