An interactive mixed reality ray tracing rendering mobile application of medical data in minimally

被引:2
作者
El-Seoud S.A. [1 ]
Mady A.S. [1 ,2 ]
Rashed E.A. [1 ,3 ]
机构
[1] Department of Computer Science, British University in Egypt (BUE)
[2] Faculty of Informatics and Computer Science, British University in Egypt (BUE)
关键词
Medical imaging; Mixed reality; Ray-casting; Ray-tracing; Volume rendering;
D O I
10.3991/ijim.v13i03.9893
中图分类号
学科分类号
摘要
Visualization of patient's anatomy is the most important preoperation process in surgeries; minimally invasive surgeries are among these types of medical operations that counts totally on medical visualization before operating on a patient. However, medicine has a problem in visualizing patients' through looking through multiple slices of scans, trying to understand the three-dimensional (3D) anatomical structure of patients. With Mixed Reality (MR) the developments in medicine visualization will become much easier andcreates a better environment for surgeries. This will help reduce the excessive effort and time spent by surgeons to locate where the problem lies with patients without looking through multiple of two-dimensional (2D) slices, but to see patients' bodies in 3D in front of them augmented in their reality, and to interact with it whatever pleases them. Moreover, this will reduce the number of scans that doctors will ask their patient's for, which will result in less harmful x-ray dosages for both the patient and the radiologist. Biomedical development in medical visualization is an active research topic as it provides the physicians with required devices for clinically feasible way for diagnosis, follow-up and take decisions in different disease lifeline. Current clinical imaging facility can provide a 3D imaging that can be used to guide different interventional procedures. The main challenge is how to map the information presented in the digital image with the real object. This is commonly implemented by mental processing that requires skills from the medical doctor. This paper contributes to this problem by providing a mixed reality system to merge the digital image of the patient anatomy with the patient visual image. Anatomical image obtained from Computed Tomography (CT) or Magnetic Resonance Imaging (MRI) is mapped over the patient body using virtual reality (VR) head-mounted device (HMD). © 2019 International Association of Online Engineering.
引用
收藏
页码:29 / 39
页数:10
相关论文
共 13 条
  • [1] El-Seoud S.A., Mady A.S., Rashed E.A., An Interactive Mixed Reality Imaging System for Minimally Invasive Surgeries, Proceedings of the 7th International Conference on Software and Information Engineering -ICSIE '18, (2018)
  • [2] Rowe S.P., Fishman E.K., Image Processing from 2D to 3D, (2017)
  • [3] Vavra P., Et al., recent development of augmented reality in surgery: a review, J. Health Eng, 2017, (2017)
  • [4] De Paolis L.T., Aloisio G., Augmented reality in minimally invasive surgery, Advances in Biomedical Sensing, Measurements, Instrumentation and Systems, pp. 305-320, (2010)
  • [5] Udupa J.K., Goncalves R.J., Medical image rendering, American journal of cardiac imaging, 7, 3, pp. 154-163, (1993)
  • [6] Otha Y., Tamura H., 2014-Mixed reality: merging real and virtual worlds
  • [7] Billinghurst M., Kato H., Collaborative mixed reality, Proceedings of the First International Symposium on Mixed Reality, (1999)
  • [8] (2017)
  • [9] Moller T., Direct Volume Rendering
  • [10] Komura T., Volume Rendering, Visualization -Lecture 10, (2008)