3D MEDICAL IMAGE INTERACTION AND SEGMENTATION USING KINECT

被引:2
作者
Chang, Cheng [1 ]
Gao, Yi [2 ]
机构
[1] SUNY Stony Brook, Dept Elect & Comp Engn, Stony Brook, NY 11794 USA
[2] SUNY Stony Brook, Dept Biomed Informat, Stony Brook, NY 11794 USA
来源
2016 IEEE 13TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI) | 2016年
关键词
3D Interaction; Audio/Gesture Driven Segmentation;
D O I
10.1109/ISBI.2016.7493316
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Most medical images, especially radiology images, naturally reside in the 3D space. The interaction with the medical images and with the image computing procedures, unfortunately, are limited to 2D due to the physical properties of the mouse, touch pad, etc. In this research, we present a 3D image interaction system and an image segmentation process based on such 3D interaction utilizing spatially free-form motions/gestures and voice commands through the Kinect sensor. The algorithm as well as the entire hardware/software system has been tested on tasks such as abdominal organ and brain tumor viewing and segmentation. Among them, we show some particular cases that are rather challenging where the segmentation leakage is very difficult to handle under the conventional 2D mouse-based interaction. Moreover, as our proposed 3D image interaction and segmentation method is dynamically driven by a audio and gesture combination, we provide a demonstration video on YouTube to better show the capability and procedure of our system.
引用
收藏
页码:498 / 501
页数:4
相关论文
共 10 条
[1]  
[Anonymous], 2013, Fundamentals of statistical signal processing: Practical algorithm development
[2]   A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities [J].
Chang, Yao-Jen ;
Chen, Shu-Fang ;
Huang, Jun-Da .
RESEARCH IN DEVELOPMENTAL DISABILITIES, 2011, 32 (06) :2566-2570
[3]   A 3D interactive multi-object segmentation tool using local robust statistics driven active contours [J].
Gao, Yi ;
Kikinis, Ron ;
Bouix, Sylvain ;
Shenton, Martha ;
Tannenbaum, Allen .
MEDICAL IMAGE ANALYSIS, 2012, 16 (06) :1216-1227
[4]   Random walks for image segmentation [J].
Grady, Leo .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (11) :1768-1783
[5]  
Kaus M., 2007, AUTOMATED SEGMENTATI
[6]   Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications [J].
Khoshelham, Kourosh ;
Elberink, Sander Oude .
SENSORS, 2012, 12 (02) :1437-1454
[7]   What energy functions can be minimized via graph cuts? [J].
Kolmogorov, V ;
Zabih, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (02) :147-159
[8]   Optimal surface segmentation in volumetric images - A graph-theoretic approach [J].
Li, K ;
Wu, XD ;
Chen, DZ ;
Sonka, M .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (01) :119-134
[9]   GrabCut - Interactive foreground extraction using iterated graph cuts [J].
Rother, C ;
Kolmogorov, V ;
Blake, A .
ACM TRANSACTIONS ON GRAPHICS, 2004, 23 (03) :309-314
[10]  
Zhu L., 2014, MICCAI IMIC WORKSH