A novel device for head gesture measurement system in combination with eye-controlled human-machine interface

被引:15
作者
Lin, CS [1 ]
Ho, CW
Chang, KC
Hung, SS
Shei, HJ
Yeh, MS
机构
[1] Feng Chia Univ, Dept Automat Control Engn, Taichung 40724, Taiwan
[2] Natl United Univ, Dept Electroopt Engn, Miaoli, Taiwan
[3] China Inst Technol, Dept Mech Engn, Taipei, Taiwan
[4] Chung Shan Inst Sci & Technol, Tao Yuan, Taiwan
关键词
human-machine interface; head-mounted display; eye image; eye-controlled system; head-controlled system;
D O I
10.1016/j.optlaseng.2005.06.005
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
This study describes the design and combination of an eye-controlled and a head-controlled human-machine interface system. This system is a highly effective human-machine interface, detecting head movement by changing positions and numbers of light sources on the head. When the users utilize the head-mounted display to browse it computer screen, the system will catch the images of the user's eyes with CCD cameras, which can also measure the angle and position of the light Sources. In the eye-trackingg system, the program in the computer will locate each center point of the Pupils in the images, and record the information on moving traces and pupil diameters. In the head gesture measurement system, the user wears a double-source eyeglass frame, so the system catches images of the user's head by using a CCD camera in front of the user. The computer program will locate the center point of the head, transferring it to the screen coordinates, and then the user can control the cursor by head motions. We combine the eye-controlled and head-controlled human-machine interface system for the virtual reality applications. (C) 2005 Elsevier Ltd. All rights reserved.
引用
收藏
页码:597 / 614
页数:18
相关论文
共 13 条
[1]   Combined head and eye tracking system for dynamic testing of the vestibular system [J].
Allison, RS ;
Eizenman, M ;
Cheung, BSK .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 1996, 43 (11) :1073-1082
[2]   The camera mouse: Visual tracking of body features to provide computer access for people with severe disabilities [J].
Betke, M ;
Gips, J ;
Fleming, P .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2002, 10 (01) :1-10
[3]   Head gesture recognition using HMMs [J].
Choi, HI ;
Rhee, PK .
EXPERT SYSTEMS WITH APPLICATIONS, 1999, 17 (03) :213-221
[4]   Controlling mouse pointer position using an infrared head-operated joystick [J].
Evans, DG ;
Drew, R ;
Blenkhorn, P .
IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, 2000, 8 (01) :107-117
[5]   A head motion measurement system suitable for emission computed tomography [J].
Goldstein, SR ;
DaubeWitherspoon, ME ;
Green, MV ;
Eidsath, A .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 1997, 16 (01) :17-27
[6]   Eye and head coordination in reading: roles of head movement and cognitive control [J].
Lee, C .
VISION RESEARCH, 1999, 39 (22) :3761-3768
[7]   Design of a computer game using an eye-tracking device for eye's activity rehabilitation [J].
Lin, CS ;
Huan, CC ;
Chan, CN ;
Yeh, MS ;
Chiu, CC .
OPTICS AND LASERS IN ENGINEERING, 2004, 42 (01) :91-108
[8]   A new image processing method for evaluating the pupillary responses in a HMD-type eye-tracking device [J].
Lin, CS ;
Lue, LW ;
Yeh, MS ;
Hwang, TS ;
Lee, SH .
OPTICS AND LASER TECHNOLOGY, 2003, 35 (07) :505-515
[9]   A new data processing and calibration method for an eye-tracking device pronunciation system [J].
Lin, CS ;
Chang, KC ;
Jain, YJ .
OPTICS AND LASER TECHNOLOGY, 2002, 34 (05) :405-413
[10]   An eye behavior measuring device for VR system [J].
Lin, CS .
OPTICS AND LASERS IN ENGINEERING, 2002, 38 (06) :333-359