An Ultra-Efficient Approach for High-Resolution MIMO Radar Imaging of Human Hand Poses

被引:0
作者
Braeunig, Johanna [1 ]
Wirth, Vanessa [2 ]
Kammel, Christoph [1 ]
Schuessler, Christian [1 ]
Ullmann, Ingrid [1 ]
Stamminger, Marc [1 ]
Vossiek, Martin
机构
[1] Friedrich Alexander Univ Erlangen Nurnberg FAU, Inst Microwaves & Photon, D-91058 Erlangen, Germany
[2] Friedrich Alexander Univ Erlangen Nurnberg FAU, Chair Visual Comp, D-91058 Erlangen, Germany
来源
IEEE TRANSACTIONS ON RADAR SYSTEMS | 2023年 / 1卷
关键词
Radar imaging; Radar; Three-dimensional displays; Imaging; Radar antennas; Image reconstruction; Frequency shift keying; hand pose capture; 3D reconstruction; frequency shift keying; CONVOLUTIONAL NEURAL-NETWORKS;
D O I
10.1109/TRS.2023.3309574
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The capturing of hands, including their poses, shapes and motions, has numerous potential applications, such as human-machine interfaces and medical use cases. However, in the radar context, most existing methods only allow for the recognition of dynamic hand gestures based on Doppler evaluations due to the respective systems' limited lateral resolution. Radar-based high-resolution three-dimensional (3D) imaging using multiple-input multiple-output (MIMO) radars is currently the state-of-the-art in personnel security scanning. However, the associated imaging techniques suffer from computationally burdensome reconstruction algorithms that sample the entire 3D space of interest, thereby making them less suitable for real-time applications. Moreover, their application in hand motion tracking scenarios is limited by low frame rates that result from a high number of transmit frequencies. Hence, we present an efficient and powerful approach for the radar-based 3D reconstruction of hand poses. The method extends the frequency shift keying continuous wave radar principle and reconstructs the hand surface using only two carrier frequencies. Instead of reconstructing an entire 3D volume, only two single-tone radar images are computed. Depth information is derived from phase differences between corresponding pixels in the images. The approach significantly reduces computational load by three orders of magnitude compared with the state-of-the-art and enables higher frame rates. Within this paper, this novel reconstruction principle is analyzed and compared to a state-of-the-art radar imaging approach using a MIMO radar system with 94 transmitting and 94 receiving antennas. Detailed simulations of point targets and comprehensive measurements demonstrate the excellent imaging performance of our approach.
引用
收藏
页码:468 / 480
页数:13
相关论文
共 34 条
[1]  
Ahmed S.S., 2014, Electronic Microwave Imaging with Planar Multistatic Arrays
[2]   Hand Gestures Recognition Using Radar Sensors for Human-Computer-Interaction: A Review [J].
Ahmed, Shahzad ;
Kallu, Karam Dad ;
Ahmed, Sarfaraz ;
Cho, Sung Ho .
REMOTE SENSING, 2021, 13 (03) :1-24
[3]   Finger-Counting-Based Gesture Recognition within Cars Using Impulse Radar with Convolutional Neural Network [J].
Ahmed, Shahzad ;
Khan, Faheem ;
Ghaffar, Asim ;
Hussain, Farhan ;
Cho, Sung Ho .
SENSORS, 2019, 19 (06)
[4]   Microwave Imaging in Security-Two Decades of Innovation [J].
Ahmed, Sherif S. .
IEEE JOURNAL OF MICROWAVES, 2021, 1 (01) :191-201
[5]   Advanced Microwave Imaging [J].
Ahmed, Sherif Sayed ;
Schiessl, Andreas ;
Gumbmann, Frank ;
Tiebout, Marc ;
Methfessel, Sebastian ;
Schmidt, Lorenz-Peter .
IEEE MICROWAVE MAGAZINE, 2012, 13 (06) :26-43
[6]  
Anaz A, 2018, IEEE ENG MED BIO, P3874, DOI 10.1109/EMBC.2018.8513260
[7]  
[Anonymous], 2022, Rohde & Schwarz QAR50 radome tester
[8]   DOPPLER RADAR [J].
BARLOW, EJ .
PROCEEDINGS OF THE INSTITUTE OF RADIO ENGINEERS, 1949, 37 (04) :340-355
[9]   A Comprehensive Study on Deep Learning-Based 3D Hand Pose Estimation Methods [J].
Chatzis, Theocharis ;
Stergioulas, Andreas ;
Konstantinidis, Dimitrios ;
Dimitropoulos, Kosmas ;
Daras, Petros .
APPLIED SCIENCES-BASEL, 2020, 10 (19) :1-27
[10]   A Survey on Hand Pose Estimation with Wearable Sensors and Computer-Vision-Based Methods [J].
Chen, Weiya ;
Yu, Chenchen ;
Tu, Chenyu ;
Lyu, Zehua ;
Tang, Jing ;
Ou, Shiqi ;
Fu, Yan ;
Xue, Zhidong .
SENSORS, 2020, 20 (04)