Application of DNN for radar micro-doppler signature-based human suspicious activity recognition

被引:23
作者
Chakraborty, Mainak [1 ,3 ]
Kumawat, Harish C. [2 ]
Dhavale, Sunita Vikrant [1 ]
Raj, A. Arockia Bazil [2 ]
机构
[1] Def Inst Adv Technol DIAT, Dept Comp Sci & Engn, Pune 411025, Maharashtra, India
[2] Def Inst Adv Technol DIAT, Dept Elect Engn, Pune 411025, Maharashtra, India
[3] Nitte Meenakshi Inst Technol, Dept Informat Sci & Engn, PB 6429 Yelahanka, Bangalore 560064, Karnataka, India
关键词
CW radar; Human activity recognition; Micro-Doppler signatures; Spectrogram; Dataset; Convolutional neural network;
D O I
10.1016/j.patrec.2022.08.005
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The non-availability of open-source datasets covering various human suspicious activities and well -trained deep learning (DL) architecture limits the effective utilization of DL network-supported radar systems for real-time autonomous human activity recognition (HAR). The development of a dataset and validation of its micro-Doppler-signature-distinguishable-features by a suitable DL network becomes significant, and that is the key contribution given in this research. In this work, an indigenously devel-oped X-band CW radar is employed to create a diverse DIAT-mu RadHAR dataset, which includes (a) army marching, (b) Stone pelting/Grenades throwing, (c) jumping with holding a gun, (d) army Jogging, (e) army crawling and (f) boxing activities. Six Pre-trained CNNs models supported DL architectures, trained with DIAT-mu RadHAR dataset containing 3780 m-D images, are proposed, which can be used for open-field HAR. The characteristics of our dataset and performance analysis of the proposed two DL architectures are statistically computed, and their results are compared in terms of receiver operating characteristic (ROC), precision, F1-score, recall, and confusion matrix. The pre-trained VGG19 with transfer learning outperforms other CNNs with an overall classification accuracy of 98%. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:1 / 6
页数:6
相关论文
共 33 条
[11]   A survey on photonics technologies for radar applications [J].
De, Sampurna ;
Bazil Raj, A. A. .
JOURNAL OF OPTICS-INDIA, 2023, 52 (01) :90-119
[12]   Airborne Multi-Channel Ground Penetrating Radar for Improvised Explosive Devices and Landmine Detection [J].
Garcia-Fernandez, Maria ;
Lopez, Yuri Alvarez ;
Andres, Fernando Las-Heras .
IEEE ACCESS, 2020, 8 :165927-165943
[13]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[14]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[15]  
Jankiraman M, 2007, DESIGN MULTIFREQUENC, V2
[16]   Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks [J].
Kim, Youngwook ;
Moon, Taesup .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (01) :8-12
[17]  
Kumawat H.C., 2022, IEEE T INSTRUM MEAS, V71, P8504011, DOI [10.1109/TIM.2022.3188050, DOI 10.1109/TIM.2022.3188050]
[18]   DIAT-μSAT: Small Aerial Targets' Micro-Doppler Signatures and Their Classification Using CNN [J].
Kumawat, Harish C. ;
Chakraborty, Mainak ;
Raj, A. Arockia Bazil ;
Dhavale, Sunita Vikrant .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[19]   Extraction of Doppler signature of micro-to-macro rotations/motions using continuous wave radar-assisted measurement system [J].
Kumawat, Harish C. ;
Bazil Raj, Arockia .
IET SCIENCE MEASUREMENT & TECHNOLOGY, 2020, 14 (07) :772-785
[20]   Data Acquisition and Signal Processing System for CW Radar [J].
Kumawat, Harish Chandra ;
Raj, Arockia Bazil .
2019 5TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION, CONTROL AND AUTOMATION (ICCUBEA), 2019,