GAN-Based Radar Spectrogram Augmentation via Diversity Injection Strategy

被引:9
作者
Yang, Yang [1 ]
Zhang, Yutong [1 ]
Lang, Yue [2 ]
Li, Beichen [1 ]
Guo, Shisheng [3 ]
Tan, Qi [4 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Hebei Univ Technol, Sch Elect & Informat Engn, Tianjin 300401, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
[4] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
基金
中国国家自然科学基金;
关键词
Spectrogram; Training; Radar; Generative adversarial networks; Data models; Training data; Radar measurements; Data augmentation; diversity; generative adversarial networks (GANs); human activity classification; micro-Doppler; mode collapse; semantic consistency; HUMAN ACTION RECOGNITION; NETWORK;
D O I
10.1109/TIM.2022.3225060
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The classification of human activity using radar has gained considerable attention in recent years because of the radar sensor's resistance to harsh settings. However, when using machine learning algorithms to train a radar-based classifier, a substantial amount of training data is always required, which means that the time-consuming and difficult radar measurements should be a prerequisite activity in most scenarios. The purpose of this article is to present a novel data augmentation methodology for generating sufficient and diverse training data for human activity classification, hence alleviating the reliance on complex radar measurements. It is worth noting that the proposed model only uses one spectrogram as a reference for spectrogram augmentation, which demonstrates its great potential in practical scenarios. Considering the contingent risk of a lack of diversity in augmented samples, we develop an elaborate strategy for injecting diversity into augmented samples using external counterparts. To validate our model, we conduct radar simulations and measurements to create a variety of datasets. Our model outperforms other comparable models, demonstrating its great potential in improving the performance of human activity classification.
引用
收藏
页数:12
相关论文
共 61 条
[1]   Deep learning approach for human action recognition in infrared images [J].
Akula, Aparna ;
Shah, Anuj K. ;
Ghosh, Ripul .
COGNITIVE SYSTEMS RESEARCH, 2018, 50 :146-154
[2]  
Amin MG, 2020, 2020 IEEE INTERNATIONAL RADAR CONFERENCE (RADAR), P1046, DOI [10.1109/RADAR42522.2020.9114613, 10.1109/radar42522.2020.9114613]
[3]   Rethinking the Truly Unsupervised Image-to-Image Translation [J].
Baek, Kyungjune ;
Choi, Yunjey ;
Uh, Youngjung ;
Yoo, Jaejun ;
Shim, Hyunjung .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :14134-14143
[4]  
Bhagyashree V., 2020, P 2020 IEEE 4 C INF, P1, DOI [DOI 10.1109/CICT51604.2020.9312049, 10.1109/CICT51604.2020.9312049]
[5]   Micro-Doppler-Based Human Activity Classification Using the Mote-Scale BumbleBee Radar [J].
Cagliyan, Bahri ;
Gurbuz, Sevgi Zubeyde .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2015, 12 (10) :2135-2139
[6]   DIAT-RadHARNet: A Lightweight DCNN for Radar Based Classification of Human Suspicious Activities [J].
Chakraborty, Mainak ;
Kumawat, Harish C. ;
Dhavale, Sunita Vikrant ;
Raj, Arockia Bazil A. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[7]   Reusing Discriminators for Encoding: Towards Unsupervised Image-to-Image Translation [J].
Chen, Runfa ;
Huang, Wenbing ;
Huang, Binghui ;
Sun, Fuchun ;
Fang, Bin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :8165-8174
[8]   Analysis of micro-Doppler signatures [J].
Chen, VC ;
Li, F ;
Ho, SS ;
Wechsler, H .
IEE PROCEEDINGS-RADAR SONAR AND NAVIGATION, 2003, 150 (04) :271-276
[9]   Enhanced Multi-Channel Feature Synthesis for Hand Gesture Recognition Based on CNN With a Channel and Spatial Attention Mechanism [J].
Du, Chuan ;
Zhang, Lei ;
Sun, Xiping ;
Wang, Junxu ;
Sheng, Jialian .
IEEE ACCESS, 2020, 8 :144610-144620
[10]   Segmented convolutional gated recurrent neural networks for human activity recognition in ultra-wideband radar [J].
Du, Hao ;
Jin, Tian ;
He, Yuan ;
Song, Yongping ;
Dai, Yongpeng .
NEUROCOMPUTING, 2020, 396 :451-464