Coded-Aperture Computational Millimeter-Wave Image Classifier Using Convolutional Neural Network

被引:16
作者
Sharma, Rahul [1 ]
Hussung, Raphael [2 ]
Keil, Andreas [2 ]
Friederich, Fabian [2 ]
Fromenteze, Thomas [3 ]
Khalily, Mohsen [4 ]
Deka, Bhabesh [5 ]
Fusco, Vincent [1 ]
Yurduseven, Okan [1 ]
机构
[1] Queens Univ Belfast, Inst Elect Commun & Informat Technol, Belfast BT3 9DT, Antrim, North Ireland
[2] Fraunhofer Inst Ind Math ITWM, Dept Mat Characterizat & Testing, D-67663 Kaiserslautern, Germany
[3] Univ Limoges, XLIM, UMR 7252, F-87000 Limoges, France
[4] Univ Surrey, 5G & 6G Innovat Ctr 5GIC & 6GIC, Inst Commun Syst ICS, Guildford GU2 7XH, Surrey, England
[5] Tezpur Univ, Dept Elect & Commun Engn, Tezpur 784028, Assam, India
关键词
Millimeter-wave; imaging radars; computational imaging; neural networks; image classification; coded-aperture; OBJECT DETECTION; RADAR;
D O I
10.1109/ACCESS.2021.3107782
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A millimeter-wave (mmW) classifier system applied to images synthesized from a coded-aperture based computational imaging (CI) radar is presented. A developed physical model of a CI system is used to generate the image dataset for the classification algorithm. A convolutional neural network (CNN) is integrated with the physical model and trained using the dataset comprising of synthesized mmW images obtained directly from the developed CI physical model. A k-fold cross validation technique is applied during the training process to validate the classification model. The coded-aperture CI concept enables image reconstruction from a significantly reduced number of back-scattered measurements by facilitating physical layer compression. This physical layer compression can substantially simplify the data acquisition layer of imaging radars, which is realized using only two channels in this article. The integration of the classification algorithm with the CI numerical model is particularly important in enabling the training step to be carried out using relevant system metrics and without the necessity for experimental data. Leveraging the CI numerical model generated data, training step for the classification algorithm is achieved in real-time while also confirming that the numerically trained CI classifier offers high accuracy with both simulated and experimental data. The classifier integrated physical model also enables performance analysis of the classification algorithm to be carried out as a function of key system metrics such as signal-to-noise (SNR) level, ensuring a complete understanding of the classification accuracy under different operating conditions. The trained CI system is tested with synthesized mmW images from the physical model and a classification accuracy of 89% is achieved. The proposed model is also verified using experimental data validating the fidelity of the developed CI integrated classifier system. A classification latency of 3.8 ms per frame is achieved, paving the way for real-time automated threat detection (ATD) for security-screening applications.
引用
收藏
页码:119830 / 119844
页数:15
相关论文
共 81 条
[1]  
Acharya D., MULTICLASS EMOTION C, V1367, P2021
[2]   Microwave Imaging in Security-Two Decades of Innovation [J].
Ahmed, Sherif S. .
IEEE JOURNAL OF MICROWAVES, 2021, 1 (01) :191-201
[3]   Three-Dimensional Terahertz Imaging With Sparse Multistatic Line Arrays [J].
Baccouche, Bessem ;
Agostini, Patrick ;
Mohammadzadeh, Shiva ;
Kahl, Matthias ;
Weisenstein, Christian ;
Jonuscheit, Joachim ;
Keil, Andreas ;
Loeffler, Torsten ;
Sauer-Greff, Wolfgang ;
Urbansky, Ralph ;
Bolivar, Peter Haring ;
Friederich, Fabian .
IEEE JOURNAL OF SELECTED TOPICS IN QUANTUM ELECTRONICS, 2017, 23 (04)
[4]  
Barbastathis G., 2020, P 17 OPT TRAPP OPT M, P11463
[5]  
Bengio Yoshua, 2012, Neural Networks: Tricks of the Trade. Second Edition: LNCS 7700, P437, DOI 10.1007/978-3-642-35289-8_26
[6]   The Rise of Radar for Autonomous Vehicles Signal processing solutions and future research directions [J].
Bilik, Igal ;
Longman, Oren ;
Villeval, Shahar ;
Tabrikian, Joseph .
IEEE SIGNAL PROCESSING MAGAZINE, 2019, 36 (05) :20-31
[7]   SAR Object Classification Optimization for Embedded Platforms [J].
Capraro, Chris ;
Majumder, Uttam ;
Siddall, Josh ;
Davis, Eric K. ;
Brown, Dan ;
Cicotta, Chris .
ALGORITHMS FOR SYNTHETIC APERTURE RADAR IMAGERY XXVI, 2019, 10987
[8]  
Charvat Gregory L., 2010, 2010 IEEE International Symposium on Phased Array Systems and Technology (ARRAY 2010), P543, DOI 10.1109/ARRAY.2010.5613313
[9]   Target Classification Using the Deep Convolutional Networks for SAR Images [J].
Chen, Sizhe ;
Wang, Haipeng ;
Xu, Feng ;
Jin, Ya-Qiu .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (08) :4806-4817
[10]   Phase-coded aperture for optical imaging [J].
Chi, Wanli ;
George, Nicholas .
OPTICS COMMUNICATIONS, 2009, 282 (11) :2110-2117