1D convolutional neural networks and applications: A survey

被引:1628
作者
Kiranyaz, Serkan [1 ]
Avci, Onur [2 ]
Abdeljaber, Osama [3 ]
Ince, Turker [4 ]
Gabbouj, Moncef [5 ]
Inman, Daniel J. [6 ]
机构
[1] Qatar Univ, Dept Elect Engn, Doha, Qatar
[2] Iowa State Univ, Civil Construct & Environm Engn, Ames, IA USA
[3] Linnaeus Univ, Dept Bldg Technol, Vaxjo, Sweden
[4] Izmir Univ Econ, Elect & Elect Engn Dept, Izmir, Turkey
[5] Tampere Univ, Dept Comp Sci, Tampere, Finland
[6] Univ Michigan, Dept Aerosp Engn, Ann Arbor, MI 48109 USA
关键词
Artificial Neural Networks; Machine learning; Deep learning; Convolutional neural networks; Structural health monitoring; Condition monitoring; Arrhythmia detection and identification; Fault detection; Structural damage detection; BEARING FAULT-DIAGNOSIS; RECEPTIVE-FIELDS; FUNCTIONAL ARCHITECTURE; SPEECH RECOGNITION; PERCEPTRON; IDENTIFICATION; DECOMPOSITION; MODEL;
D O I
10.1016/j.ymssp.2020.107398
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
During the last decade, Convolutional Neural Networks (CNNs) have become the de facto standard for various Computer Vision and Machine Learning operations. CNNs are feed-forward Artificial Neural Networks (ANNs) with alternating convolutional and subsampling layers. Deep 2D CNNs with many hidden layers and millions of parameters have the ability to learn complex objects and patterns providing that they can be trained on a massive size visual database with ground-truth labels. With a proper training, this unique ability makes them the primary tool for various engineering applications for 2D signals such as images and video frames. Yet, this may not be a viable option in numerous applications over 1D signals especially when the training data is scarce or application specific. To address this issue, 1D CNNs have recently been proposed and immediately achieved the state-of-the-art performance levels in several applications such as personalized biomedical data classification and early diagnosis, structural health monitoring, anomaly detection and identification in power electronics and electrical motor fault detection. Another major advantage is that a real-time and low-cost hardware implementation is feasible due to the simple and compact configuration of 1D CNNs that perform only 1D convolutions (scalar multiplications and additions). This paper presents a comprehensive review of the general architecture and principals of 1D CNNs along with their major engineering applications, especially focused on the recent progress in this field. Their state-of-the-art performance is highlighted concluding with their unique properties. The benchmark datasets and the principal 1D CNN software used in those applications are also publicly shared in a dedicated website. While there has not been a paper on the review of 1D CNNs and its applications in the literature, this paper fulfills this gap. (C) 2020 The Author(s). Published by Elsevier Ltd.
引用
收藏
页数:21
相关论文
共 98 条
[41]   Deep Neural Networks for Acoustic Modeling in Speech Recognition [J].
Hinton, Geoffrey ;
Deng, Li ;
Yu, Dong ;
Dahl, George E. ;
Mohamed, Abdel-rahman ;
Jaitly, Navdeep ;
Senior, Andrew ;
Vanhoucke, Vincent ;
Patrick Nguyen ;
Sainath, Tara N. ;
Kingsbury, Brian .
IEEE SIGNAL PROCESSING MAGAZINE, 2012, 29 (06) :82-97
[42]   RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE OF MONKEY STRIATE CORTEX [J].
HUBEL, DH ;
WIESEL, TN .
JOURNAL OF PHYSIOLOGY-LONDON, 1968, 195 (01) :215-&
[43]   RECEPTIVE FIELDS OF CELLS IN STRIATE CORTEX OF VERY YOUNG, VISUALLY INEXPERIENCED KITTENS [J].
HUBEL, DH ;
WIESEL, TN .
JOURNAL OF NEUROPHYSIOLOGY, 1963, 26 (06) :994-&
[44]   RECEPTIVE FIELDS, BINOCULAR INTERACTION AND FUNCTIONAL ARCHITECTURE IN CATS VISUAL CORTEX [J].
HUBEL, DH ;
WIESEL, TN .
JOURNAL OF PHYSIOLOGY-LONDON, 1962, 160 (01) :106-&
[45]   RECEPTIVE FIELDS OF SINGLE NEURONES IN THE CATS STRIATE CORTEX [J].
HUBEL, DH ;
WIESEL, TN .
JOURNAL OF PHYSIOLOGY-LONDON, 1959, 148 (03) :574-591
[46]   SINGLE UNIT ACTIVITY IN LATERAL GENICULATE BODY AND OPTIC TRACT OF UNRESTRAINED CATS [J].
HUBEL, DH .
JOURNAL OF PHYSIOLOGY-LONDON, 1960, 150 (01) :91-&
[47]   Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks [J].
Ince, Turker ;
Kiranyaz, Serkan ;
Eren, Levent ;
Askar, Murat ;
Gabbouj, Moncef .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2016, 63 (11) :7067-7075
[48]   Evaluation of global and local training techniques over feed-forward neural network architecture spaces for computer-aided medical diagnosis [J].
Ince, Turker ;
Kiranyaz, Serkan ;
Pulkkinen, Jenni ;
Gabbouj, Moncef .
EXPERT SYSTEMS WITH APPLICATIONS, 2010, 37 (12) :8450-8461
[49]   A Generic and Robust System for Automated Patient-Specific Classification of ECG Signals [J].
Ince, Turker ;
Kiranyaz, Serkan ;
Gabbouj, Moncef .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2009, 56 (05) :1415-1426
[50]   Convolutional Neural Network Based Fault Detection for Rotating Machinery [J].
Janssens, Olivier ;
Slavkovikj, Viktor ;
Vervisch, Bram ;
Stockman, Kurt ;
Loccufier, Mia ;
Verstockt, Steven ;
Van de Walle, Rik ;
Van Hoecke, Sofie .
JOURNAL OF SOUND AND VIBRATION, 2016, 377 :331-345