Prosperous Human Gait Recognition: an end-to-end system based on pre-trained CNN features selection

被引:61
|
作者
Mehmood, Asif [1 ]
Khan, Muhammad Attique [2 ]
Sharif, Muhammad [1 ]
Khan, Sajid Ali [3 ]
Shaheen, Muhammad [3 ]
Saba, Tanzila [4 ]
Riaz, Naveed [5 ]
Ashraf, Imran [2 ]
机构
[1] COMSATS Univ Islamabad, Dept Comp Sci, Wah Campus, Islamabad, Pakistan
[2] HITEC Univ, Dept Comp Sci & Engn, Museum Rd Taxila, Rawalpindi, Pakistan
[3] Fdn Univ Islamabad, Dept Software Engn, Islamabad, Pakistan
[4] Prince Sultan Univ, Dept Comp & Informat Sci, Riyadh, Saudi Arabia
[5] Natl Univ Sci & Technol, SEECS, Islamabad, Pakistan
关键词
Gait recognition; Deep features; Features fusion; Features selection; CONVOLUTIONAL NEURAL-NETWORKS; CLASSIFICATION; FUSION; FRAMEWORK; MOTION; ROBUST;
D O I
10.1007/s11042-020-08928-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human Gait Recognition (HGR) is a biometric approach, widely used for security purposes from the past few decades. In HGR, the change in an individual walk along with wearing clothes and carrying bag are major covariant controls which impact the performance of a system. Moreover, recognition under various view angles is another key challenge in HGR. In this work, a novel fully automated method is proposed for HGR under various view angles using deep learning. Four primary steps are involved such as: preprocessing of original video frames, exploiting pre-trained Densenet-201 CNN model for features extraction, reduction of additional features from extracted vector based on a hybrid selection method, and finally recognition using supervised learning methods. The extraction of CNN features is a key step in which our target is to extract the most active features. To achieve this goal, we fuse the features of both second last and third last layers in a parallel process. At a later stage, best features are selected by the Firefly algorithm and Skewness based approach. These selected features are serially combined and fed to One against All Multi Support Vector Machine (OAMSVM) for final recognition. Three different angles 18(0), 36(0) and 54(0) of the CASIA B dataset are selected for the evaluation process and accuracy of 94.3%, 93.8% and 94.7% is achieved respectively. Results show significant improvement in accuracy and recall rate as compared to the existing state-of-the-art techniques.
引用
收藏
页码:14979 / 14999
页数:21
相关论文
共 50 条
  • [1] Prosperous Human Gait Recognition: an end-to-end system based on pre-trained CNN features selection
    Asif Mehmood
    Muhammad Attique Khan
    Muhammad Sharif
    Sajid Ali Khan
    Muhammad Shaheen
    Tanzila Saba
    Naveed Riaz
    Imran Ashraf
    Multimedia Tools and Applications, 2024, 83 : 14979 - 14999
  • [2] End-to-End Pre-trained Dialogue System for Automatic Diagnosis
    Wang, Yuan
    Li, Zekun
    Zeng, Leilei
    Zhao, Tingting
    CCKS 2021 - EVALUATION TRACK, 2022, 1553 : 82 - 91
  • [3] End-to-end speech topic classification based on pre-trained model Wavlm
    Cao, Tengfei
    He, Liang
    Niu, Fangjing
    2022 13TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2022, : 369 - 373
  • [4] End-to-End Visual Editing with a Generatively Pre-trained Artist
    Brown, Andrew
    Fu, Cheng-Yang
    Parkhi, Omkar
    Berg, Tamara L.
    Vedaldi, Andrea
    COMPUTER VISION - ECCV 2022, PT XV, 2022, 13675 : 18 - 35
  • [5] SPEECH SENTIMENT ANALYSIS VIA PRE-TRAINED FEATURES FROM END-TO-END ASR MODELS
    Lu, Zhiyun
    Cao, Liangliang
    Zhang, Yu
    Chiu, Chung-Cheng
    Fan, James
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 7149 - 7153
  • [6] FINE-TUNING OF PRE-TRAINED END-TO-END SPEECH RECOGNITION WITH GENERATIVE ADVERSARIAL NETWORKS
    Haidar, Md Akmal
    Rezagholizadeh, Mehdi
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6204 - 6208
  • [7] Disambiguation of Chinese Polyphones in an End-to-End Framework with Semantic Features Extracted by Pre-trained BERT
    Dai, Dongyang
    Wu, Zhiyong
    Kang, Shiyin
    Wu, Xixin
    Jia, Jia
    Su, Dan
    Yu, Dong
    Meng, Helen
    INTERSPEECH 2019, 2019, : 2090 - 2094
  • [8] An end-to-end gait recognition system for covariate conditions using custom kernel CNN
    Ali, Babar
    Bukhari, Maryam
    Maqsood, Muazzam
    Moon, Jihoon
    Hwang, Eenjun
    Rho, Seungmin
    HELIYON, 2024, 10 (12)
  • [9] IMPROVING NON-AUTOREGRESSIVE END-TO-END SPEECH RECOGNITION WITH PRE-TRAINED ACOUSTIC AND LANGUAGE MODELS
    Deng, Keqi
    Yang, Zehui
    Watanabe, Shinji
    Higuchi, Yosuke
    Cheng, Gaofeng
    Zhang, Pengyuan
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8522 - 8526
  • [10] End-To-End Finger Trimodal Features Fusion and Recognition Model Based on CNN
    Wen, Mengna
    Zhang, Haigang
    Yang, Jinfeng
    BIOMETRIC RECOGNITION (CCBR 2021), 2021, 12878 : 39 - 48