DHERF: A Deep Learning Ensemble Feature Extraction Framework for Emotion Recognition Using Enhanced-CNN

Artificial Intelligence (AI) based solutions are inevitable for real-time issues in any field where voluminous historical data is to be analyzed for accurate prediction analysis. Voice-operated smart AI devices like Alexa, Siri, etc., are a commercial success which are now part of most smart households. Voice-based acoustic datasets can also be leveraged to function like biomarkers in identifying the emotion of the speech signal. Existing deep learning models using Convolutional Neural Networks (CNN) have already been employed for emotion detection, but mediocre performance was reported when prediction was extracted from multimedia content analysis. To enhance the performance of CNN-based deep learning algorithms on multi-media content-based datasets, a novel configuration framework known as the Deep Human Emotion Recognition Framework (DHERF) has been proposed in this work. DHERF exploits multiple selective features from the training dataset with a learning-based phenomenon for enhancing prediction accuracy. The experimental study revealed that optimized feature selection in training the DHERF model resulted in better prediction performances of up to 85.70% accuracy as compared to conventional CNN baseline and Long Short-Term Memory (LSTM) models which attained a maximum prediction accuracy of 71.64% and 81.11% respectively, for the same experimental conditions.