Early detection of depression through facial expression recognition and electroencephalogram-based artificial intelligence-assisted graphical user interface

被引:4
作者
Kumar, Gajendra [1 ,2 ]
Das, Tanaya [3 ]
Singh, Kuldeep [4 ]
机构
[1] Brown Univ, Dept Mol Biol Cell Biol & Biochem MCB, 70 Ship St, Providence, RI 02906 USA
[2] Brown Univ, Ctr Translat Neurosci, Providence, RI 02912 USA
[3] Univ Sydney, Fac Engn, Sch Biomed Engn, Sydney, NSW, Australia
[4] Guru Nanak Dev Univ, Dept Elect Technol, Amritsar, Punjab, India
关键词
Depression; Artificial intelligence; EEG; Emotion recognition; Graphical user interface; EEG; MODEL;
D O I
10.1007/s00521-024-09437-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Psychological disorders have increased globally at an alarming rate. Among these disorders, depression stands out as one of the leading and most prevalent conditions that have affected more than 280 million people. However, it remains widely undiagnosed and untreated due to lack of sensitive and reliable diagnostic tools. This underscores the imperative for the development of a sensitive and accurate diagnostic tool facilitating the early diagnosis of depression symptoms to mitigate the impending mental illness epidemic. To address this need, we developed an artificial intelligence (AI)-assisted tool utilizing facial expression-based emotion recognition and electroencephalogram (EEG) analysis for the detection of depression symptoms along with their severity level assessment. Our approach yielded successful detection of depression symptoms with an accuracy of 93.58%, a sensitivity of 92.70%, a specificity of 93.40%, and an f1-score of 93.68% through facial emotion recognition task. Additionally, severity level detection employing EEG biomarkers achieved an accuracy of 99.75%, a sensitivity of 99.75%, a specificity of 99.92%, and an f1-score of 99.75%. Consequently, a graphical user interface (GUI) tool was developed that seamlessly integrated the AI with facial image and EEG data inputs, enabling efficient recognition of depression from both real-time and pre-recorded data. The resulting AI assistant demonstrates high sensitivity, precision, and accuracy in the early detection of depression, establishing its potential as a reliable diagnostic tool. The application of our tool may be extended to clinicians, therapists, and hospitals for the identification of depression at its early stage.
引用
收藏
页码:6937 / 6954
页数:18
相关论文
共 51 条
[1]  
[Anonymous], 2022, SMOTEENN-Version 0.10.0
[2]  
[Anonymous], 2020, FER-2013
[3]  
[Anonymous], 2010, Depression in Adults with a Chronic Physical Health Problem: The NICE Guideline on Treatment and Management
[4]  
[Anonymous], 2022, World Health Organization Internet
[5]   Automated Depression Detection Using Deep Representation and Sequence Learning with EEG Signals [J].
Ay, Betul ;
Yildirim, Ozal ;
Talo, Muhammed ;
Baloglu, Ulas Baran ;
Aydin, Galip ;
Puthankattil, Subha D. ;
Acharya, U. Rajendra .
JOURNAL OF MEDICAL SYSTEMS, 2019, 43 (07)
[6]  
Bazarevsky V, 2019, Arxiv, DOI [arXiv:1907.05047, DOI 10.48550/ARXIV.1907.05047]
[7]  
Cavanagh James F, 2019, Comput Psychiatr, V3, P1, DOI 10.1162/cpsy_a_00024
[8]   3D face model dataset: Automatic detection of facial expressions and emotions for educational environments [J].
Chickerur, Satyadhyan ;
Joshi, Kartik .
BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2015, 46 (05) :1028-1037
[9]   Action unit detection in 3D facial videos with application in facial expression retrieval and recognition [J].
Danelakis, Antonios ;
Theoharis, Theoharis ;
Pratikakis, Ioannis .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (19) :24813-24841
[10]   A Deep Multiscale Spatiotemporal Network for Assessing Depression From Facial Dynamics [J].
de Melo, Wheidima Carneiro ;
Granger, Eric ;
Hadid, Abdenour .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (03) :1581-1592