Early detection of depression through facial expression recognition and electroencephalogram-based artificial intelligence-assisted graphical user interface

被引:4
作者
Kumar, Gajendra [1 ,2 ]
Das, Tanaya [3 ]
Singh, Kuldeep [4 ]
机构
[1] Brown Univ, Dept Mol Biol Cell Biol & Biochem MCB, 70 Ship St, Providence, RI 02906 USA
[2] Brown Univ, Ctr Translat Neurosci, Providence, RI 02912 USA
[3] Univ Sydney, Fac Engn, Sch Biomed Engn, Sydney, NSW, Australia
[4] Guru Nanak Dev Univ, Dept Elect Technol, Amritsar, Punjab, India
关键词
Depression; Artificial intelligence; EEG; Emotion recognition; Graphical user interface; EEG; MODEL;
D O I
10.1007/s00521-024-09437-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Psychological disorders have increased globally at an alarming rate. Among these disorders, depression stands out as one of the leading and most prevalent conditions that have affected more than 280 million people. However, it remains widely undiagnosed and untreated due to lack of sensitive and reliable diagnostic tools. This underscores the imperative for the development of a sensitive and accurate diagnostic tool facilitating the early diagnosis of depression symptoms to mitigate the impending mental illness epidemic. To address this need, we developed an artificial intelligence (AI)-assisted tool utilizing facial expression-based emotion recognition and electroencephalogram (EEG) analysis for the detection of depression symptoms along with their severity level assessment. Our approach yielded successful detection of depression symptoms with an accuracy of 93.58%, a sensitivity of 92.70%, a specificity of 93.40%, and an f1-score of 93.68% through facial emotion recognition task. Additionally, severity level detection employing EEG biomarkers achieved an accuracy of 99.75%, a sensitivity of 99.75%, a specificity of 99.92%, and an f1-score of 99.75%. Consequently, a graphical user interface (GUI) tool was developed that seamlessly integrated the AI with facial image and EEG data inputs, enabling efficient recognition of depression from both real-time and pre-recorded data. The resulting AI assistant demonstrates high sensitivity, precision, and accuracy in the early detection of depression, establishing its potential as a reliable diagnostic tool. The application of our tool may be extended to clinicians, therapists, and hospitals for the identification of depression at its early stage.
引用
收藏
页码:6937 / 6954
页数:18
相关论文
共 51 条
[11]  
de Melo WC, 2019, IEEE IMAGE PROC, P4544, DOI [10.1109/ICIP.2019.8803467, 10.1109/icip.2019.8803467]
[12]   Four-layer ConvNet to facial emotion recognition with minimal epochs and the significance of data diversity [J].
Debnath, Tanoy ;
Reza, Md Mahfuz ;
Rahman, Anichur ;
Beheshti, Amin ;
Band, Shahab S. ;
Alinejad-Rokny, Hamid .
SCIENTIFIC REPORTS, 2022, 12 (01)
[13]   A NOVEL COMBINATION OF BIOMARKERS TO HERALD THE ONSET OF SEPSIS PRIOR TO THE MANIFESTATION OF SYMPTOMS [J].
Dolin, Hallie H. ;
Papadimos, Thomas J. ;
Stepkowski, Stanislaw ;
Chen, Xiaohuan ;
Pan, Zhixing K. .
SHOCK, 2018, 49 (04) :364-370
[14]   Gamma oscillations as a biomarker for major depression: an emerging topic [J].
Fitzgerald, Paul J. ;
Watson, Brendon O. .
TRANSLATIONAL PSYCHIATRY, 2018, 8
[15]  
Gatt Justine M., 2007, Journal of Integrative Neuroscience, V6, P75, DOI 10.1142/S0219635207001398
[16]  
Grishchenko I, 2020, Arxiv, DOI arXiv:2006.10962
[17]   A MATLAB based graphical user interface (GUI) for quickly producing widely used hydrogeochemical diagrams [J].
He, Song ;
Li, Peiyue .
GEOCHEMISTRY, 2020, 80 (04)
[18]   Emotion Regulating Attentional Control Abnormalities In Major Depressive Disorder: An Event-Related Potential Study [J].
Hu, Bin ;
Rao, Juan ;
Li, Xiaowei ;
Cao, Tong ;
Li, Jianxiu ;
Majoe, Dennis ;
Gutknecht, Jurg .
SCIENTIFIC REPORTS, 2017, 7
[19]   Analysis of EEG features and study of automatic classification in first-episode and drug-naïve patients with major depressive disorder [J].
Huang, Yuanyuan ;
Yi, Yun ;
Chen, Qiang ;
Li, Hehua ;
Feng, Shixuan ;
Zhou, Sumiao ;
Zhang, Ziyun ;
Liu, Chenyu ;
Li, Junhao ;
Lu, Qiuling ;
Zhang, Lida ;
Han, Wei ;
Wu, Fengchun ;
Ning, Yuping .
BMC PSYCHIATRY, 2023, 23 (01)
[20]   NIA-AA Research Framework: Toward a biological definition of Alzheimer's disease [J].
Jack, Clifford R., Jr. ;
Bennett, David A. ;
Blennow, Kaj ;
Carrillo, Maria C. ;
Dunn, Billy ;
Haeberlein, Samantha Budd ;
Holtzman, David M. ;
Jagust, William ;
Jessen, Frank ;
Karlawish, Jason ;
Liu, Enchi ;
Luis Molinuevo, Jose ;
Montine, Thomas ;
Phelps, Creighton ;
Rankin, Katherine P. ;
Rowe, Christopher C. ;
Scheltens, Philip ;
Siemers, Eric ;
Snyder, Heather M. ;
Sperling, Reisa ;
Elliott, Cerise ;
Masliah, Eliezer ;
Ryan, Laurie ;
Silverberg, Nina .
ALZHEIMERS & DEMENTIA, 2018, 14 (04) :535-562