Depressonify: BERT a deep learning approach of detection of depression

被引：0
作者：
Kumari M. [1 ]
Singh G. [1 ]
Pande S.D. [2 ]
机构：
[1] School of Computer Application, Lovely Professional University, Punjab, Phagwara
[2] School of Computer Science Engineering, VIT-AP University, Andhra Pradesh, Amaravati
来源：
EAI Endorsed Transactions on Pervasive Health and Technology | 2024年 / 10卷
关键词：
Bidirectional Encoder Representations from Transformers; Deep learning; Depression Detection; Transformers;
D O I：
10.4108/eetpht.10.5513
中图分类号：
学科分类号：
摘要：
INTRODUCTION: Depression is one of the leading psychological problems in the modern tech era where every single person has a social media account that has wide space for the creation of depressed feelings. Since depression can escalate to the point of suicidal thoughts or behavior spotting it early can be vitally important. Traditionally, psychologists rely on patient interviews and questionnaires to gauge the severity of depression. OBJECTIVES: The objective of this paper is earlier depression detection as well as treatment can greatly improve the probability of living a healthy and full life free of depression. METHODS: This paper introduces the utilization of BERT, a novel deep-learning, transformers approach that can detect levels of depression using textual data as input. RESULTS: The main result obtained in this paper is the extensive dataset consists of a total of 20,000 samples, which are categorized into 5 classes and further divided into training, testing, and validation sets, with respective sizes of 16,000, 2,000, and 2,000. This paper has achieved a remarkable result with a training accuracy of 95.5% and validation accuracy of 92.2% with just 5 epochs. CONCLUSION: These are the conclusions of this paper, Deep learning has a lot of potential for use in mental health applications, as seen by the study's outstanding results, which included training accuracy of 95.5%. But the path towards comprehensive and morally sound AI-based mental health support continues into the future. © 2024 M. Kumari et al.
引用
收藏
相关论文
共 14 条
  • [1] Tavchioski I., Robnik-Sikonja M., Pollak S., Detection of depression on social networks using transformers and ensembles, (2023)
  • [2] Bucur A.-M., Cosma A., Rosso P., Dinu L. P., It’s Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformers, (2023)
  • [3] Viloria S. S., del Rio D. P., Cabo R. B., Fuentes G. A. A., Segura-Bedmar I., A Frame-work for Identifying Depression on Social Media: MentalRiskES@IberLEF 2023, (2023)
  • [4] Burris S., Villatoro-Tello E., Madikeri S., Motlicek P., Node-weighted Graph Convo-lutional Network for Depression Detection in Transcribed Clinical Interviews, (2023)
  • [5] Shen Y. H., Yang H., Lin L., Automatic Depression Detection: An Emotional Audio-Textual Corpus and a GRU/BiLSTM-based Model, (2022)
  • [6] Li C., Braud C., Amblard M., Multi-Task Learning for Depression Detection in Dia-logs, (2022)
  • [7] Uddin M. Z., Dysthe K. K., Folstad A., Brandtzaeg P. B., Deep learning for prediction of depressive symptoms in a large textual dataset, Neural Computing and Applications, (2021)
  • [8] Naseem U., Dunn A. G., Kim J., Khushi M., Early Identification of Depression Sever-ity Levels on Reddit Using Ordinal Classification, Proceedings of the ACM Web Conference 2022, (2022)
  • [9] Kilaskar M., Saindane N., Ansari N., Doshi D., Kulkarni M., Machine Learning Algo-rithms for Analysis and Prediction of Depression, SN Computer Science, 3, 2, (2021)
  • [10] Aydemir E., Tuncer T., Dogan S., Gururajan R., Acharya U. R., Automated major depressive disorder detection using melamine pattern with EEG signals, Applied Intelli-gence, 51, 9, pp. 6449-6466, (2021)
12