Multimodal depression detection on instagram considering time interval of posts

被引:40
作者
Chiu, Chun Yueh [1 ]
Lane, Hsien Yuan [2 ,3 ]
Koh, Jia Ling [4 ]
Chen, Arbee L. P. [5 ]
机构
[1] Natl Tsing Hua Univ, Inst Informat Syst & Applicat, Hsinchu, Taiwan
[2] China Med Univ, Grad Inst Biomed Sci, Sch Med, Taichung, Taiwan
[3] China Med Univ Hosp, Dept Psychiat, Taichung, Taiwan
[4] Natl Taiwan Normal Univ, Dept Comp Sci & Informat Engn, Taipei, Taiwan
[5] Asia Univ, Dept Comp Sci & Informat Engn, Taichung, Taiwan
关键词
Depression detection; Deep learning; Social media;
D O I
10.1007/s10844-020-00599-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Depression is a common and serious mental disorder that causes a person to have sad or hopeless feelings in his/her daily life. With the rapid development of social media, people tend to express their thoughts or emotions on the social platform. Different social platforms have various formats of data presentation, which makes huge and diverse data available for analysis by researchers. In our study, we aim to detect users with depressive tendency on Instagram. We create a depression dictionary for automatically collecting data of depressive and non-depressive users. In terms of the prediction model, we construct a multimodal system, which utilizes image, text and behavior features to predict the aggregated depression score of each post on Instagram. Considering the time interval between posts, we propose a two-stage detection mechanism for detecting depressive users. Experimental results demonstrate that our proposed methods can achieve up to 0.835 F1-score for detecting depressive users. It can therefore serve as an early depression detector for a timely treatment before it becomes severe.
引用
收藏
页码:25 / 47
页数:23
相关论文
共 37 条
[1]  
Andalibi N., 2015, Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work Social Computing - CSCW'15 Companion, 2015-Janua, P231, DOI [DOI 10.1145/2685553.2699014, 10.1145/2685553.2699014]
[2]  
[Anonymous], EPJ DATA SCI
[3]  
Borth D., 2013, P 21 ACM INT C MULT, P223, DOI 10.1145/2502081.2502282
[4]  
Boski M, 2017, 2017 10TH INTERNATIONAL WORKSHOP ON MULTIDIMENSIONAL (ND) SYSTEMS (NDS)
[5]   Hierarchical Variational Memory Network for Dialogue Generation [J].
Chen, Hongshen ;
Ren, Zhaochun ;
Tang, Jiliang ;
Zhao, Yihong Eric ;
Yin, Dawei .
WEB CONFERENCE 2018: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW2018), 2018, :1653-1662
[6]  
Cong Q, 2018, IEEE INT C BIOINFORM, P1624, DOI 10.1109/BIBM.2018.8621230
[7]  
De Choudhury M., 2013, P INT AAAI C WEB SOC, P128, DOI DOI 10.1609/ICWSM.V7I1.14432
[8]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[9]  
Dos Santos C., 2014, P COLING 2014 25 INT, P69
[10]   Time, Emotion, and Depression [J].
Gallagher, Shaun .
EMOTION REVIEW, 2012, 4 (02) :127-132