GNN-Based Depression Recognition Using Spatio-Temporal Information: A fNIRS Study

被引:24
作者
Yu, Qiao [1 ]
Wang, Rui [1 ]
Liu, Jia [1 ]
Hu, Long [1 ]
Chen, Min [1 ]
Liu, Zhongchun [2 ,3 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
[2] Wuhan Univ, Renmin Hosp, Dept Psychiat, Wuhan 430060, Peoples R China
[3] Wuhan Univ, Taikang Ctr Life & Med Sci, Wuhan 430060, Peoples R China
关键词
Depression; Functional near-infrared spectroscopy; Task analysis; Brain modeling; Feature extraction; Spatial databases; Electroencephalography; Depression Recognition; fNIRS; GNN; Spatio-temporal Feature; Functional Connectivity;
D O I
10.1109/JBHI.2022.3195066
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, depression has become an increasingly serious problem globally. Previous studies of automatic depression recognition based on functional near-Infrared spectroscopy (fNIRS) or other brain imaging techniques have shown potential to serve as auxiliary diagnosis methods that provide assistance to medical professionals. Recently, some studies have found that, besides directly using the data themselves (temporal data), the use of functional connectivity among channels (spatial data) also can be effective. In this paper, we propose a method based on Graph Neural Network (GNN) that combines both temporal and spatial features of fNIRS data for automatic depression recognition. Specifically, fNIRS data of 96 subjects were collected and pre-processed. Basic statistical metrics of each channel were extracted as temporal features, and channel connectivity (coherence and correlation) were calculated as spatial features. Point-biserial analysis was conducted on these features and depression labels as a data-driven motivation. For classification, we considered data of each subject as a graph, with temporal features as node features and spatial features as edge weights. The graphs were fed into GNNs for training and testing. Experimental results showed that our GNN-based methods realized the best depression recognition performance compared with classical machine-learning methods regarding accuracy, F1 score, and precision, especially in F1 score for over 10%.
引用
收藏
页码:4925 / 4935
页数:11
相关论文
共 40 条
[1]  
Abaeikoupaei N., 2020, IEEE T AFFECT COMPUT, DOI [10.1109/TAFFC.2020.3047582, DOI 10.1109/TAFFC.2020.3047582]
[2]   Automated EEG-based screening of depression using deep convolutional neural network [J].
Acharya, U. Rajendra ;
Oh, Shu Lih ;
Hagiwara, Yuki ;
Tan, Jen Hong ;
Adeli, Hojjat ;
Subha, D. P. .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2018, 161 :103-113
[3]   Frontal EEG asymmetry as a promising marker of depression vulnerability: summary and methodological considerations [J].
Allen, John J. B. ;
Reznik, Samantha J. .
CURRENT OPINION IN PSYCHOLOGY, 2015, 4 :93-97
[4]  
[Anonymous], 2017, P INT C LEARN REPR T
[5]   Feature-level fusion approaches based on multimodal EEG data for depression recognition [J].
Cai, Hanshu ;
Qu, Zhidiao ;
Li, Zhe ;
Zhang, Yi ;
Hu, Xiping ;
Hu, Bin .
INFORMATION FUSION, 2020, 59 (59) :127-138
[6]   fNIRS Evidence for Distinguishing Patients With Major Depression and Healthy Controls [J].
Chao, Jinlong ;
Zheng, Shuzhen ;
Wu, Hongtong ;
Wang, Dixin ;
Zhang, Xuan ;
Peng, Hong ;
Hu, Bin .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 :2211-2221
[7]   Transformer Encoder With Multi-Modal Multi-Head Attention for Continuous Affect Recognition [J].
Chen, Haifeng ;
Jiang, Dongmei ;
Sahli, Hichem .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 :4171-4183
[8]  
Chen M., 2022, ACMTRANS MULTIMEDIA, V18, P1
[9]   Negative Information Measurement at AI Edge: A New Perspective for Mental Health Monitoring [J].
Chen, Min ;
Shen, Ke ;
Wang, Rui ;
Miao, Yiming ;
Jiang, Yingying ;
Hwang, Kai ;
Hao, Yixue ;
Tao, Guangming ;
Hu, Long ;
Liu, Zhongchun .
ACM TRANSACTIONS ON INTERNET TECHNOLOGY, 2022, 22 (03)
[10]   Cognitive Wearable Robotics for Autism Perception Enhancement [J].
Chen, Min ;
Xiao, Wenjing ;
Hu, Long ;
Ma, Yujun ;
Zhang, Yin ;
Tao, Guangming .
ACM TRANSACTIONS ON INTERNET TECHNOLOGY, 2021, 21 (04)