Early detection of cognitive decline with deep learning and graph-based modeling

被引:0
作者
Patil, Sunita [1 ]
Kukreja, Swetta [1 ]
机构
[1] Amity Sch Engn & Technol, Comp Sci & Engn, Mumbai 410206, Maharashtra, India
关键词
Cognitive assessment; Deep learning; Multimodal fusion; Graph neural networks;
D O I
10.1016/j.mex.2025.103405
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In today's world, increasing stress and depression significantly impact cognitive well-being, making early detection of cognitive impairment essential for timely intervention. This work introduces a Multimodal Fusion Cognitive Assessment Framework that leverages advanced deep learning and graph intelligence to enhance early identification accuracy. Traditional tools like the Montreal Cognitive Assessment (MOCA) are limited in adaptability, prompting the need for a more dynamic, data-driven approach. The framework is validated using datasets involving cognitive tests, voice samples, and physiological signals. It enables a scalable, personalized, and adaptive cognitive assessment system that improves early detection and supports targeted intervention strategies. By integrating deep learning and information fusion, this approach addresses the complexity of cognitive health in a modern context. center dot This paper introduces Multimodal Deep Learning Integration, incorporating MOCA scores, behavioral data, speech signals, and physiological parameters using GAT, TAT, and CNN-LSTM models to capture diverse cognitive indicators . center dot The proposed model achieves superior performance through Information Fusion via Heterogeneous GNNs, effectively merging cross-domain data to enable holistic cognitive state assessment via inter-modality learning. center dot This paper applies Reinforcement Learning (RL) to personalize user interactions based on real-time cognitive and stress cues, reducing cognitive overload and enhancing engagement.
引用
收藏
页数:18
相关论文
共 40 条
[1]   Validating a novel digital performance-based assessment of data literacy: Psychometric and eye-tracking analyses [J].
Chen, Fu ;
Cui, Ying ;
Lutsyk-King, Alina ;
Gao, Yizhu ;
Liu, Xiaoxiao ;
Cutumisu, Maria ;
Leighton, Jacqueline P. .
EDUCATION AND INFORMATION TECHNOLOGIES, 2024, 29 (08) :9417-9444
[2]   Digital game-based learning: Pedagogical agent and feedback types on achievement, flow experience, and cognitive load [J].
Erdogmus, Yasemin Kahyaoglu ;
Kurt, Adile Askim .
EDUCATION AND INFORMATION TECHNOLOGIES, 2024, 29 (10) :12943-12968
[3]   Competency and Skill-Based Educational Recommendation System [J].
Feitosa, Robson Goncalves Fechine ;
de Campos, Gustavo Augusto Lima ;
de Sousa Santos, Ismayle ;
Goncalves, Carlos Hairon Ribeiro ;
de Barros Serra, Antonio ;
de Oliveira, Alisson Romao ;
Feitosa, Pedro Lucas Pereira ;
Santos, Yuri David ;
Bispo Jr, Esdras Lins ;
Esmeraldo, Guilherme Alvaro Rodrigues Maia .
INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION, 2025, 35 (01) :135-154
[4]   A multimodal neural signature of face processing in autism within the fusiform gyrus [J].
Floris, Dorothea L. ;
Llera, Alberto ;
Zabihi, Mariam ;
Moessnang, Carolin ;
Jones, Emily J. H. ;
Mason, Luke ;
Haartsen, Rianne ;
Holz, Nathalie E. ;
Mei, Ting ;
Elleaume, Camille ;
Vieira, Bruno Hebling ;
Pretzsch, Charlotte M. ;
Forde, Natalie J. ;
Baumeister, Sarah ;
Dell'Acqua, Flavio ;
Durston, Sarah ;
Banaschewski, Tobias ;
Ecker, Christine ;
Holt, Rosemary J. ;
Baron-Cohen, Simon ;
Bourgeron, Thomas ;
Charman, Tony ;
Loth, Eva ;
Murphy, Declan G. M. ;
Buitelaar, Jan K. ;
Beckmann, Christian F. ;
Holz, Nathalie E. ;
Forde, Natalie J. ;
Banaschewski, Tobias ;
Langer, Nicolas .
NATURE MENTAL HEALTH, 2025, 3 (01) :31-45
[5]   Using multimodal approach in teaching literacy to Deaf college students [J].
Francisco, Marian Patricia Bea U. ;
Padilla, Portia P. .
READING AND WRITING, 2024, 37 (04) :1035-1057
[6]   The cognitive neuroscience and neurocognitive rehabilitation of dance [J].
Hackney, Madeleine Eve ;
Burzynska, Agnieszka Zofia ;
Ting, Lena H. .
BMC NEUROSCIENCE, 2024, 25 (01)
[7]   Multimodal learning analytics for assessing teachers' self-regulated learning in planning technology-integrated lessons in a computer-based environment [J].
Huang, Lingyun ;
Doleck, Tenzin ;
Chen, Boyin ;
Huang, Xiaoshan ;
Tan, Chengyi ;
Lajoie, Susanne P. ;
Wang, Minhong .
EDUCATION AND INFORMATION TECHNOLOGIES, 2023, 28 (12) :15823-15843
[8]   Effects of teachers' rapport-building strategies on EFL learners' cognitive load and computer-assisted language learning motivation [J].
Kang, Huan ;
Chen, Hong .
EDUCATION AND INFORMATION TECHNOLOGIES, 2025, 30 (03) :3911-3952
[9]   Effects of multimodal explanations for autonomous driving on driving performance, cognitive load, expertise, confidence, and trust [J].
Kaufman, Robert ;
Costa, Jean ;
Kimani, Everlyne .
SCIENTIFIC REPORTS, 2024, 14 (01)
[10]   Effects of nonlinear dynamic online assessment model on language learners' learning outcomes and cognitive load [J].
Liu, Zhengyuan .
EDUCATION AND INFORMATION TECHNOLOGIES, 2024, 29 (18) :24255-24284