Early detection of cognitive decline with deep learning and graph-based modeling

被引:0
作者
Patil, Sunita [1 ]
Kukreja, Swetta [1 ]
机构
[1] Amity Sch Engn & Technol, Comp Sci & Engn, Mumbai 410206, Maharashtra, India
关键词
Cognitive assessment; Deep learning; Multimodal fusion; Graph neural networks;
D O I
10.1016/j.mex.2025.103405
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In today's world, increasing stress and depression significantly impact cognitive well-being, making early detection of cognitive impairment essential for timely intervention. This work introduces a Multimodal Fusion Cognitive Assessment Framework that leverages advanced deep learning and graph intelligence to enhance early identification accuracy. Traditional tools like the Montreal Cognitive Assessment (MOCA) are limited in adaptability, prompting the need for a more dynamic, data-driven approach. The framework is validated using datasets involving cognitive tests, voice samples, and physiological signals. It enables a scalable, personalized, and adaptive cognitive assessment system that improves early detection and supports targeted intervention strategies. By integrating deep learning and information fusion, this approach addresses the complexity of cognitive health in a modern context. center dot This paper introduces Multimodal Deep Learning Integration, incorporating MOCA scores, behavioral data, speech signals, and physiological parameters using GAT, TAT, and CNN-LSTM models to capture diverse cognitive indicators . center dot The proposed model achieves superior performance through Information Fusion via Heterogeneous GNNs, effectively merging cross-domain data to enable holistic cognitive state assessment via inter-modality learning. center dot This paper applies Reinforcement Learning (RL) to personalize user interactions based on real-time cognitive and stress cues, reducing cognitive overload and enhancing engagement.
引用
收藏
页数:18
相关论文
共 40 条
[11]   Cultivating independent thinkers: The triad of artificial intelligence, Bloom's taxonomy and critical thinking in assessment pedagogy [J].
Lubbe, Anitia ;
Marais, Elma ;
Kruger, Donnavan .
EDUCATION AND INFORMATION TECHNOLOGIES, 2025,
[12]   The efficacy of adaptive training in immersive virtual reality for a fine motor skill task [J].
Lui, Lasse F. ;
Radhakrishnan, Unnikrishnan ;
Chinello, Francesco ;
Koumaditis, Konstantinos .
VIRTUAL REALITY, 2025, 29 (01)
[13]  
Mack A., 2024, Discov. Educ., V3, P237, DOI [10.1007/s44217-024-00331-3, DOI 10.1007/S44217-024-00331-3]
[14]   The awareness assessment model: measuring awareness and collaboration support over participant's perspective [J].
Mantau, Marcio Jose ;
Benitti, Fabiane Barreto Vavassori .
UNIVERSAL ACCESS IN THE INFORMATION SOCIETY, 2025, 24 (01) :785-816
[15]   Cognitive biases in user experience and spreadsheet programming [J].
Mate, Domician ;
Kiss, Judit T. ;
Csernoch, Maria .
EDUCATION AND INFORMATION TECHNOLOGIES, 2025, 30 (11) :14821-14851
[16]   Multimodal creativity assessments following acute and sustained microdosing of lysergic acid diethylamide [J].
Murphy, Robin J. ;
Sumner, Rachael L. ;
Godfrey, Kate ;
Mabidikama, Acima ;
Roberts, Reece P. ;
Sundram, Frederick ;
Muthukumaraswamy, Suresh .
PSYCHOPHARMACOLOGY, 2025, 242 (02) :337-351
[17]   Perceptions of cognitive workload measurement using multimodal sensors in surgery [J].
Naik, Ravi ;
Fehervari, Matyas ;
Ali, Rayyan ;
Hazell, George ;
Kutaiman, Tarek ;
Singh, Rananjay ;
Vijayanarasimhan, Rakshith ;
Mylonas, George ;
Ashrafian, Hutan ;
Darzi, Ara .
GLOBAL SURGICAL EDUCATION - JOURNAL OF THE ASSOCIATION FOR SURGICAL EDUCATION, 2024, 3 (01)
[18]   Multimodal Deep Learning for Two-Year ENSO Forecast [J].
Naisipour, Mohammad ;
Saeedpanah, Iraj ;
Adib, Arash .
WATER RESOURCES MANAGEMENT, 2025, 39 (08) :3745-3775
[19]   Bringing the field into the lab: a novel virtual reality outdoor march simulator for evaluating cognitive and physical performance [J].
Naor, Shani Kimel ;
Ketko, Itay ;
Yanovich, Ran ;
Gottlieb, Amihai ;
Bahat, Yotam ;
Ben-Gal, Oran ;
Heled, Yuval ;
Plotnik, Meir .
VIRTUAL REALITY, 2024, 28 (02)
[20]   Multitasking, an EEG experiment: comparative analysis of cognitive workload during demanding stimuli presentation [J].
Neill, Ryan .
Neural Computing and Applications, 2025, 37 (01) :457-473