Smartphone-derived Virtual Keyboard Dynamics Coupled with Accelerometer Data as a Window into Understanding Brain Health Smartphone Keyboard and Accelerometer as Window into Brain Health

被引:6
作者
Ning, Emma [1 ]
Cladek, Andrea [1 ]
Ross, Mindy K. [1 ]
Kabir, Sarah [1 ]
Barve, Amruta [1 ]
Kennelly, Ellyn [2 ]
Hussain, Faraz [1 ]
Dufecy, Jennifer [1 ]
Langenecker, Scott L. [3 ]
Nguyen, Theresa [1 ]
Tulabandhula, Theja [1 ]
Zulueta, John [1 ]
Ajilore, Olusola [1 ]
Demos, Alexander P. [1 ]
Leow, Alex [1 ]
机构
[1] Univ Illinois, Chicago, IL 60680 USA
[2] Wayne State Univ, Detroit, MI USA
[3] Univ Utah, Salt Lake City, UT USA
来源
PROCEEDINGS OF THE 2023 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2023 | 2023年
关键词
Health; -; Clinical; Mobile Devices: Phones/Tablets; Empirical Study that tells us about people; Quantitative Methods; COGNITIVE DEFICITS; KEYSTROKE-DYNAMICS; BIPOLAR DISORDER; DISEASE; SLEEP; TIME; MOOD;
D O I
10.1145/3544548.3580906
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We examine the feasibility of using accelerometer data exclusively collected during typing on a custom smartphone keyboard to study whether typing dynamics are associated with daily variations in mood and cognition. As part of an ongoing digital mental health study involving mood disorders, we collected data from a well-characterized clinical sample (N = 85) and classified accelerometer data per typing session into orientation (upright vs. not) and motion (active vs. not). The mood disorder group showed lower cognitive performance despite mild symptoms (depression/mania). There were also diurnal pattern differences with respect to cognitive performance: individuals with higher cognitive performance typed faster and were less sensitive to time of day. They also exhibited more well-defined diurnal patterns in smartphone keyboard usage: they engaged with the keyboard more during the day and tapered their usage more at night compared to those with lower cognitive performance, suggesting a healthier usage of their phone.
引用
收藏
页数:15
相关论文
共 55 条
  • [1] Cognitive Rhythms: Unobtrusive and Continuous Sensing of Alertness Using a Mobile Phone
    Abdullah, Saeed
    Murnane, Elizabeth L.
    Matthews, Mark
    Kay, Matthew
    Kientz, Julie A.
    Gay, Geri
    Choudhury, Tanzeem
    [J]. UBICOMP'16: PROCEEDINGS OF THE 2016 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, 2016, : 178 - 189
  • [2] Diagnostic accuracy of keystroke dynamics as digital biomarkers for fine motor decline in neuropsychiatric disorders: a systematic review and meta-analysis
    Alfalahi, Hessa
    Khandoker, Ahsan H.
    Chowdhury, Nayeefa
    Iakovakis, Dimitrios
    Dias, Sofia B.
    Chaudhuri, K. Ray
    Hadjileontiadis, Leontios J.
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [3] Mobile phone sensors and supervised machine learning to identify alcohol use events in young adults: Implications for just-in-time adaptive interventions
    Bae, Sangwon
    Chung, Tammy
    Ferreira, Denzil
    Dey, Anind K.
    Suffoletto, Brian
    [J]. ADDICTIVE BEHAVIORS, 2018, 83 : 42 - 47
  • [4] Bedogni L, 2012, IFIP WIREL DAY
  • [5] Retrospective recall of affect in clinically depressed individuals and controls
    Ben-Zeev, Dror
    Young, Michael A.
    Madsen, Joshua W.
    [J]. COGNITION & EMOTION, 2009, 23 (05) : 1021 - 1040
  • [6] Predicting clinically relevant changes in bipolar disorder outside the clinic walls based on pervasive technology interactions via smartphone typing dynamics
    Bennett, Casey C.
    Ross, Mindy K.
    Baek, EuGene
    Kim, Dohyeon
    Leow, Alex D.
    [J]. PERVASIVE AND MOBILE COMPUTING, 2022, 83
  • [7] Bixler R., 2013, Proceedings of the 2013 International Conference on Intelligent User Interfaces, New York, NY, USA, P225, DOI [DOI 10.1145/2449396.2449426, 10.1145/2449396.2449426]
  • [8] Neuropsychological testing of cognitive impairment in euthymic bipolar disorder: an individual patient data meta-analysis
    Bourne, C.
    Aydemir, O.
    Balanza-Martinez, V.
    Bora, E.
    Brissos, S.
    Cavanagh, J. T. O.
    Clark, L.
    Cubukcuoglu, Z.
    Dias, V. V.
    Dittmann, S.
    Ferrier, I. N.
    Fleck, D. E.
    Frangou, S.
    Gallagher, P.
    Jones, L.
    Kieseppa, T.
    Martinez-Aran, A.
    Melle, I.
    Moore, P. B.
    Mur, M.
    Pfennig, A.
    Raust, A.
    Senturk, V.
    Simonsen, C.
    Smith, D. J.
    Bio, D. S.
    Soeiro-de-Souza, M. G.
    Stoddart, S. D. R.
    Sundet, K.
    Szoke, A.
    Thompson, J. M.
    Torrent, C.
    Zalla, T.
    Craddock, N.
    Andreassen, O. A.
    Leboyer, M.
    Vieta, E.
    Bauer, M.
    Worhunsky, P. D.
    Tzagarakis, C.
    Rogers, R. D.
    Geddes, J. R.
    Goodwin, G. M.
    [J]. ACTA PSYCHIATRICA SCANDINAVICA, 2013, 128 (03) : 149 - 162
  • [9] glmmTMB Balances Speed and Flexibility Among Packages for Zero-inflated Generalized Linear Mixed Modeling
    Brooks, Mollie E.
    Kristensen, Kasper
    van Benthem, Koen J.
    Magnusson, Arni
    Berg, Casper W.
    Nielsen, Anders
    Skaug, Hans J.
    Machler, Martin
    Bolker, Benjamin M.
    [J]. R JOURNAL, 2017, 9 (02): : 378 - 400
  • [10] Improving Accuracy, Applicability and Usability of Keystroke Biometrics on Mobile Touchscreen Devices
    Buschek, Daniel
    De Luca, Alexander
    Alt, Florian
    [J]. CHI 2015: PROCEEDINGS OF THE 33RD ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2015, : 1393 - 1402