A new paradigm for investigating real-world social behavior and its neural underpinnings

被引:0
作者
Alreja, Arish [1 ,2 ,3 ,4 ,5 ]
Ward, Michael J. [5 ,6 ]
Ma, Qianli [7 ]
Russ, Brian E. [8 ]
Bickel, Stephan [9 ]
Van Wouwe, Nelleke C. [10 ]
Gonzalez-Martinez, Jorge A. [5 ]
Neimat, Joseph S. [10 ]
Abel, Taylor J. [1 ,2 ,5 ,11 ]
Bagic, Anto [12 ]
Parker, Lisa S. [13 ]
Richardson, R. Mark [5 ,14 ,15 ]
Schroeder, Charles E. [8 ,16 ,17 ]
Morency, Louis-Philippe [7 ]
Ghuman, Avniel Singh [1 ,2 ,5 ,11 ,18 ,19 ,20 ]
机构
[1] Carnegie Mellon Univ, Ctr Neural Basis Cognit, Pittsburgh, PA 15213 USA
[2] Univ Pittsburgh, Pittsburgh, PA 15260 USA
[3] Carnegie Mellon Univ, Neurosci Inst, Pittsburgh, PA 15213 USA
[4] Carnegie Mellon Univ, Machine Learning Dept, Pittsburgh, PA 15213 USA
[5] Univ Pittsburgh, Dept Neurol Surg, Pittsburgh, PA 15260 USA
[6] Univ Calif Los Angeles, David Geffen Sch Med, Los Angeles, CA 90095 USA
[7] Carnegie Mellon Univ, Language Technol Inst, Pittsburgh, PA 15213 USA
[8] Nathan S Kline Inst Psychiat Res, Orangeburg, NY USA
[9] Northwell Hlth, Feinstein Inst Med Res, Dept Neurosurg & Neurol, Manhasset, NY USA
[10] Univ Louisville, Dept Neurol Surg, Louisville, KY 40292 USA
[11] Univ Pittsburgh, Brain Inst, Pittsburgh, PA USA
[12] Univ Pittsburgh, Dept Neurol, Pittsburgh, PA 15260 USA
[13] Univ Pittsburgh, Sch Publ Hlth, Pittsburgh, PA 15260 USA
[14] Harvard Med Sch, Dept Neurosurg, Boston, MA 02115 USA
[15] Massachusetts Gen Hosp, Boston, MA 02114 USA
[16] Columbia Univ, Dept Neurosurg, New York, NY USA
[17] Columbia Univ, Dept Psychiat, New York, NY USA
[18] Univ Pittsburgh, Dept Psychol, Pittsburgh, PA 15260 USA
[19] Univ Pittsburgh, Dept Neurobiol, Pittsburgh, PA USA
[20] Univ Pittsburgh, Dept Psychiat, Pittsburgh, PA USA
基金
美国国家卫生研究院; 美国国家科学基金会;
关键词
BRAIN ACTIVITY; FACE AREA; STIMULATION; FUSIFORM; LIFE; PERCEPTION; REGIONS; CORTEX;
D O I
10.3758/s13428-022-01882-9
中图分类号
B841 [心理学研究方法];
学科分类号
040201 ;
摘要
Eye tracking and other behavioral measurements collected from patient-participants in their hospital rooms afford a unique opportunity to study natural behavior for basic and clinical translational research. We describe an immersive social and behavioral paradigm implemented in patients undergoing evaluation for surgical treatment of epilepsy, with electrodes implanted in the brain to determine the source of their seizures. Our studies entail collecting eye tracking with other behavioral and psychophysiological measurements from patient-participants during unscripted behavior, including social interactions with clinical staff, friends, and family in the hospital room. This approach affords a unique opportunity to study the neurobiology of natural social behavior, though it requires carefully addressing distinct logistical, technical, and ethical challenges. Collecting neurophysiological data synchronized to behavioral and psychophysiological measures helps us to study the relationship between behavior and physiology. Combining across these rich data sources while participants eat, read, converse with friends and family, etc., enables clinical-translational research aimed at understanding the participants' disorders and clinician-patient interactions, as well as basic research into natural, real-world behavior. We discuss data acquisition, quality control, annotation, and analysis pipelines that are required for our studies. We also discuss the clinical, logistical, and ethical and privacy considerations critical to working in the hospital setting.
引用
收藏
页码:2333 / 2352
页数:20
相关论文
共 85 条
[51]   An autonomous implantable computer for neural recording and stimulation in unrestrained primates [J].
Mavoori, J ;
Jackson, A ;
Diorio, C ;
Fetz, E .
JOURNAL OF NEUROSCIENCE METHODS, 2005, 148 (01) :71-77
[52]   Pupil Diameter Covaries With BOLD Activity in Human Locus Coeruleus [J].
Murphy, Peter R. ;
O'Connell, Redmond G. ;
O'Sullivan, Michael ;
Robertson, Ian H. ;
Balsters, Joshua H. .
HUMAN BRAIN MAPPING, 2014, 35 (08) :4140-4154
[53]   Pupillometry and P3 index the locus coeruleus-noradrenergic arousal function in humans [J].
Murphy, Peter R. ;
Robertson, Ian H. ;
Balsters, Joshua H. ;
O'connell, Redmond G. .
PSYCHOPHYSIOLOGY, 2011, 48 (11) :1531-1542
[54]  
Muszynski Michal, 2020, Proc ACM Int Conf Multimodal Interact, V2020, P70, DOI 10.1145/3382507.3418859
[55]   Using DeepLabCut for 3D markerless pose estimation across species and behaviors [J].
Nath, Tanmay ;
Mathis, Alexander ;
Chen, An Chi ;
Patel, Amir ;
Bethge, Matthias ;
Mathis, Mackenzie Weygandt .
NATURE PROTOCOLS, 2019, 14 (07) :2152-2176
[56]   Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data [J].
Nielsen, AA .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2002, 11 (03) :293-305
[57]   Fear Thou Not: Activity of Frontal and Temporal Circuits in Moments of Real-Life Courage [J].
Nili, Uri ;
Goldberg, Hagar ;
Weizman, Abraham ;
Dudai, Yadin .
NEURON, 2010, 66 (06) :949-962
[58]   Electrical Stimulation of Human Fusiform Face-Selective Regions Distorts Face Perception [J].
Parvizi, Josef ;
Jacques, Corentin ;
Foster, Brett L. ;
Withoft, Nathan ;
Rangarajan, Vinitha ;
Weiner, Kevin S. ;
Grill-Spector, Kalanit .
JOURNAL OF NEUROSCIENCE, 2012, 32 (43) :14915-14920
[59]   What is the white-coat effect and how should it be measured? [J].
Pickering, TG ;
Gerin, W ;
Schwartz, AR .
BLOOD PRESSURE MONITORING, 2002, 7 (06) :293-300
[60]   Does it make a difference if I have an eye contact with you or with your picture? An ERP study [J].
Ponkanen, Laura M. ;
Alhoniemi, Annemari ;
Leppanen, Jukka M. ;
Hietanen, Jari K. .
SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2011, 6 (04) :486-494