A new paradigm for investigating real-world social behavior and its neural underpinnings

被引:0
作者
Alreja, Arish [1 ,2 ,3 ,4 ,5 ]
Ward, Michael J. [5 ,6 ]
Ma, Qianli [7 ]
Russ, Brian E. [8 ]
Bickel, Stephan [9 ]
Van Wouwe, Nelleke C. [10 ]
Gonzalez-Martinez, Jorge A. [5 ]
Neimat, Joseph S. [10 ]
Abel, Taylor J. [1 ,2 ,5 ,11 ]
Bagic, Anto [12 ]
Parker, Lisa S. [13 ]
Richardson, R. Mark [5 ,14 ,15 ]
Schroeder, Charles E. [8 ,16 ,17 ]
Morency, Louis-Philippe [7 ]
Ghuman, Avniel Singh [1 ,2 ,5 ,11 ,18 ,19 ,20 ]
机构
[1] Carnegie Mellon Univ, Ctr Neural Basis Cognit, Pittsburgh, PA 15213 USA
[2] Univ Pittsburgh, Pittsburgh, PA 15260 USA
[3] Carnegie Mellon Univ, Neurosci Inst, Pittsburgh, PA 15213 USA
[4] Carnegie Mellon Univ, Machine Learning Dept, Pittsburgh, PA 15213 USA
[5] Univ Pittsburgh, Dept Neurol Surg, Pittsburgh, PA 15260 USA
[6] Univ Calif Los Angeles, David Geffen Sch Med, Los Angeles, CA 90095 USA
[7] Carnegie Mellon Univ, Language Technol Inst, Pittsburgh, PA 15213 USA
[8] Nathan S Kline Inst Psychiat Res, Orangeburg, NY USA
[9] Northwell Hlth, Feinstein Inst Med Res, Dept Neurosurg & Neurol, Manhasset, NY USA
[10] Univ Louisville, Dept Neurol Surg, Louisville, KY 40292 USA
[11] Univ Pittsburgh, Brain Inst, Pittsburgh, PA USA
[12] Univ Pittsburgh, Dept Neurol, Pittsburgh, PA 15260 USA
[13] Univ Pittsburgh, Sch Publ Hlth, Pittsburgh, PA 15260 USA
[14] Harvard Med Sch, Dept Neurosurg, Boston, MA 02115 USA
[15] Massachusetts Gen Hosp, Boston, MA 02114 USA
[16] Columbia Univ, Dept Neurosurg, New York, NY USA
[17] Columbia Univ, Dept Psychiat, New York, NY USA
[18] Univ Pittsburgh, Dept Psychol, Pittsburgh, PA 15260 USA
[19] Univ Pittsburgh, Dept Neurobiol, Pittsburgh, PA USA
[20] Univ Pittsburgh, Dept Psychiat, Pittsburgh, PA USA
基金
美国国家卫生研究院; 美国国家科学基金会;
关键词
BRAIN ACTIVITY; FACE AREA; STIMULATION; FUSIFORM; LIFE; PERCEPTION; REGIONS; CORTEX;
D O I
10.3758/s13428-022-01882-9
中图分类号
B841 [心理学研究方法];
学科分类号
040201 ;
摘要
Eye tracking and other behavioral measurements collected from patient-participants in their hospital rooms afford a unique opportunity to study natural behavior for basic and clinical translational research. We describe an immersive social and behavioral paradigm implemented in patients undergoing evaluation for surgical treatment of epilepsy, with electrodes implanted in the brain to determine the source of their seizures. Our studies entail collecting eye tracking with other behavioral and psychophysiological measurements from patient-participants during unscripted behavior, including social interactions with clinical staff, friends, and family in the hospital room. This approach affords a unique opportunity to study the neurobiology of natural social behavior, though it requires carefully addressing distinct logistical, technical, and ethical challenges. Collecting neurophysiological data synchronized to behavioral and psychophysiological measures helps us to study the relationship between behavior and physiology. Combining across these rich data sources while participants eat, read, converse with friends and family, etc., enables clinical-translational research aimed at understanding the participants' disorders and clinician-patient interactions, as well as basic research into natural, real-world behavior. We discuss data acquisition, quality control, annotation, and analysis pipelines that are required for our studies. We also discuss the clinical, logistical, and ethical and privacy considerations critical to working in the hospital setting.
引用
收藏
页码:2333 / 2352
页数:20
相关论文
共 85 条
[1]   Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli [J].
Allison, T ;
Puce, A ;
Spencer, DD ;
McCarthy, G .
CEREBRAL CORTEX, 1999, 9 (05) :415-430
[2]   Pupil size signals mental effort deployed during multiple object tracking and predicts brain activity in the dorsal attention network and the locus coeruleus [J].
Alnaes, Dag ;
Sneve, Markus Handal ;
Espeseth, Thomas ;
Endestad, Tor ;
de Pavert, Steven Harry Pieter Van ;
Laeng, Bruno .
JOURNAL OF VISION, 2014, 14 (04)
[3]   Research in the psychological laboratory: Truth or triviality? [J].
Anderson, CA ;
Lindsay, AJ ;
Bushman, BJ .
CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE, 1999, 8 (01) :3-9
[4]   Relationship between Arousal Intensity and Heart Rate Response to Arousal [J].
Azarbarzin, Ali ;
Ostrowski, Michele ;
Hanly, Patrick ;
Younes, Magdy .
SLEEP, 2014, 37 (04) :645-653
[5]   Social neuroscience and hyperscanning techniques: Past, present and future [J].
Babiloni, Fabio ;
Astolfi, Laura .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2014, 44 :76-93
[6]   OpenFace 2.0: Facial Behavior Analysis Toolkit [J].
Baltrusaitis, Tadas ;
Zadeh, Amir ;
Lim, Yao Chong ;
Morency, Louis-Philippe .
PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, :59-66
[7]   Dynamic Modulation of Cortical Excitability during Visual Active Sensing [J].
Barczak, Annamaria ;
Haegens, Saskia ;
Ross, Deborah A. ;
McGinnis, Tammy ;
Lakatos, Peter ;
Schroeder, Charles E. .
CELL REPORTS, 2019, 27 (12) :3447-+
[8]   Lesions of the fusiform, face area impair perception of facial configuration in prosopagnosia [J].
Barton, JJS ;
Press, DZ ;
Keenan, JP ;
O'Connor, M .
NEUROLOGY, 2002, 58 (01) :71-78
[9]  
Berg JW., 2001, INFORM CONSENT LEGAL, VSecond, DOI 10.1093/oso/9780195126778.003.0023
[10]   Multiple Adjoining Word- and Face-Selective Regions in Ventral Temporal Cortex Exhibit Distinct Dynamics [J].
Boring, Matthew J. ;
Silson, Edward H. ;
Ward, Michael J. ;
Richardson, R. Mark ;
Fiez, Julie A. ;
Baker, Chris, I ;
Ghuman, Avniel Singh .
JOURNAL OF NEUROSCIENCE, 2021, 41 (29) :6314-6327