A new paradigm for investigating real-world social behavior and its neural underpinnings

被引:0
作者
Alreja, Arish [1 ,2 ,3 ,4 ,5 ]
Ward, Michael J. [5 ,6 ]
Ma, Qianli [7 ]
Russ, Brian E. [8 ]
Bickel, Stephan [9 ]
Van Wouwe, Nelleke C. [10 ]
Gonzalez-Martinez, Jorge A. [5 ]
Neimat, Joseph S. [10 ]
Abel, Taylor J. [1 ,2 ,5 ,11 ]
Bagic, Anto [12 ]
Parker, Lisa S. [13 ]
Richardson, R. Mark [5 ,14 ,15 ]
Schroeder, Charles E. [8 ,16 ,17 ]
Morency, Louis-Philippe [7 ]
Ghuman, Avniel Singh [1 ,2 ,5 ,11 ,18 ,19 ,20 ]
机构
[1] Carnegie Mellon Univ, Ctr Neural Basis Cognit, Pittsburgh, PA 15213 USA
[2] Univ Pittsburgh, Pittsburgh, PA 15260 USA
[3] Carnegie Mellon Univ, Neurosci Inst, Pittsburgh, PA 15213 USA
[4] Carnegie Mellon Univ, Machine Learning Dept, Pittsburgh, PA 15213 USA
[5] Univ Pittsburgh, Dept Neurol Surg, Pittsburgh, PA 15260 USA
[6] Univ Calif Los Angeles, David Geffen Sch Med, Los Angeles, CA 90095 USA
[7] Carnegie Mellon Univ, Language Technol Inst, Pittsburgh, PA 15213 USA
[8] Nathan S Kline Inst Psychiat Res, Orangeburg, NY USA
[9] Northwell Hlth, Feinstein Inst Med Res, Dept Neurosurg & Neurol, Manhasset, NY USA
[10] Univ Louisville, Dept Neurol Surg, Louisville, KY 40292 USA
[11] Univ Pittsburgh, Brain Inst, Pittsburgh, PA USA
[12] Univ Pittsburgh, Dept Neurol, Pittsburgh, PA 15260 USA
[13] Univ Pittsburgh, Sch Publ Hlth, Pittsburgh, PA 15260 USA
[14] Harvard Med Sch, Dept Neurosurg, Boston, MA 02115 USA
[15] Massachusetts Gen Hosp, Boston, MA 02114 USA
[16] Columbia Univ, Dept Neurosurg, New York, NY USA
[17] Columbia Univ, Dept Psychiat, New York, NY USA
[18] Univ Pittsburgh, Dept Psychol, Pittsburgh, PA 15260 USA
[19] Univ Pittsburgh, Dept Neurobiol, Pittsburgh, PA USA
[20] Univ Pittsburgh, Dept Psychiat, Pittsburgh, PA USA
基金
美国国家卫生研究院; 美国国家科学基金会;
关键词
BRAIN ACTIVITY; FACE AREA; STIMULATION; FUSIFORM; LIFE; PERCEPTION; REGIONS; CORTEX;
D O I
10.3758/s13428-022-01882-9
中图分类号
B841 [心理学研究方法];
学科分类号
040201 ;
摘要
Eye tracking and other behavioral measurements collected from patient-participants in their hospital rooms afford a unique opportunity to study natural behavior for basic and clinical translational research. We describe an immersive social and behavioral paradigm implemented in patients undergoing evaluation for surgical treatment of epilepsy, with electrodes implanted in the brain to determine the source of their seizures. Our studies entail collecting eye tracking with other behavioral and psychophysiological measurements from patient-participants during unscripted behavior, including social interactions with clinical staff, friends, and family in the hospital room. This approach affords a unique opportunity to study the neurobiology of natural social behavior, though it requires carefully addressing distinct logistical, technical, and ethical challenges. Collecting neurophysiological data synchronized to behavioral and psychophysiological measures helps us to study the relationship between behavior and physiology. Combining across these rich data sources while participants eat, read, converse with friends and family, etc., enables clinical-translational research aimed at understanding the participants' disorders and clinician-patient interactions, as well as basic research into natural, real-world behavior. We discuss data acquisition, quality control, annotation, and analysis pipelines that are required for our studies. We also discuss the clinical, logistical, and ethical and privacy considerations critical to working in the hospital setting.
引用
收藏
页码:2333 / 2352
页数:20
相关论文
共 85 条
[41]   Sentiment Analysis of Short Informal Text [J].
Kiritchenko, Svetlana ;
Zhu, Xiaodan ;
Mohammad, Saif M. .
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2014, 50 :723-762
[42]  
KORSCH BM, 1968, PEDIATRICS, V42, P855
[43]   Don't be fooled! Attentional responses to social cues in a face-to-face and video magic trick reveals greater top-down control for overt than covert attention [J].
Kuhn, Gustav ;
Teszka, Robert ;
Tenaw, Natalia ;
Kingstone, Alan .
COGNITION, 2016, 146 :136-142
[44]  
Lauer J., 2021, bioRxiv
[45]   End-to-end Domain-Adversarial Voice Activity Detection [J].
Lavechin, Marvin ;
Gill, Marie-Philippe ;
Bousbib, Ruben ;
Bredin, Herve ;
Garcia-Perera, Leibny Paola .
INTERSPEECH 2020, 2020, :3685-3689
[46]   Posterior Fusiform and Midfusiform Contribute to Distinct Stages of Facial Expression Processing [J].
Li, Yuanning ;
Richardson, R. Mark ;
Ghuman, Avniel Singh .
CEREBRAL CORTEX, 2019, 29 (07) :3209-3219
[47]   Gaze in a real-world social interaction: A dual eye-tracking study [J].
Macdonald, Ross G. ;
Tatler, Benjamin W. .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2018, 71 (10) :2162-2173
[48]   Pretraining boosts out-of-domain robustness for pose estimation [J].
Mathis, Alexander ;
Biasi, Thomas ;
Schneider, Steffen ;
Yuksekgonul, Mert ;
Rogers, Byron ;
Bethge, Matthias ;
Mathis, Mackenzie W. .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, :1858-1867
[49]   DeepLabCut: markerless pose estimation of user-defined body parts with deep learning [J].
Mathis, Alexander ;
Mamidanna, Pranav ;
Cury, Kevin M. ;
Abe, Taiga ;
Murthy, Venkatesh N. ;
Mathis, Mackenzie Weygandt ;
Bethge, Matthias .
NATURE NEUROSCIENCE, 2018, 21 (09) :1281-+
[50]   Are We Ready for Real-world Neuroscience? [J].
Matusz, Pawel J. ;
Dikker, Suzanne ;
Huth, Alexander G. ;
Perrodin, Catherine .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2019, 31 (03) :327-338