Using cognitive interviews and think-aloud protocols to understand thought processes

被引:135
作者
Wolcott, Michael D. [1 ]
Lobczowski, Nikki G. [2 ]
机构
[1] Univ N Carolina, UNC Eshelman Sch Pharm, 321 Beard Hall, Chapel Hill, NC 27599 USA
[2] Carnegie Mellon Univ, Human Comp Interact Inst, 5000 Forbes Ave, Pittsburgh, PA 15213 USA
关键词
Research methods; Cognitive interview; Think-aloud protocols; Qualitative methods; MEDICAL-EDUCATION; VALIDITY;
D O I
10.1016/j.cptl.2020.09.005
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Our situation: Cognitive interviews (CIs) and think-aloud protocols (TAPs) are two strategies that offer unique approaches to capture participant thought processes when engaging with instruments and interventions. In this paper, we describe the origins of CIs and TAPs, the types of research questions they can be used to address, and strategies to implement these approaches. Methodological literature review: CIs and TAPs are interview methods that make thought processes more explicit. CIs include targeted interview questions that are focused on evaluating participant comprehension during an activity, such as a survey. TAPs request the participant to think-aloud while they solve a problem or complete a task; this is to help understand the problem-solving process. Our recommendations and their applications: An understanding of the research aim is critical to identify whether a CI or TAP is preferred. Researchers should ensure that participants are selected based on the needs of the research and that they are appropriately prepared for the selected interview type. Individuals can analyze verbal reports from CIs and TAPs using qualitative and quantitative methods, and researchers are encouraged to disseminate their findings to inform design practices of other researchers. Potential impact: CIs and TAPs are methods that help pharmacy education researchers explore thought processes; specifically, these methods are useful to study test response processes, improve survey construction, and map cognitive models of complex thought processes. CIs and TAPs are methodologies that should be in the toolbox of pharmacy education researchers to support design, evaluation, and refinement of instruments and educational interventions.
引用
收藏
页码:181 / 188
页数:8
相关论文
共 30 条
[1]   Research synthesis: The practice of cognitive interviewing [J].
Beatty, Paul C. ;
Willis, Gordon B. .
PUBLIC OPINION QUARTERLY, 2007, 71 (02) :287-311
[2]   Quantifying qualitative analyses of verbal data: A practical guide [J].
Chi, MTH .
JOURNAL OF THE LEARNING SCIENCES, 1997, 6 (03) :271-315
[3]  
Collins D., 2015, Cognitive Interviewing Practice
[4]   Trust me, it is valid: Research validity in pharmacy education research [J].
Cor, Mathew Kenneth .
CURRENTS IN PHARMACY TEACHING AND LEARNING, 2016, 8 (03) :391-400
[5]  
Eccles DW, 2017, QUAL RES SPORT EXERC, V9, P514, DOI 10.1080/2159676X.2017.1331501
[6]  
Ericsson K., 1993, PROTOCOL ANAL VERBAL
[7]   VERBAL REPORTS AS DATA [J].
ERICSSON, KA ;
SIMON, HA .
PSYCHOLOGICAL REVIEW, 1980, 87 (03) :215-251
[8]   The cognitive process of test takers when using the script concordance test rating scale [J].
Gawad, Nada ;
Wood, Timothy J. ;
Cowley, Lindsay ;
Raiche, Isabelle .
MEDICAL EDUCATION, 2020, 54 (04) :337-347
[9]   Effects of a Science of Learning Course on College Students' Learning With a Computer [J].
Greene, Jeffrey A. ;
Lobczowski, Nikki G. ;
Freed, Rebekah ;
Cartiff, Brian M. ;
Demetriou, Cynthia ;
Panter, A. T. .
AMERICAN EDUCATIONAL RESEARCH JOURNAL, 2020, 57 (03) :947-978
[10]  
Greene JA, 2011, EDUC PSYCHOL HANDB, P313