Four Text-Mining Methods for Measuring Elaboration

被引:23
作者
Dumas, Denis [1 ]
Organisciak, Peter [1 ]
Maio, Shannon [1 ]
Doherty, Michael [2 ]
机构
[1] Univ Denver, Denver, CO 80208 USA
[2] Actors Equity Assoc, New York, NY USA
关键词
divergent thinking; elaboration; validation; text-mining; computational psychometrics; creativity; DIVERGENT THINKING TESTS; CREATIVE ACTIVITY; TORRANCE TESTS; ACHIEVEMENT; ORIGINALITY; EXPERIENCE; QUANTITY; OPENNESS; FLUENCY; QUALITY;
D O I
10.1002/jocb.471
中图分类号
G44 [教育心理学];
学科分类号
0402 ; 040202 ;
摘要
When individuals engage in divergent thinking, they vary on their Elaboration, or the degree to which they explain and embellish their responses. Although Elaboration has been considered relevant to creativity research for decades, its measurement has remained under-developed. Here, we leverage technical and methodological perspectives from the text-mining literature to posit four methods for quantifying elaboration: Unweighted Word Count, Stoplisted Inclusion, Part of Speech Inclusion, and Inverse Frequency Weighting. Although the Unweighted Word Count method is becoming typical in the field, more complex weighting methods appear to better fit the conceptualization of Elaboration. We explain the benefits of each of the included methods and demonstrate their application to responses from the Alternate Uses Task: showing that all four of these text-mining methods produced Elaboration scores with high levels of reliability, but the Stoplisted Inclusion method appeared to maximize the score validity both in terms of criteria correlations and power to discriminate among creative experts and non-experts. We offer an open-access module for creativity researchers to apply these methods to their own data via our laboratory website [].
引用
收藏
页码:517 / 531
页数:15
相关论文
共 72 条
[1]   Divergent Thinking: New Methods, Recent Research, and Extended Theory [J].
Acar, Selcuk ;
Runco, Mark A. .
PSYCHOLOGY OF AESTHETICS CREATIVITY AND THE ARTS, 2019, 13 (02) :153-158
[2]   How Divergent Thinking Tests Mislead Us: Are the Torrance Tests Still Relevant in the 21st Century? The Division 10 Debate [J].
Baer, John .
PSYCHOLOGY OF AESTHETICS CREATIVITY AND THE ARTS, 2011, 5 (04) :309-313
[4]   Creativity, intelligence, and personality: A critical review of the scattered literature [J].
Batey, Mark ;
Furnham, Adrian .
GENETIC SOCIAL AND GENERAL PSYCHOLOGY MONOGRAPHS, 2006, 132 (04) :355-429
[5]   Divergent Thinking in Italian Students with and Without Reading Impairments [J].
Bigozzi, Lucia ;
Tarchi, Christian ;
Pinto, Giuliana ;
Donfrancesco, Renato .
INTERNATIONAL JOURNAL OF DISABILITY DEVELOPMENT AND EDUCATION, 2016, 63 (04) :450-466
[6]  
Bourassa M, 2000, CREATIVITY RES J, V13, P411
[7]   Between facets and domains: 10 aspects of the big five [J].
DeYoung, Colin G. ;
Quilty, Lena C. ;
Peterson, Jordan B. .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 2007, 93 (05) :880-896
[8]   \Assessment of Real-Life Creativity: The Inventory of Creative Activities and Achievements (ICAA) [J].
Diedrich, Jennifer ;
Jauk, Emanuel ;
Silvia, Paul J. ;
Gredlein, Jeffrey M. ;
Neubauer, Aljoscha C. ;
Benedek, Mathias .
PSYCHOLOGY OF AESTHETICS CREATIVITY AND THE ARTS, 2018, 12 (03) :304-316
[9]   The psychology of professional and student actors: Creativity, personality, and motivation [J].
Dumas, Denis ;
Doherty, Michael ;
Organisciak, Peter .
PLOS ONE, 2020, 15 (10)
[10]   Measuring Divergent Thinking Originality With Human Raters and Text-Mining Models: A Psychometric Comparison of Methods [J].
Dumas, Denis ;
Organisciak, Peter ;
Doherty, Michael .
PSYCHOLOGY OF AESTHETICS CREATIVITY AND THE ARTS, 2021, 15 (04) :645-663