Customer-Centric Science: Reporting Significant Research Results With Rigor, Relevance, and Practical Impact in Mind

被引:176
作者
Aguinis, Herman [1 ]
Werner, Steve [2 ]
Abbott, JeAnna Lanza [3 ]
Angert, Cory [2 ]
Park, Joon Hyung [2 ]
Kohlhausen, Donna
机构
[1] Indiana Univ, Dept Management & Entrepreneurship, Kelley Sch Business, Bloomington, IN 47405 USA
[2] Univ Houston, CT Bauer Coll Business, Downtown, TX USA
[3] Univ Houston, Conrad N Hilton Coll Hotel & Restaurant Managemen, Downtown, TX USA
关键词
statistical significance; practical significance; hypothesis testing; STATISTICAL SIGNIFICANCE TESTS; EFFECT SIZE; CONFIDENCE-INTERVALS; QUALITATIVE RESEARCH; ORGANIZATIONAL-PSYCHOLOGY; MULTIPLE-REGRESSION; EDITORIAL POLICIES; POWER; MANAGEMENT; KNOWLEDGE;
D O I
10.1177/1094428109333339
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
In response to the ongoing concern regarding a science-practice gap, we propose a customer-centric approach to reporting significant research results that involves a sequence of three interdependent steps. The first step involves setting an alpha level (i.e., a priori Type I error rate) that considers the relative seriousness of falsely rejecting a null hypothesis of no effect or relationship (i.e., Type I error) relative to not detecting an existing effect or relationship (i.e., Type II error) and reporting the actual observed p value (i.e., probability that the data would be obtained if the null hypothesis is true). The second step involves reporting estimates of the size of the effect or relationship, which indicate the extent to which an outcome is explained or predicted. The third step includes reporting results of a qualitative study to gather evidence regarding the practical significance of the effect or relationship. Our proposal to report research results with rigor, relevance, and practical impact involves important changes in how we report research results with the goal to bridge the science-practice gap.
引用
收藏
页码:515 / 539
页数:25
相关论文
共 112 条
[1]   On the surprising longevity of flogged horses: Why there is a case for the significance test [J].
Abelson, RP .
PSYCHOLOGICAL SCIENCE, 1997, 8 (01) :12-15
[2]   Effect size and power in assessing moderating effects of categorical variables using multiple regression: A 30-year review [J].
Aguinis, H ;
Beaty, JC ;
Boik, RJ ;
Pierce, CA .
JOURNAL OF APPLIED PSYCHOLOGY, 2005, 90 (01) :94-107
[3]   Methodological artifacts in moderated multiple regression and their effects on statistical power [J].
Aguinis, H ;
StoneRomero, EF .
JOURNAL OF APPLIED PSYCHOLOGY, 1997, 82 (01) :192-206
[4]  
AGUINIS H, RES METHODO IN PRESS, V5
[5]  
Aguinis H., 2004, Regression analysis for categorical moderators
[6]   Understanding the impact of test validity and bias on selection errors and adverse impact in human resource selection [J].
Aguinis, Herman ;
Smith, Marlene A. .
PERSONNEL PSYCHOLOGY, 2007, 60 (01) :165-199
[7]  
Aguinis H, 2009, STATISTICAL AND METHODOLOGICAL MYTHS AND URBAN LEGENDS: DOCTRINE, VERITY AND FABLE IN THE ORGANIZATIONAL AND SOCIAL SCIENCES, P267
[8]   USING WEB-BASED FRAME-OF-REFERENCE TRAINING TO DECREASE BIASES IN PERSONALITY-BASED JOB ANALYSIS: AN EXPERIMENTAL FIELD STUDY [J].
Aguinis, Herman ;
Mazurkiewicz, Mark D. ;
Heggestad, Eric D. .
PERSONNEL PSYCHOLOGY, 2009, 62 (02) :405-438
[9]   First Decade of Organizational Research Methods Trends in Design, Measurement, and Data-Analysis Topics [J].
Aguinis, Herman ;
Pierce, Charles A. ;
Bosco, Frank A. ;
Muslin, Ivan S. .
ORGANIZATIONAL RESEARCH METHODS, 2009, 12 (01) :69-112
[10]   Approximate confidence intervals for effect sizes [J].
Algina, J ;
Keselman, HJ .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2003, 63 (04) :537-553