Improving measurement and prediction in personnel selection through the application of machine learning

被引:19
作者
Koenig, Nick [1 ]
Tonidandel, Scott [2 ,13 ]
Thompson, Isaac [1 ]
Albritton, Betsy [2 ]
Koohifar, Farshad [1 ]
Yankov, Georgi [3 ]
Speer, Andrew [4 ]
Hardy, Jay H. [5 ]
Gibson, Carter [1 ]
Frost, Chris [1 ]
Liu, Mengqiao [6 ]
McNeney, Denver [6 ]
Capman, John [6 ]
Lowery, Shane [6 ]
Kitching, Matthew [6 ]
Nimbkar, Anjali [6 ]
Boyce, Anthony [6 ]
Sun, Tianjun [7 ]
Guo, Feng [8 ]
Min, Hanyi [9 ]
Zhang, Bo [10 ,11 ]
Lebanoff, Logan [12 ]
Phillips, Henry [12 ]
Newton, Charles [12 ]
机构
[1] Modern Hire, Cleveland, OH USA
[2] Univ N Carolina, Charlotte, NC USA
[3] Dev Dimens Int DDI, Pittsburgh, PA USA
[4] Indiana Univ, Kelley Sch Business, Bloomington, IN USA
[5] Oregon State Univ, Corvallis, OR USA
[6] Amazon Com Inc, Seattle, WA USA
[7] Kansas State Univ, Dept Psychol Sci, Manhattan, KS USA
[8] Univ Tennessee, Dept Psychol, Chattanooga, TN USA
[9] Penn State Univ, Dept Psychol, State Coll, PA USA
[10] Univ Illinois, Sch Lab & Employment Relat, Champaign, IL USA
[11] Univ Illinois, Dept Psychol, Champaign, IL USA
[12] Soar Technol Inc, Orlando, FL USA
[13] UNC Charlotte Ringgold Stand Inst, Charlotte, NC 28223 USA
关键词
artificial intelligence; big data; machine learning; selection-methods; selection-validation; SUBGROUP DIFFERENCES; PENCIL TEST; VALIDITY; JOB; DIMENSIONS; EXERCISES; CONSTRUCTS; RATINGS; TESTS; RATER;
D O I
10.1111/peps.12608
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
Machine learning (ML) is being widely adopted by organizations to assist in selecting personnel, commonly by scoring narrative information or by eliminating the inefficiencies of human scoring. This combined article presents six such efforts from operational selection systems in actual organizations. The findings show that ML can score narrative information collected from candidates either in writing or orally in response to assessment questions (called constructed response) as accurately and reliably as human judges, but much more efficiently, making such responses more feasible to include in personnel selection and often improving validity with little or no adverse impact. Moreover, algorithms can generalize across assessment questions, and algorithms can be created to predict multiple outcomes simultaneously (e.g., productivity and turnover). ML has even been demonstrated to make job analysis more efficient by determining knowledge and skill requirements based on job descriptions. Collectively, the studies in this article illustrate the likely major impact that ML will have on the practice and science of personnel selection from this point forward.
引用
收藏
页码:1061 / 1123
页数:63
相关论文
共 95 条
[1]  
Agarwal A, 2019, PR MACH LEARN RES, V97
[2]   How Can Big Data Science Transform the Psychological Sciences? [J].
Albritton, Betsy H. ;
Tonidandel, Scott .
SPANISH JOURNAL OF PSYCHOLOGY, 2020, 23
[3]  
Alon A, 2009, INT J SELECT ASSESS, V17, P243
[4]  
[Anonymous], 2020, R LANG ENV STAT COMP
[5]   A meta-analysis of the criterion-related validity of assessment center dimensions [J].
Arthur, W ;
Day, EA ;
McNelly, TL ;
Edens, PS .
PERSONNEL PSYCHOLOGY, 2003, 56 (01) :125-154
[6]   Multiple-choice and constructed response tests of ability: Race-based subgroup performance differences on alternative paper-and-pencil test formats [J].
Arthur, W ;
Edwards, BD ;
Barrett, GV .
PERSONNEL PSYCHOLOGY, 2002, 55 (04) :985-1008
[7]   The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice [J].
Arthur, Winfred, Jr. ;
Villado, Anton J. .
JOURNAL OF APPLIED PSYCHOLOGY, 2008, 93 (02) :435-442
[8]   The Use of Mobile Devices in High-stakes Remotely Delivered Assessments and Testing [J].
Arthur, Winfred, Jr. ;
Doverspike, Dennis ;
Munoz, Gonzalo J. ;
Taylor, Jason E. ;
Carr, Alison E. .
INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, 2014, 22 (02) :113-123
[9]   Strategic Recruitment Across Borders: An Investigation of Multinational Enterprises [J].
Banks, George C. ;
Woznyj, Haley M. ;
Wesslen, Ryan S. ;
Frear, Katherine A. ;
Berka, Gregory ;
Heggestad, Eric D. ;
Gordon, Heather L. .
JOURNAL OF MANAGEMENT, 2019, 45 (02) :476-509
[10]   VALIDITY OF PERSONNEL DECISIONS - A CONCEPTUAL ANALYSIS OF THE INFERENTIAL AND EVIDENTIAL BASES [J].
BINNING, JF ;
BARRETT, GV .
JOURNAL OF APPLIED PSYCHOLOGY, 1989, 74 (03) :478-494