Validation of a Spanish-language Version of a Computer Programming Aptitude Test for First-year University Students

被引:0
作者
Vasquez, Francisco [1 ]
Felipe Calderon, Juan [2 ]
Meza, Federico [1 ]
Vasquez, Andrea [3 ]
机构
[1] Univ Tecn Federico Santa Maria, Ave Vicuna Mackena 3939, Santiago 8940897, Chile
[2] Univ Andres Bello, Quillota 980, Vina Del Mar 2531015, Chile
[3] Univ Tecn Federico Santa Maria, Ave Espana 1680, Valparaiso 2390123, Chile
关键词
Programming assessment; assessment; programming aptitude; validation; cs1; quantitative research; VALIDITY;
D O I
10.1145/3579365
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
There is increasing interest in computer science and computing bachelor programs due to the growing importance of technology in the globalized world. Thus, as higher education institutions strive to serve a diverse student demographic, it is salient to gauge their programming abilities to improve guidance on learning processes regarding their initial knowledge state. Despite the availability of certain instruments to measure student programming skills, these are traditionally aimed at younger populations and do not accurately discriminate the different levels of ability among university students. This article introduces a translation into Spanish and validation of an existing English-language aptitude test for computing jobs that can be used to measure the programming abilities of students with no prior experience in the field. Following a cyclic research methodology, two iterations were carried out in this article. First, the aforementioned test was translated and validated via expert judgment and focus groups, in which certain items were removed subsequent to a quantitative analysis. The resultant instrument underwent a second validation using a larger population of students. Analysis conducted after the second iteration showed this instrument to deliver good internal consistency, good difficulty and discrimination indices, and a moderate correlation with the grades of the midterm exam of a programming course undertaken by first year engineering students. This work contributes to both increasing the number of tests available in the Spanish language with which to assess programming abilities, as well as to the broader literature regarding test adaptation, translation and validation.
引用
收藏
页数:20
相关论文
共 40 条
[1]  
Ally Noor, 2018, INT J LEARN TEACH, V4, P7, DOI [10.18178/ijlt.4.1.7-14, DOI 10.18178/IJLT.4.1.7-14]
[2]   Computational thinking education: Issues and challenges [J].
Angeli, Charoula ;
Giannakos, Michail .
COMPUTERS IN HUMAN BEHAVIOR, 2020, 105
[3]  
[Anonymous], 2021, Introduction to computational thinking test questions - ks3 computer science revision - bbc bitesize
[4]  
[Anonymous], 2017, Generation CS: Computer Science Undergraduate Enrollments Surge Since 2006
[5]   (Re)Validating Cognitive Introductory Computing Instruments [J].
Bockmon, Ryan ;
Cooper, Stephen ;
Gratch, Jonathan ;
Dorodchi, Mohsen .
SIGCSE '19: PROCEEDINGS OF THE 50TH ACM TECHNICAL SYMPOSIUM ON COMPUTER SCIENCE EDUCATION, 2019, :552-557
[6]  
Borzovs Juris, 2015, P INT SCI PRACTICAL, V3, P29, DOI [10.17770/etr2015vol3.175, DOI 10.17770/ETR2015VOL3.175]
[7]   Development of Computational Thinking Skills through Unplugged Activities in Primary School [J].
Brackmann, Christian P. ;
Roman-Gonzalez, Marcos ;
Robles, Gregorio ;
Moreno-Leon, Jesus ;
Casali, Ana ;
Barone, Dante .
PROCEEDINGS OF THE 12TH WORKSHOP IN PRIMARY AND SECONDARY COMPUTING EDUCATION (WIPSCE 2017), 2017, :65-72
[8]  
Cronbach LJ, 1951, PSYCHOMETRIKA, V16, P297
[9]   Towards a Common Instrument for Measuring Prior Programming Knowledge [J].
Duran, Rodrigo ;
Rybicki, Jan-Mikael ;
Hellas, Arto ;
Suoranta, Sanna .
PROCEEDINGS OF THE 2019 ACM CONFERENCE ON INNOVATION AND TECHNOLOGY IN COMPUTER SCIENCE EDUCATION (ITICSE '19), 2019, :443-449
[10]  
Ebel R.L., 1991, Essentials of Educational measurement