Piloting of a Computer Science Content Knowledge Test for 10th Grade Students

被引:0
作者
Bahr, Tobias [1 ]
机构
[1] Univ Stuttgart, Inst Sci Educ, Stuttgart, Germany
来源
2024 IEEE GLOBAL ENGINEERING EDUCATION CONFERENCE, EDUCON 2024 | 2024年
关键词
Programming; Education; Instruments; Assessment tools; MODEL;
D O I
10.1109/EDUCON60312.2024.10578675
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
New (interdisciplinary) Computer Science (CS) subjects in K-12 education have been introduced in recent years. Most of them have educational plans derived from CS Frameworks such as the K-12 CS Framework. To some extent the educational plans have the same core topic areas: data and coding (including data compression and data structures), algorithms (involving variables and software projects), computers and networks (covering topics like logic tables and data transmission) and information society and data security (consisting of collection and processing of personal data and asymmetric encryption). Various Computer Science assessment tests such as the SCS1, MG-CSCI, PSIv1 and the Fairy Assessment have been developed for different age groups. These tests mostly include computational thinking, programming or topics that could be categorized in the first two core topic areas data and coding and algorithms. Hence, the research desideratum was to develop a test specifically for measuring the four core topic areas. These core topic areas are part of the educational plan of the new interdisciplinary subject IMP (Informatics, Mathematics, Physics) for secondary schools in Germany. The test was piloted with 156 (m = 117, f = 37, o = 2) 10th grade students, approximately aged 16 at the end of the lower secondary level. We used the Item-Response-Theory (IRT) to validate the test. This work in progress paper presents translated items and the psychometric evaluation of the piloted test. The contribution for both researchers and educators in the CS education research field is the set of items of the research-based CS test in the four core topic areas for 10th grade students that includes item sets for the areas computers and networks and information society and data security.
引用
收藏
页数:5
相关论文
共 51 条
[1]   Developing a Computer Science Content Knowledge Test for 10th Grade Students [J].
Bahr, Tobias .
PROCEEDINGS OF THE 18TH WIPSCE CONFERENCE IN PRIMARY AND SECONDARY COMPUTING EDUCATION RESEARCH, WIPSCE 2023, 2023,
[2]   How Challenging are Bebras Tasks? An IRT analysis based on the performance of Italian students [J].
Bellettini, Carlo ;
Lonati, Violetta ;
Malchiodi, Dario ;
Monga, Mattia ;
Morpurgo, Anna ;
Torelli, Mauro .
ITICSE'15: PROCEEDINGS OF THE 2015 ACM CONFERENCE ON INNOVATION AND TECHNOLOGY IN COMPUTER SCIENCE EDUCATION, 2015, :27-32
[3]  
Bocconi S., 2022, Reviewing Computational Thinking in Compulsory Education
[4]   Validation of the Placement Skill Inventory: A CS0/CS1 Placement Exam [J].
Bockmon, Ryan ;
Bourke, Chris .
PROCEEDINGS OF THE 54TH ACM TECHNICAL SYMPOSIUM ON COMPUTER SCIENCE EDUCATION, VOL 1, SIGCSE 2023, 2023, :39-45
[5]   (Re)Validating Cognitive Introductory Computing Instruments [J].
Bockmon, Ryan ;
Cooper, Stephen ;
Gratch, Jonathan ;
Dorodchi, Mohsen .
SIGCSE '19: PROCEEDINGS OF THE 50TH ACM TECHNICAL SYMPOSIUM ON COMPUTER SCIENCE EDUCATION, 2019, :552-557
[6]  
Bond T. G., 2007, APPL RASCH MODEL FUN, V2nd, DOI [https://doi.org/10.4324/9781410614575, DOI 10.4324/9781410614575]
[7]   Rasch Analysis for Instrument Development: Why, When, and How? [J].
Boone, William J. .
CBE-Life Sciences Education, 2016, 15 (04)
[8]  
Caspersen M.E., 2022, The Informatics Reference Framework for School
[9]   Is Rasch model analysis applicable in small sample size pilot studies for assessing item characteristics? An example using PROMIS pain behavior item bank data [J].
Chen, Wen-Hung ;
Lenderking, William ;
Jin, Ying ;
Wyrwich, Kathleen W. ;
Gelhorn, Heather ;
Revicki, Dennis A. .
QUALITY OF LIFE RESEARCH, 2014, 23 (02) :485-493
[10]   Developing a kindergarten computational thinking assessment using evidence-centered design: the case of algorithmic thinking [J].
Clarke-Midura, Jody ;
Silvis, Deborah ;
Shumway, Jessica F. ;
Lee, Victor R. ;
Kozlowski, Joseph S. .
COMPUTER SCIENCE EDUCATION, 2021, 31 (02) :117-140