Development and validation of an assessment instrument of the initial programming skills

被引:0
|
作者
Costa J.M. [1 ]
Miranda G.L. [1 ]
机构
[1] Instituto de Educação da Universidade de Lisboa, Alameda da Universidade, Lisboa
来源
| 2017年 / Associacao Iberica de Sistemas e Tecnologias de Informacao卷 / 2017期
关键词
Bloom's Taxonomy; Initial Programming; Performance; Reliability; Validation;
D O I
10.17013/risti.25.66-81
中图分类号
学科分类号
摘要
Nowadays there is a noticeable lack of validated evaluation instruments that can measure the different stages of initial programming learning. For this reason, we developed an instrument from Bloom's Taxonomy that allows to compare the students' performance regardless of the programming language with which they started their learning. The instrument presents multiple choice questions for the first four levels and open-ended questions for the last two levels. After its construction, it was validated by 12 specialists and submitted to a pilotgroup (N=29) to analyze the items' reliability and difficulty. We obtained an alpha of 0,837 and positive correlation between al the test's items and the total of items with a significance level of p < 0,05. The differences between the frequency of correct answers in the items are statistically significative (Q(12)=76,767; n=29; p=0,000). These results demonstrate that the test is valid, reliable and discriminative.
引用
收藏
页码:66 / 81
页数:15
相关论文
共 50 条
  • [1] Critical Thinking Skills in Performance-Based Assessment: Instrument Development and Validation
    Adri, Junil
    Refdinal
    Ambiyar
    Abdullah, Arman Shah
    JOURNAL OF TECHNICAL EDUCATION AND TRAINING, 2022, 14 (01): : 91 - 100
  • [2] Development of an instrument to measure medical students' perceptions of the assessment environment: initial validation
    Sim, Joong Hiong
    Tong, Wen Ting
    Hong, Wei-Han
    Vadivelu, Jamuna
    Hassan, Hamimah
    MEDICAL EDUCATION ONLINE, 2015, 20
  • [3] Development and initial validation of an instrument measuring athletes' volition
    Proios, Miltiadis
    Proios, Ioannis M.
    JOURNAL OF HUMAN SPORT AND EXERCISE, 2014, 9 (04): : 761 - 772
  • [4] Development and validation of an assessment instrument for teams sports
    Alves, Luciano Santos
    De Lima, Leilane Alves
    de Oliveira, Elson Aparecido
    Lopes, Antonio
    Reverdito, Riller Silva
    E-BALONMANO COM, 2022, 18 (03): : 211 - 220
  • [5] Bidimensional Structure of the Orthorexia: Development and Initial Validation of a New Instrument
    Barrada, Juan Ramon
    Roncero, Maria
    ANALES DE PSICOLOGIA, 2018, 34 (02): : 283 - 291
  • [6] Antisocial Sport Behaviors Survey: Instrument Development and Initial Validation
    Kaye, Miranda P.
    Hoar, Sharleen
    JOURNAL OF SPORT & EXERCISE PSYCHOLOGY, 2015, 37 (02): : 164 - 179
  • [7] Validation of an instrument for assessing basic science process skills in initial elementary teacher education
    Garcia-Carmona, Antonio
    Munoz-Franco, Granada
    Criado, Ana M.
    Cruz-Guzman, Marta
    INTERNATIONAL JOURNAL OF SCIENCE EDUCATION, 2024, 46 (04) : 362 - 381
  • [8] The initial development and validation of the Social Adaptability Skills Questionnaire: SASQ
    Owiti, Samuel B.
    Hauw, Denis B.
    PLOS ONE, 2023, 18 (08):
  • [9] Development and validation of the Complex Thinking Assessment Instrument (CTAI)
    Pacheco, Cristian Silva
    Herrera, Carolina Iturra
    THINKING SKILLS AND CREATIVITY, 2023, 48
  • [10] Measuring the Post-Impact of Programming MOOCs: Development and Validation of an Instrument
    Saede, Merilin
    Suviste, Reelika
    Luik, Piret
    EDUCATION SCIENCES, 2021, 11 (12):