Development of an assessment tool for collaborative problem-solving skills in chemistry

被引：0

作者：

Yike Ying ^{[1
]}

Rüdiger Tiemann ^{[1
]}

机构：

[1] Department of Chemistry, Humboldt-Universität zu Berlin, Brook-Taylor Str. 2, Berlin

来源：

Disciplinary and Interdisciplinary Science Education Research | / 6卷 / 1期

关键词：

Assessment tool; Chemistry; Collaborative problem-solving; STEM education;

D O I：

10.1186/s43031-024-00116-6

中图分类号：

学科分类号：

摘要：

Collaborative problem-solving (CPS) skills are recognised as an essential aspect of 21st century skills and STEM education. In the STEM framework, students’ CPS skills in the learning process need to be appropriately monitored, yet assessment tools for students’ CPS skills are currently not widely developed in chemistry. This study aimed to develop and validate the assessment tool for measuring high school students’ collaborative problem-solving skills in chemistry (CPS-C). Fifty-two students participated in the assessment, which included tasks on Coke Titration, Fruit Battery, and Soap Making. The data were analyzed using Multidimensional Item Response Theory (MIRT) models and the Generalized Partial Credit Model (GPCM). The results indicated that the CPS-C tool showed good internal consistency and item fit. Additionally, ten students were interviewed, and the interview content was analyzed using MAXQDA, emphasizing the importance of providing clear and concise instructions, reducing the number of tasks, and offering meaningful and relevant options. Moreover, this study also validated the reliability of cognitive ability tests, mental load and effort tests, and interest and motivation tests. The results showed satisfactory reliability for all tests except for the mental load and effort tests, which had a lower reliability coefficient of 0.68. Despite some limitations, the CPS-C tool showed great potential for effectively assessing CPS skills. Further research is needed to validate the tool’s effectiveness and reliability across larger, more diverse samples and different cultural contexts. © The Author(s) 2024.

引用

共 61 条

[11] Cho Y.H., Lim K.Y., Effectiveness of collaborative learning with 3 D virtual worlds, British Journal of Educational Technology, 48, 1, pp. 202-211, (2017)
[12] R: A language and environment for statistical computing, (Version 4.2.1) R Foundation for Statistical Computing, (2022)
[13] Flor M., Andrews-Todd J., Towards automatic annotation of collaborative problem‐solving skills in technology‐enhanced environments, Journal of Computer Assisted Learning, 38, 5, pp. 1434-1447, (2022)
[14] Graesser A.C., Dowell N., Clewley D., Assessing collaborative problem solving through conversational agents., pp. 65-80, (2017)
[15] Graesser A.C., Fiore S.M., Greiff S., Andrews-Todd J., Foltz P.W., Hesse F.W., Advancing the science of collaborative problem solving, Psychological Science in the Public Interest, 19, 2, pp. 59-92, (2018)
[16] Greiff S., From interactive to collaborative problem solving: Current issues in the Programme for International Student Assessment, Review of Psychology, 19, 2, pp. 111-121, (2012)
[17] Griffin P., Care E., Harding S.-M., Task characteristics and calibration, In Assessment and Teaching of 21St Century Skills: Methods and Approach, pp. 133-178, (2015)
[18] Hao J., Liu L., Kyllonen P., Flor M., von Davier A.A., Psychometric considerations and a general scoring strategy for assessments of collaborative problem solving, ETS Research Report Series, 2019, 1, pp. 1-17, (2019)
[19] Heller K.A., Perleth C., Kognitiver Fähigkeitstest für 4. Bis 12. Klassen, Revision: KFT 4–12 + R. Beltz-Test., (2000)
[20] Hesse F., Care E., Buder J., Sassenberg K., Griffin P., A framework for teachable collaborative problem solving skills, . Assessment and Teaching of 21St Century Skills: Methods and Approach, pp. 37-56, (2015)

← 1 2 3 4 5 6 7 →