Development of an assessment tool for collaborative problem-solving skills in chemistry

被引：0
作者：
Yike Ying [1 ]
Rüdiger Tiemann [1 ]
机构：
[1] Department of Chemistry, Humboldt-Universität zu Berlin, Brook-Taylor Str. 2, Berlin
来源：
Disciplinary and Interdisciplinary Science Education Research | / 6卷 / 1期
关键词：
Assessment tool; Chemistry; Collaborative problem-solving; STEM education;
D O I：
10.1186/s43031-024-00116-6
中图分类号：
学科分类号：
摘要：
Collaborative problem-solving (CPS) skills are recognised as an essential aspect of 21st century skills and STEM education. In the STEM framework, students’ CPS skills in the learning process need to be appropriately monitored, yet assessment tools for students’ CPS skills are currently not widely developed in chemistry. This study aimed to develop and validate the assessment tool for measuring high school students’ collaborative problem-solving skills in chemistry (CPS-C). Fifty-two students participated in the assessment, which included tasks on Coke Titration, Fruit Battery, and Soap Making. The data were analyzed using Multidimensional Item Response Theory (MIRT) models and the Generalized Partial Credit Model (GPCM). The results indicated that the CPS-C tool showed good internal consistency and item fit. Additionally, ten students were interviewed, and the interview content was analyzed using MAXQDA, emphasizing the importance of providing clear and concise instructions, reducing the number of tasks, and offering meaningful and relevant options. Moreover, this study also validated the reliability of cognitive ability tests, mental load and effort tests, and interest and motivation tests. The results showed satisfactory reliability for all tests except for the mental load and effort tests, which had a lower reliability coefficient of 0.68. Despite some limitations, the CPS-C tool showed great potential for effectively assessing CPS skills. Further research is needed to validate the tool’s effectiveness and reliability across larger, more diverse samples and different cultural contexts. © The Author(s) 2024.
引用
收藏
相关论文
共 61 条
  • [1] Arnold K., Eberle A., Fleischer H., Hein A., Kronabel C., Luttgens U., Malz R., Peters J., Rehm H., (2018)
  • [2] Avry S., Chanel G., Betrancourt M., Molinari G., Achievement appraisals, emotions and socio-cognitive processes: How they interplay in collaborative problem-solving?, Computers in Human Behavior, 107, (2020)
  • [3] Backfisch I., Franke U., Ohla K., Scholtz N., Lachner A., Collaborative design practices in pre-service teacher education for technological pedagogical content knowledge (TPACK): Group composition matters, Unterrichtswissenschaft, 51, 4, pp. 579-604, (2023)
  • [4] Bauer A., Popovic Z., Collaborative problem solving in an open-ended scientific discovery game, Proceedings of the ACM on Human-Computer Interaction, 1, CSCW, pp. 1-21, (2017)
  • [5] Cai H., Lin L., Gu X., Using a semantic diagram to structure a collaborative problem solving process in the classroom, Educational Technology Research and Development, 64, 6, pp. 1207-1225, (2016)
  • [6] Care E., Griffin P., An Approach to Assessment of Collaborative Problem solving, Research and Practice in Technology Enhanced Learning, 9, pp. 367-388, (2014)
  • [7] Care E., Griffin P., Scoular C., Awwal N., Zoanetti N., Collaborative problem solving tasks, Assessment and Teaching of 21St Century Skills: Methods and Approach, pp. 85-104, (2015)
  • [8] Chang C.J., Chang M.H., Chiu B.C., Liu C.C., Chiang S.H.F., Wen C.T., Hwang F.K., Wu Y.T., Chao P.Y., Lai C.H., An analysis of student collaborative problem solving activities mediated by collaborative simulations, Computers & Education, 114, pp. 222-235, (2017)
  • [9] Chen L., Yoshimatsu N., Goda Y., Okubo F., Taniguchi Y., Oi M., Konomi S., Shimada A., Ogata H., Yamada M., Direction of collaborative problem solving-based STEM learning by learning analytics approach, Research and Practice in Technology Enhanced Learning, 14, (2019)
  • [10] Chen L., Inoue K., Goda Y., Okubo F., Taniguchi Y., Oi M., Konomi S., Ogata H., Yamada M., Exploring factors that influence collaborative problem solving awareness in science education, Technology Knowledge and Learning, 25, pp. 337-366, (2020)
1234567