Published October 18, 2023 | Version 1.0.0

Dataset for algorithmic thinking skills assessment: Results from the virtual CAT pilot study in Swiss compulsory education

  • 1. Istituto Dalle Molle di Studi sull'Intelligenza Artificiale
  • 2. ROR icon Università della Svizzera italiana
  • 1. University of Applied Sciences and Arts of Southern Switzerland
  • 2. ROR icon Dalle Molle Institute for Artificial Intelligence Research
  • 3. ROR icon Università della Svizzera italiana
  • 4. École Polytechnique Fédérale de Lausanne

Description

Overview
This dataset was collected during a pilot study that evaluated the virtual Cross Array Task (CAT) platform as an assessment tool for algorithmic thinking (AT) skills among K-12 students in Swiss compulsory education.
As algorithmic thinking becomes increasingly vital in our digital age, this study bridges the gap between traditional assessments and the needs of today's learners by introducing a digital platform. The virtual CAT, a digital adaptation of an unplugged assessment activity, offers scalable, automated assessments with reduced human intervention.

Study Context, Location and Participants
To demonstrate the virtual CAT's effectiveness, we conducted a pilot study in March 2023.
The study was conducted in Switzerland, specifically within the Ticino canton.
The sample consisted of 31 students (21 girls and 10 boys) from a preschool class (ages 4-6) and two low secondary classes (1st grade, ages 11-12). 

Data Collection
Data collection was integrated into a validation module of the app. 
Sessions required manual input for details like date, canton, and school information. 
Students' details, anonymised for privacy, encompassed their gender and date of birth. 
Each interaction within the platform was meticulously logged, capturing operations like task confirmations, command updates, mode changes, and more.

Data Features
The dataset comprises the following files:

  • ALGORITHMS.csv
  • CANTONS.csv
  • DF.csv
  • LOGS.csv
  • RESULTS.csv
  • SCHOOLS.csv
  • SESSIONS.csv
  • STUDENTS_SESSIONS.csv

These files collectively provide insights into the algorithmic actions of the students, demographic details, session logs, results, and more.

Usage & Ethics
In the spirit of open science, this dataset is made available to the public after meticulous anonymisation to ensure all participants' privacy and ethical treatment. 
Initial authorisations were secured from school administrators, teachers, and parents. 
Detailed communication regarding the study's nature, data handling, and objectives was transparently shared with all stakeholders.

 

REFERENCES

[1] A. Piatti, G. Adorni, L. El-Hamamsy, L. Negrini, D. Assaf, L. Gambardella & F. Mondada. (2022). The CT-cube: A framework for the design and the assessment of computational thinking activities. Computers in Human Behavior Reports, 5, 100166. https://doi.org/10.1016/j.chbr.2021.100166

[2] Adorni, G., & Piatti, S., & Karpenko, V. (2023). virtual CAT: An app for algorithmic thinking assessment within Swiss compulsory education. Zenodo Software. https://doi.org/10.5281/zenodo.10027851 On GitHub: https://github.com/GiorgiaAuroraAdorni/virtual-CAT-app/

[3] Adorni, G., & Karpenko, V. (2023). virtual CAT programming language interpreter. Zenodo Software. https://doi.org/10.5281/zenodo.10016535 On GitHub: https://github.com/GiorgiaAuroraAdorni/virtual-CAT-programming-language-interpreter/

[4] Adorni, G., & Karpenko, V. (2023). virtual CAT data infrastructure. Zenodo Software. https://doi.org/10.5281/zenodo.10015011 On GitHub: https://github.com/GiorgiaAuroraAdorni/virtual-CAT-data-infrastructure

Files

DF.csv

Files (8.5 MB)

Name Size Download all
md5:22846ffb46e9f64f15809858f9daa233
157.1 kB Preview Download
md5:9ac52c608858ff71aa33e0d2a40a7c53
469 Bytes Preview Download
md5:c49bebfacf82912884b856504389f3ea
303.4 kB Preview Download
md5:e574023f3ffc22e647037cf613edb86c
7.9 MB Preview Download
md5:f0eee26e93c4e823eb88c1ed8ad2bb80
115.0 kB Preview Download
md5:6dd7e1701abf09e0644ccec4afdc5f0f
128 Bytes Preview Download
md5:fc6731d7b91c42f344fb034dbcc56d0f
163 Bytes Preview Download
md5:f6b0c2c424c810d37ecd54fc062157a2
3.3 kB Preview Download

Additional details

Related works

Cites
Journal article: 10.1016/j.chbr.2021.100166 (DOI)
Software: 10.5281/zenodo.10016535 (DOI)
Software: 10.5281/zenodo.10015011 (DOI)
Software: 10.5281/zenodo.10027851 (DOI)

Funding

Swiss National Science Foundation
Assessing the development of computational thinking skills through an intelligent tutoring system: an exploratory study in the cantons of St Gallen, Vaud and Ticino. 407740_187246

References