Published November 7, 2025 | Version v1
Dataset Open

Supplementary materials for the paper "Understanding Student Interaction with AI-Powered Next-Step Hints: Strategies and Challenges"

  • 1. JetBrains Research
  • 2. Utrecht University

Description

This is the supplementary material for the paper "Understanding Student Interaction with AI-Powered Next-Step Hints: Strategies and Challenges".

- The PDF file contains our interview script.  

- The hints_dataset directory includes preprocessed data about the hint requests we collected. The dataset is organized by student, with one directory per student. Inside each folder, you'll find HTML files representing individual hint-request scenarios in a user-friendly format for manual analysis. These reports can be opened in any browser, showing all student actions related to the scenario. This includes hint information, keystroke data, IDE interactions, and details about opened files and tool windows.  

- The raw_dataset directory contains unprocessed data related to the task-solving process (excluding hint information), allowing this data to be reused for other studies or tasks. The data was collected using the the KOALA tool and is saved as several CSV files:

  • activitydata.csv: Logs of activities performed in the IDE, such as running code, building projects, and using keyboard shortcuts.  
  • documentdata.csv: Snapshots of the student's current code.  
  • fileeditordata.csv: Logs of opening, closing, and switching between files.  
  • toolwindowdata.csv: Information about tool windows accessed, like the Build window, Version Control, Terminal, etc.

Files

ai_hints_interaction.zip

Files (54.6 MB)

Name Size Download all
md5:577d7874155222eef307d582dd0a9aca
54.6 MB Preview Download