Participants' Solutions Runtime Performance Data with Model Solutions Runtime Performance Data

The runtime performance data for participants' solutions as well as the model solutions the authors came up with to problems A and B.

partID - the participant ID; any ID prefixed with "fast" is a model solution for A (L1 - L3) or B (L1)

problem - the problem (either A or B)

mode - whether Copilot was used or not; NULL for model solutions (prefixed with "fast")

compiled - whether the code compiled or not (TRUE or FALSE)

passed - whether the code passed the sanity checks (TRUE or FALSE or NULL if the code did not compile or ran with errors)

IterationNumber - the iteration number for that run. Each participant's solution was run 32 times so we provide the runtime performance for each run.

Runtime (µs) - the runtime performance of the solution for that iteration in microseconds (µs)