Tool Usage and Efficiency in an Online Test

In this study, we analyze data from the National Assessment of Education Progress (NAEP) digital test to understand how digital tool usage relates to the efficiency of answering the questions. Digital testing software provides students with on-screen tools such as calculators and scratchpads. We found that in the NAEP test, students who used the digital tools were slower in solving the problems, but more accurate when the question demanded the use of the tool. We also found that when students used the tool when it was not needed, they were more likely to be incorrect. Overall, our findings suggest that students need to be trained on both how to use the tools and when to use them so that they can make the most use of their testing time.