Published July 8, 2022 | Version 1
Dataset Open

A Study of Improving Mathematics Assessment Readability by using GPT-3

  • 1. Playpower Labs

Description

A Study of Improving Mathematics Assessment Readability by using GPT-3

This dataset contains 250 math word problems from EngageNY, and their automated simplifications generated using the GPT-3 engine. There are eight ways each prompt is simplified, and three samples are taken for each prompt. Some API calls can fail or return a blank string. Those responses are omitted. Readability measures for input and output passages are generated using the Common Text Analysis Platform (http://sifnos.sfs.uni-tuebingen.de/ctap/). Text similarity metrics are generated by computing the % of total words between input and output and cosine similarity of the text vectors that GPT-3 embedding API generates.

Files

readability_metrics.csv

Files (88.0 MB)

Name Size Download all
md5:bd344b8ad1fab01403e4b7bfa5e9c038
85.8 MB Preview Download
md5:75f5565457f3c8d0cd2c1407f78ee2ec
2.2 MB Preview Download