Data from: ChatGPT performance on radiation technologist and therapist entry to practice exams

This dataset contains the data needed to reproduce all results and figures described in "ChatGPT performance on radiation technologist and therapist entry to practice exams".

Details about the data collection can be found in the paper referenced below. Briefly, ChatGPT (GPT-4) was prompted with multiple choice questions from 4 practice exams provided by the Canadian Association of Medical Radiation Technologists (CAMRT). ChatGPT was promted with the questions from each exam 5 times between July 17 and August 13, 2023. Table 1, below, provides details about the dates for data collection.

Variable descriptions

• question: Question number, provided by CAMRT. Skipped question numbers indicate image-based questions that were excluded from the study.
• discipline: Indicates the CAMRT exam discipline, abbreviated as follows 
  • RAD: radiological technology
  • MRI: magnetic resonance
  • NUC: nuclear medicine
  • RTT: radiation therapy
• question_type: Indicates the type of competency being assessed by the question (Knowledge, Application, or Critical thinking). Competency categories were assigned by CAMRT.
• corrrect_response: The correct multiple choice response ("A", "B", "C", or "D"), assigned by CAMRT.
• attempt1-5: ChatGPT's response to the multiple choice questions for attempts 1 through 5, indicated using the letters "A", "B", "C", or "D". In a few cases, ChatGPT did not provide a reference to a multiple choice response and "NA" is recorded in the dataset. 

Note: The long-form questions from CAMRT and answers provided by ChatGPT are not available as a part of this dataset.

Table 1: Dates for data collection