Evaluating a Standardized ChatGPT Workflow for Data Extraction from Research Articles: A Multi-Project Study
Description
This study evaluates a standardized, project-specific ChatGPT workflow for extracting structured information from research articles. It is a multi-participant implementation evaluation. Each participant will use the supplied Extraction, Review, and Evaluation skill to organize files, preserve evidence, validate outputs, create audit records, and calculate the prespecified results. The substantive extraction rules remain the participant's frozen coding prompt.
All work completed before this registration, including TEST1 calibration, pilot, feasibility, workflow-development, and previously viewed Ground Truth, will be described as prior work and will not enter the prospective primary cohort. A previously developed prompt may be reused only if none of the participant's designated formal papers contributed to its development or revision. No prior formal-test article, coding sheet, AI output, comparison, adjudication note, or performance summary may be supplied to ChatGPT for the new prospective evaluation.
The prospective cohort begins after this document is deposited and each participant has reserved formal papers, separated formal Ground Truth, and frozen the formal extraction system.
Files
extraction-and-review-skill-standardized-evaluation (20260801).zip
Files
(221.6 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:3124d9588576e02a9002c50ed0d13310
|
69.3 kB | Preview Download |
|
md5:bcd40a5bbc72522f0ba1339fc7639e0c
|
69.9 kB | Download |
|
md5:7de2e7644bdd3130b66746d8d9d58fdc
|
22.1 kB | Preview Download |
|
md5:1b8e78e01862fbfaed540f2c40a7950a
|
43.0 kB | Download |
|
md5:30dea1aa1e54f815c02dfcd18b2669b8
|
16.0 kB | Preview Download |
|
md5:33cedffdc1208e4e6d608e1b5186dbc5
|
1.2 kB | Preview Download |