Dataset: Card Citations Without Interpretive Provenance — A Proposition-Level Audit of One Fully Automated KJ Method Run
Authors/Creators
Description
De-identified, category-level data accompanying the paper "Card Citations Without Interpretive Provenance: A Proposition-Level Audit of One Fully Automated KJ Method Run". Version 2 accompanies the revised paper. In addition to the proposition-level rows of version 1, it releases each proposition's label before adjudication, span and sentence identifiers, and the labels of the independent human coders, together with an English translation of the codebook, the fourteen issue-level adjudication rules, and the annotation instructions given to the LLM annotator. The released rows allow every aggregate distribution and agreement statistic reported in the paper to be recomputed with recompute_aggregates.py (its complete output is in expected_output.txt), and analysis_traceability.md maps every quantitative claim in the paper to its computation and verification route. The worked cases quoted in the paper and its supplementary material carry their row IDs, so their labels can be read in the released rows. A constructed, entirely fictitious practice set (the files beginning with practice_: a complete card set, a system-style summary, 30 propositions to code, and an answer key) lets readers apply the codebook end to end; it contains no real data and tests the codebook, not the paper's labels. Card texts, the students' and the system's sentences, and proposition–card correspondences are not released under the conditions of the ethics approval. See README.md for the file list, column definitions, changes from version 1, and reproduction instructions. Data and documentation are released under CC BY 4.0; the script under the MIT License.
Files
README.md
Files
(4.6 MB)
| Name | Size | |
|---|---|---|
|
md5:c28e8c9064dd67770250a55b015df37f
|
7.2 kB | Preview Download |
|
md5:320efb38f0da26a69aadb107627187e3
|
19.7 kB | Preview Download |
|
md5:cde950f86215a832f11ed289a49414c4
|
39.3 kB | Preview Download |
|
md5:5c6be466d40067da4a44480154e3175d
|
17.9 kB | Preview Download |
|
md5:5b70054e8fedc5a693890598707640d4
|
17.0 kB | Preview Download |
|
md5:ddd0799c40c05bb098e62ad7d58f3b97
|
6.5 kB | Preview Download |
|
md5:5d827d80365a4825ecdb169755532b0f
|
20.6 kB | Preview Download |
|
md5:94c1dcd87faeb643ef64bf32e0313175
|
5.6 kB | Preview Download |
|
md5:951f74f2637dfccab1c9ea9c7dab709c
|
16.1 kB | Preview Download |
|
md5:5d47f1ea0396b40dc9f9c501548064a3
|
10.7 kB | Preview Download |
|
md5:ba5bbbd2df6a7f51f1fc9a4675faf2b4
|
8.0 kB | Preview Download |
|
md5:5de7f34a770196852156ff6f17bb22cd
|
3.9 kB | Preview Download |
|
md5:2de96dcea4b7875d75ea1ff9cf288d00
|
15.0 kB | Preview Download |
|
md5:f328aa2f58c6901bc7bf80da60471746
|
12.6 kB | Download |
|
md5:c1ea3de457ff148777cef76aaca7a6bf
|
18.5 kB | Preview Download |
|
md5:b134d98f60a3bde1aa0d25e1fac7aca9
|
4.4 MB | Preview Download |