Conference paper Open Access

Wrong Answers for Wrong Reasons: The Risks of Ad Hoc Instruments

Chiodini Luca


JSON Export

{
  "files": [
    {
      "links": {
        "self": "https://zenodo.org/api/files/5dc219b6-8cd2-4cde-b2ac-8521857e351d/conditions.csv"
      }, 
      "checksum": "md5:f518ee44de3ebde9ad41154c28aed412", 
      "bucket": "5dc219b6-8cd2-4cde-b2ac-8521857e351d", 
      "key": "conditions.csv", 
      "type": "csv", 
      "size": 376
    }, 
    {
      "links": {
        "self": "https://zenodo.org/api/files/5dc219b6-8cd2-4cde-b2ac-8521857e351d/main.py"
      }, 
      "checksum": "md5:b696d416bf6ec12803615d3159dca6b0", 
      "bucket": "5dc219b6-8cd2-4cde-b2ac-8521857e351d", 
      "key": "main.py", 
      "type": "py", 
      "size": 2114
    }, 
    {
      "links": {
        "self": "https://zenodo.org/api/files/5dc219b6-8cd2-4cde-b2ac-8521857e351d/posttest_mc_anon.csv"
      }, 
      "checksum": "md5:8a6de7ab3dbd03457372ffc8859b90df", 
      "bucket": "5dc219b6-8cd2-4cde-b2ac-8521857e351d", 
      "key": "posttest_mc_anon.csv", 
      "type": "csv", 
      "size": 1322
    }, 
    {
      "links": {
        "self": "https://zenodo.org/api/files/5dc219b6-8cd2-4cde-b2ac-8521857e351d/posttest_revised_anon.csv"
      }, 
      "checksum": "md5:f0ee5dddb1da82fb4e4001aa75308e46", 
      "bucket": "5dc219b6-8cd2-4cde-b2ac-8521857e351d", 
      "key": "posttest_revised_anon.csv", 
      "type": "csv", 
      "size": 1290
    }, 
    {
      "links": {
        "self": "https://zenodo.org/api/files/5dc219b6-8cd2-4cde-b2ac-8521857e351d/pretest_mc_anon.csv"
      }, 
      "checksum": "md5:0d8f353f78be2d1fbe1aed66ea3910ba", 
      "bucket": "5dc219b6-8cd2-4cde-b2ac-8521857e351d", 
      "key": "pretest_mc_anon.csv", 
      "type": "csv", 
      "size": 1322
    }, 
    {
      "links": {
        "self": "https://zenodo.org/api/files/5dc219b6-8cd2-4cde-b2ac-8521857e351d/pretest_revised_anon.csv"
      }, 
      "checksum": "md5:f06d4ba9eb0ea7f71283d27787910e05", 
      "bucket": "5dc219b6-8cd2-4cde-b2ac-8521857e351d", 
      "key": "pretest_revised_anon.csv", 
      "type": "csv", 
      "size": 1290
    }, 
    {
      "links": {
        "self": "https://zenodo.org/api/files/5dc219b6-8cd2-4cde-b2ac-8521857e351d/questions.md"
      }, 
      "checksum": "md5:5d8989b74cb03a52a513e0d4e6e8a18b", 
      "bucket": "5dc219b6-8cd2-4cde-b2ac-8521857e351d", 
      "key": "questions.md", 
      "type": "md", 
      "size": 5763
    }, 
    {
      "links": {
        "self": "https://zenodo.org/api/files/5dc219b6-8cd2-4cde-b2ac-8521857e351d/README.md"
      }, 
      "checksum": "md5:d88aade3e28891dccd6d7670b21ae014", 
      "bucket": "5dc219b6-8cd2-4cde-b2ac-8521857e351d", 
      "key": "README.md", 
      "type": "md", 
      "size": 1917
    }
  ], 
  "owners": [
    243726
  ], 
  "doi": "10.5281/zenodo.5118719", 
  "stats": {
    "version_unique_downloads": 28.0, 
    "unique_views": 67.0, 
    "views": 77.0, 
    "version_views": 77.0, 
    "unique_downloads": 28.0, 
    "version_unique_views": 67.0, 
    "volume": 112835.0, 
    "version_downloads": 33.0, 
    "downloads": 33.0, 
    "version_volume": 112835.0
  }, 
  "links": {
    "doi": "https://doi.org/10.5281/zenodo.5118719", 
    "conceptdoi": "https://doi.org/10.5281/zenodo.5118718", 
    "bucket": "https://zenodo.org/api/files/5dc219b6-8cd2-4cde-b2ac-8521857e351d", 
    "conceptbadge": "https://zenodo.org/badge/doi/10.5281/zenodo.5118718.svg", 
    "html": "https://zenodo.org/record/5118719", 
    "latest_html": "https://zenodo.org/record/5118719", 
    "badge": "https://zenodo.org/badge/doi/10.5281/zenodo.5118719.svg", 
    "latest": "https://zenodo.org/api/records/5118719"
  }, 
  "conceptdoi": "10.5281/zenodo.5118718", 
  "created": "2021-07-21T10:27:26.888348+00:00", 
  "updated": "2021-11-22T20:46:45.897857+00:00", 
  "conceptrecid": "5118718", 
  "revision": 3, 
  "id": 5118719, 
  "metadata": {
    "access_right_category": "success", 
    "doi": "10.5281/zenodo.5118719", 
    "description": "<p>This folder contains anonymized data from the experiment described in the paper &quot;Wrong Answers for Wrong Reasons: The Risks of Ad Hoc Instruments&quot;.</p>\n\n<ul>\n\t<li><code>questions.md</code>&nbsp;contains the 14 questions used as pre/post-test</li>\n\t<li>Participants are identified using numeric identifiers (from 1 to 40).</li>\n\t<li><code>conditions.csv</code> contains the mapping between participants identifiers and their condition</li>\n\t<li>\n\t<p><code>{test}_{assessment_type}_anon.csv</code> contains data for a given test (<code>pretest</code> or <code>posttest</code>) using a certain assessment type. Two assessment types are used:</p>\n\n\t<ul>\n\t\t<li><code>mc</code> (multiple choice as assessed by Moodle: <code>0</code> means wrong, <code>1</code> means correct, <code>-</code> means missing)</li>\n\t\t<li><code>revised</code> (human revision after reading the explanation: the judgment is either a <code>0</code> or a <code>1</code> following what presented in the paper)</li>\n\t</ul>\n\t</li>\n\t<li>\n\t<p>Statistics are computed with Python and SciPy. You can execute the script by running:</p>\n\n\t<pre><code>python3 main.py\n</code></pre>\n\n\t<p>and you should get this output:</p>\n\n\t<pre><code>=== Analyzing answers using mc as assessment type ===\nResults on pretest - Condition Text: N: 21, mean \u00b1 std: 9.81 \u00b1 3.03\nResults on pretest - Condition Graphic: N: 19, mean \u00b1 std: 9.68 \u00b1 2.11\nMann Whitney U on pretest scores: U=184.0, p=0.3406\n\nResults on posttest - Condition Text: N: 21, mean \u00b1 std: 11.19 \u00b1 2.75\nResults on posttest - Condition Graphic: N: 19, mean \u00b1 std: 10.74 \u00b1 2.23\nMann Whitney U on posttest scores: U=164.0, p=0.1681\n\n=== Analyzing answers using revised as assessment type ===\nResults on pretest - Condition Text: N: 20, mean \u00b1 std: 9.15 \u00b1 3.10\nResults on pretest - Condition Graphic: N: 19, mean \u00b1 std: 7.89 \u00b1 3.16\nMann Whitney U on pretest scores: U=150.5, p=0.1344\n\nResults on posttest - Condition Text: N: 20, mean \u00b1 std: 11.15 \u00b1 2.39\nResults on posttest - Condition Graphic: N: 19, mean \u00b1 std: 9.42 \u00b1 3.11\nMann Whitney U on posttest scores: U=123.0, p=0.0299\n</code></pre>\n\n\t<p>You might need to install <code>scipy</code> (e.g., depending on your setup, <code>pip install scipy</code>).</p>\n\t</li>\n</ul>", 
    "license": {
      "id": "CC-BY-4.0"
    }, 
    "title": "Wrong Answers for Wrong Reasons: The Risks of Ad Hoc Instruments", 
    "relations": {
      "version": [
        {
          "count": 1, 
          "index": 0, 
          "parent": {
            "pid_type": "recid", 
            "pid_value": "5118718"
          }, 
          "is_last": true, 
          "last_child": {
            "pid_type": "recid", 
            "pid_value": "5118719"
          }
        }
      ]
    }, 
    "publication_date": "2021-07-21", 
    "creators": [
      {
        "orcid": "0000-0002-2712-9248", 
        "affiliation": "Software Institute - USI", 
        "name": "Chiodini Luca"
      }
    ], 
    "access_right": "open", 
    "resource_type": {
      "subtype": "conferencepaper", 
      "type": "publication", 
      "title": "Conference paper"
    }, 
    "related_identifiers": [
      {
        "scheme": "doi", 
        "identifier": "10.5281/zenodo.5118718", 
        "relation": "isVersionOf"
      }
    ]
  }
}
77
33
views
downloads
All versions This version
Views 7777
Downloads 3333
Data volume 112.8 kB112.8 kB
Unique views 6767
Unique downloads 2828

Share

Cite as