Journal article Open Access

What's Next? Sequence Length and Impossible Loops in State Transition Measurement

Bosch, Nigel; Paquette, Luc


MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nam##2200000uu#4500</leader>
  <datafield tag="041" ind1=" " ind2=" ">
    <subfield code="a">eng</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">sequential analysis</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">transition metrics</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">simulated data</subfield>
  </datafield>
  <controlfield tag="005">20210701014818.0</controlfield>
  <controlfield tag="001">5048423</controlfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Illinois at Urbana-Champaign</subfield>
    <subfield code="a">Paquette, Luc</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1113467</subfield>
    <subfield code="z">md5:f21221200b688e73876b5fce5f3820d9</subfield>
    <subfield code="u">https://zenodo.org/record/5048423/files/-380170607.pdf</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2021-06-30</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">openaire</subfield>
    <subfield code="o">oai:zenodo.org:5048423</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="4">
    <subfield code="c">1-23</subfield>
    <subfield code="n">1</subfield>
    <subfield code="p">Journal of Educational Data Mining</subfield>
    <subfield code="v">13</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">University of Illinois at Urbana-Champaign</subfield>
    <subfield code="a">Bosch, Nigel</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">What's Next? Sequence Length and Impossible Loops in State Transition Measurement</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u">https://creativecommons.org/licenses/by-nc-nd/4.0/legalcode</subfield>
    <subfield code="a">Creative Commons Attribution Non Commercial No Derivatives 4.0 International</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">Transition metrics, which quantify the propensity for one event to follow another, are often utilized to study sequential patterns of behaviors, emotions, actions, and other states. However, little is known about the conditions in which application of transition metrics is appropriate. We report on two experiments in which we simulated sequences of states to explore the properties of common transition metrics (conditional probability, D'Mello's L, lag sequential analysis, and Yule's Q) where results should be null (i.e., random sequences). In experiment 1, we found that transition metrics produced statistically significant results with non-null effect sizes (e.g., Q &amp;gt; 0.2) when sequences of states were short. In experiment 2, we explored situations where consecutively repeated states (i.e., loops, or self-transitions) are impossible - e.g., in digital learning environments where actions such as hint requests cannot be made twice in a row. We found that impossible loops affected all transition metrics (e.g., Q = .646). Based on simulations, we recommend sequences of length 50 or more for transition metric analyses. Our software for calculating transition metrics and running simulated experiments is publicly available.</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">url</subfield>
    <subfield code="i">isCitedBy</subfield>
    <subfield code="a">https://jedm.educationaldatamining.org/index.php/JEDM/article/view/473</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="a">10.5281/zenodo.5048422</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.5281/zenodo.5048423</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">publication</subfield>
    <subfield code="b">article</subfield>
  </datafield>
</record>
120
51
views
downloads
All versions This version
Views 120120
Downloads 5151
Data volume 56.8 MB56.8 MB
Unique views 117117
Unique downloads 4949

Share

Cite as