Dataset Open Access

SOTorrent Dataset

Baltes, Sebastian; Dumani, Lorik


MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nmm##2200000uu#4500</leader>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">stack overflow</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">code snippets</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">software evolution</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">github</subfield>
  </datafield>
  <controlfield tag="005">20181215233227.0</controlfield>
  <datafield tag="500" ind1=" " ind2=" ">
    <subfield code="a">The dataset is based on the official Stack Overflow data dump released 2018-12-02 (https://archive.org/details/stackexchange) and the Google BigQuery GitHub data set queried 2018-12-09 (https://cloud.google.com/bigquery/public-data/github). Please read the license files (LICENSE.md) before using the dataset.</subfield>
  </datafield>
  <controlfield tag="001">2273117</controlfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Trier</subfield>
    <subfield code="0">(orcid)0000-0001-9567-1699</subfield>
    <subfield code="a">Dumani, Lorik</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">6591</subfield>
    <subfield code="z">md5:e079bf0648e49e77aee5053a7170df4f</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/1_create_database.sql</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1152</subfield>
    <subfield code="z">md5:aeab3d449ec3f39a5c372475ef85bdf8</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/2_load_so_from_xml.sql</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">488</subfield>
    <subfield code="z">md5:4bf83b1ea7fbe7c5eeffb403c52bd402</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/3_create_indices.sql</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">6668</subfield>
    <subfield code="z">md5:dc71eaf388f5a7bf1815dada6ee90352</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/4_create_sotorrent_tables.sql</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">495</subfield>
    <subfield code="z">md5:e719b7d430dcbfc41e9149fd7be2cbbc</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/5_create_sotorrent_user.sql</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">4575</subfield>
    <subfield code="z">md5:cea4330cba80e2bec7a66dcc6270c0d3</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/6_load_sotorrent.sql</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">544</subfield>
    <subfield code="z">md5:a747635b8d2361ab07f16460f6436054</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/7_load_postreferencegh.sql</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">457</subfield>
    <subfield code="z">md5:053033fbbc897272c6e98bd877d49d50</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/8_load_ghmatches.sql</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1537</subfield>
    <subfield code="z">md5:d3ee212014e05ba9fb924bce92c28c85</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/9_create_sotorrent_indices.sql</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">310305231</subfield>
    <subfield code="z">md5:781bd4cc1da8f0518011fa6ac0590c59</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/Badges.xml.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">5957644601</subfield>
    <subfield code="z">md5:2fb09435346d796cc7b08d8148ea771d</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/Comments.xml.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">429534808</subfield>
    <subfield code="z">md5:032869b4f42458855048e29edbf59d59</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/CommentUrl.csv.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1298240495</subfield>
    <subfield code="z">md5:5121b1659ede2e4f6ce77233cdcd973f</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/GHMatches.csv.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">38414</subfield>
    <subfield code="z">md5:dd690a9239427df0ccf2369c97285125</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/LICENSE.md</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">9880672900</subfield>
    <subfield code="z">md5:bd9a25996f530391b0dfd1f63273c1dd</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/PostBlockDiff.csv.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">21520516941</subfield>
    <subfield code="z">md5:78cba7e35e6169ea4b230174a195ace9</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/PostBlockVersion.csv.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">32335754754</subfield>
    <subfield code="z">md5:c3473175aa700784561043a4b420176f</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/PostHistory.xml.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">101780728</subfield>
    <subfield code="z">md5:3673fd8815d409b8471734de3d01fbc0</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/PostLinks.xml.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">384884156</subfield>
    <subfield code="z">md5:61e0fe853e2b33c1063d54d96a805c3b</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/PostReferenceGH.csv.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">18185586907</subfield>
    <subfield code="z">md5:ff7cbf0c93cf8efabdd9512324d8a30b</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/Posts.xml.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1035123362</subfield>
    <subfield code="z">md5:fd8e444a05d25ffa7d473f17643c6f70</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/PostVersion.csv.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1406277408</subfield>
    <subfield code="z">md5:271e15da37247800bfa5e09441e5d830</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/PostVersionUrl.csv.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1711</subfield>
    <subfield code="z">md5:76e1d6694a2f7862dd5361fd1a9a1074</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/README.md</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1060992</subfield>
    <subfield code="z">md5:45ade28bffb60ef9b05d0b5af62e599a</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/Tags.xml.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">771633742</subfield>
    <subfield code="z">md5:7f23f3308b1def66b32d4e5b5dff9995</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/TitleVersion.csv.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">633111152</subfield>
    <subfield code="z">md5:0b0fb49c71a001582219db42394a5976</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/Users.xml.gz</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1361820620</subfield>
    <subfield code="z">md5:42ae552fbdadb4bd4e02e26ec57fa070</subfield>
    <subfield code="u">https://zenodo.org/record/2273117/files/Votes.xml.gz</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2018-12-14</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">openaire_data</subfield>
    <subfield code="p">openaire_data</subfield>
    <subfield code="p">user-empirical-software-engineering</subfield>
    <subfield code="o">oai:zenodo.org:2273117</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">University of Trier</subfield>
    <subfield code="0">(orcid)0000-0002-2442-7522</subfield>
    <subfield code="a">Baltes, Sebastian</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">SOTorrent Dataset</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-empirical-software-engineering</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u">http://creativecommons.org/licenses/by-sa/4.0/legalcode</subfield>
    <subfield code="a">Creative Commons Attribution Share Alike 4.0 International</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;Stack Overflow (SO) is the most popular question-and-answer website for software developers, providing a large amount of code snippets and free-form text on a wide variety of topics. Like other software artifacts, questions and answers on SO evolve over time, for example when bugs in code snippets are fixed, code is updated to work with a more recent library version, or text surrounding a code snippet is edited for clarity. To be able to analyze how content on SO evolves, we built &lt;em&gt;SOTorrent&lt;/em&gt;, an open dataset based on the official SO data dump. &lt;em&gt;SOTorrent &lt;/em&gt;provides access to the version history of SO content at the level of whole posts and individual text or code blocks. It connects SO posts to other platforms by aggregating URLs from text blocks and comments, and by collecting references from GitHub files to SO posts. Our vision is that researchers will use &lt;em&gt;SOTorrent &lt;/em&gt;to investigate and understand the evolution of SO posts and their relation to other platforms such as GitHub.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;If you use this dataset in your work, please cite our &lt;a href="http://empirical-software.engineering/publications#msr18-sotorrent"&gt;MSR 2018 paper&lt;/a&gt; (&lt;a href="https://dblp.uni-trier.de/rec/bibtex/conf/msr/BaltesDT008"&gt;BibTex&lt;/a&gt;) or our &lt;a href="http://empirical-software.engineering/publications#msr19-sotorrent"&gt;MSR 2019 mining challenge proposal&lt;/a&gt;.&lt;/strong&gt;&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="a">10.5281/zenodo.1135262</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.5281/zenodo.2273117</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">dataset</subfield>
  </datafield>
</record>
2,385
9,134
views
downloads
All versions This version
Views 2,385545
Downloads 9,1342,347
Data volume 52.5 TB19.9 TB
Unique views 1,904442
Unique downloads 1,574454

Share

Cite as