Dataset Open Access

A Code Token Type Taxonomy-enhanced dataset with pre-computed token types for Python150k

Le, Kim Tuyen; Rashidi, Gabriel; Andrzejak, Artur


MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nmm##2200000uu#4500</leader>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">code completion</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">accuracy evaluation</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">code token types</subfield>
  </datafield>
  <controlfield tag="005">20211129134844.0</controlfield>
  <controlfield tag="001">5733013</controlfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Heidelberg University</subfield>
    <subfield code="a">Rashidi, Gabriel</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Heidelberg University</subfield>
    <subfield code="a">Andrzejak, Artur</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">1063616115</subfield>
    <subfield code="z">md5:52f69f659e875a8c4f937552bb96830a</subfield>
    <subfield code="u">https://zenodo.org/record/5733013/files/CT3-dataset-journal-20211128.zip</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2021-11-28</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">openaire_data</subfield>
    <subfield code="o">oai:zenodo.org:5733013</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">Heidelberg University</subfield>
    <subfield code="a">Le, Kim Tuyen</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">A Code Token Type Taxonomy-enhanced dataset with pre-computed token types for Python150k</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u">https://creativecommons.org/licenses/by/4.0/legalcode</subfield>
    <subfield code="a">Creative Commons Attribution 4.0 International</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;Code Token Type Taxonomy (CT3) is a methodology for refined evaluation of ML-based code completion approaches.&lt;/p&gt;

&lt;p&gt;We published the&amp;nbsp;CT3-enhanced dataset with pre-computed token types for each token in the &lt;a href="https://www.sri.inf.ethz.ch/py150"&gt;Python150k dataset&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;The dataset was obtained from&amp;nbsp;an empirical study of the below paper:&lt;/p&gt;

&lt;p&gt;Kim Tuyen Le, Gabriel Rashidi, and Artur Andrzejak. A Methodology for Refined Evaluation of ML-based Code Completion Approaches. In &lt;em&gt;Special Issue on Programming Language Processing, Data Mining and Knowledge Discovery&lt;/em&gt;.&lt;/p&gt;

&lt;p&gt;Please read the README.txt file for detailed information of structuring the enhanced dataset.&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="a">10.5281/zenodo.5148585</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.5281/zenodo.5733013</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">dataset</subfield>
  </datafield>
</record>
50
2
views
downloads
All versions This version
Views 5030
Downloads 22
Data volume 2.1 GB2.1 GB
Unique views 3723
Unique downloads 22

Share

Cite as