Dataset Open Access

A Code Token Type Taxonomy-enhanced dataset with pre-computed token types for Python150k

Le, Kim Tuyen; Rashidi, Gabriel; Andrzejak, Artur


DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://datacite.org/schema/kernel-4" xsi:schemaLocation="http://datacite.org/schema/kernel-4 http://schema.datacite.org/meta/kernel-4.1/metadata.xsd">
  <identifier identifierType="DOI">10.5281/zenodo.5733013</identifier>
  <creators>
    <creator>
      <creatorName>Le, Kim Tuyen</creatorName>
      <givenName>Kim Tuyen</givenName>
      <familyName>Le</familyName>
      <affiliation>Heidelberg University</affiliation>
    </creator>
    <creator>
      <creatorName>Rashidi, Gabriel</creatorName>
      <givenName>Gabriel</givenName>
      <familyName>Rashidi</familyName>
      <affiliation>Heidelberg University</affiliation>
    </creator>
    <creator>
      <creatorName>Andrzejak, Artur</creatorName>
      <givenName>Artur</givenName>
      <familyName>Andrzejak</familyName>
      <affiliation>Heidelberg University</affiliation>
    </creator>
  </creators>
  <titles>
    <title>A Code Token Type Taxonomy-enhanced dataset with pre-computed token types for Python150k</title>
  </titles>
  <publisher>Zenodo</publisher>
  <publicationYear>2021</publicationYear>
  <subjects>
    <subject>code completion</subject>
    <subject>accuracy evaluation</subject>
    <subject>code token types</subject>
  </subjects>
  <dates>
    <date dateType="Issued">2021-11-28</date>
  </dates>
  <resourceType resourceTypeGeneral="Dataset"/>
  <alternateIdentifiers>
    <alternateIdentifier alternateIdentifierType="url">https://zenodo.org/record/5733013</alternateIdentifier>
  </alternateIdentifiers>
  <relatedIdentifiers>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.5148585</relatedIdentifier>
  </relatedIdentifiers>
  <rightsList>
    <rights rightsURI="https://creativecommons.org/licenses/by/4.0/legalcode">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
  </rightsList>
  <descriptions>
    <description descriptionType="Abstract">&lt;p&gt;Code Token Type Taxonomy (CT3) is a methodology for refined evaluation of ML-based code completion approaches.&lt;/p&gt;

&lt;p&gt;We published the&amp;nbsp;CT3-enhanced dataset with pre-computed token types for each token in the &lt;a href="https://www.sri.inf.ethz.ch/py150"&gt;Python150k dataset&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;The dataset was obtained from&amp;nbsp;an empirical study of the below paper:&lt;/p&gt;

&lt;p&gt;Kim Tuyen Le, Gabriel Rashidi, and Artur Andrzejak. A Methodology for Refined Evaluation of ML-based Code Completion Approaches. In &lt;em&gt;Special Issue on Programming Language Processing, Data Mining and Knowledge Discovery&lt;/em&gt;.&lt;/p&gt;

&lt;p&gt;Please read the README.txt file for detailed information of structuring the enhanced dataset.&lt;/p&gt;</description>
  </descriptions>
</resource>
50
2
views
downloads
All versions This version
Views 5030
Downloads 22
Data volume 2.1 GB2.1 GB
Unique views 3723
Unique downloads 22

Share

Cite as