A Code Token Type Taxonomy-enhanced dataset with pre-computed token types for Python150k
Description
Code Token Type Taxonomy (CT3) is a methodology for refined evaluation of ML-based code completion approaches.
We published the CT3-enhanced dataset with pre-computed token types for each token in the Python150k dataset.
The dataset was obtained from an empirical study of the below paper:
Kim Tuyen Le, Gabriel Rashidi, and Artur Andrzejak. A Methodology for Refined Evaluation of ML-based Code Completion Approaches. In KDD Workshop on Programming Language Processing (PLP), August 14-18, 2021 (Virtual).
Please read the README.txt file for detailed information of structuring the enhanced dataset.
Files
CT3-dataset-20210729.zip
Files
(1.1 GB)
Name | Size | Download all |
---|---|---|
md5:f0bd6c8b0e13ccf1ef039f46640a6c5a
|
1.1 GB | Preview Download |