Preprint Open Access

Automatic Classification of Error Types in Solutions to Programming Assignments at Online Learning Platform

Artyom Lobanov; Timofey Bryksin; Alexey Shpilman


DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://datacite.org/schema/kernel-4" xsi:schemaLocation="http://datacite.org/schema/kernel-4 http://schema.datacite.org/meta/kernel-4.1/metadata.xsd">
  <identifier identifierType="DOI">10.5281/zenodo.2631872</identifier>
  <creators>
    <creator>
      <creatorName>Artyom Lobanov</creatorName>
      <affiliation>JetBrains Research, Higher School of Economics</affiliation>
    </creator>
    <creator>
      <creatorName>Timofey Bryksin</creatorName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="http://orcid.org/">0000-0001-9022-3563</nameIdentifier>
      <affiliation>JetBrains Research, Saint Petersburg State University</affiliation>
    </creator>
    <creator>
      <creatorName>Alexey Shpilman</creatorName>
      <affiliation>JetBrains Research, Higher School of Economics</affiliation>
    </creator>
  </creators>
  <titles>
    <title>Automatic Classification of Error Types in Solutions to Programming Assignments at Online Learning Platform</title>
  </titles>
  <publisher>Zenodo</publisher>
  <publicationYear>2019</publicationYear>
  <subjects>
    <subject>MOOC, automatic evaluation, clustering, classification, program- ming</subject>
  </subjects>
  <dates>
    <date dateType="Issued">2019-04-07</date>
  </dates>
  <language>en</language>
  <resourceType resourceTypeGeneral="Text">Preprint</resourceType>
  <alternateIdentifiers>
    <alternateIdentifier alternateIdentifierType="url">https://zenodo.org/record/2631872</alternateIdentifier>
  </alternateIdentifiers>
  <relatedIdentifiers>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.2631871</relatedIdentifier>
  </relatedIdentifiers>
  <rightsList>
    <rights rightsURI="https://creativecommons.org/licenses/by/4.0/legalcode">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
  </rightsList>
  <descriptions>
    <description descriptionType="Abstract">&lt;p&gt;&amp;nbsp;Online programming courses are becoming more and more popular, but they still have significant drawbacks when compared to the&lt;br&gt;
traditional education system, e.g., the lack of feedback. In this study, we apply machine learning methods to improve the feedback of automated verification systems for programming assignments. We propose an approach that provides an insight on how to fix the code for a given incorrect submission. To achieve this, we detect frequent error types by clustering previously submitted incorrect solutions, label these clusters and use this labeled dataset to identify the type of an error in a new submission. We examine and compare several approaches to the detection of frequent error types and to the assignment of clusters to new submissions. The proposed method is evaluated on a dataset provided by a popular online learning platform.&lt;/p&gt;</description>
  </descriptions>
</resource>
144
113
views
downloads
All versions This version
Views 144144
Downloads 113113
Data volume 19.7 MB19.7 MB
Unique views 136136
Unique downloads 106106

Share

Cite as