Journal article Open Access

Multi-Armed Bandits for Intelligent Tutoring Systems

Clement, Benjamin; Roy, Didier; Oudeyer, Pierre-Yves; Lopes, Manuel

DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="" xmlns="" xsi:schemaLocation="">
  <identifier identifierType="DOI">10.5281/zenodo.3554668</identifier>
      <creatorName>Clement, Benjamin</creatorName>
      <affiliation>Inria, Bordeaux</affiliation>
      <creatorName>Roy, Didier</creatorName>
      <affiliation>Inria, Bordeaux</affiliation>
      <creatorName>Oudeyer, Pierre-Yves</creatorName>
      <affiliation>Inria, Bordeaux</affiliation>
      <creatorName>Lopes, Manuel</creatorName>
      <affiliation>Inria, Bordeaux</affiliation>
    <title>Multi-Armed Bandits for Intelligent Tutoring Systems</title>
    <subject>intelligent tutoring systems</subject>
    <subject>multi-armed bandits</subject>
    <subject>intrinsic motivation</subject>
    <subject>active teaching</subject>
    <subject>active learning</subject>
    <date dateType="Issued">2015-06-18</date>
  <resourceType resourceTypeGeneral="JournalArticle"/>
    <alternateIdentifier alternateIdentifierType="url"></alternateIdentifier>
    <relatedIdentifier relatedIdentifierType="URL" relationType="IsCitedBy"></relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.3554667</relatedIdentifier>
    <rights rightsURI="">Creative Commons Attribution Non Commercial No Derivatives 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
    <description descriptionType="Abstract">&lt;p&gt;We present an approach to Intelligent Tutoring Systems which adaptively personalizes sequences of learning activities to maximize skills acquired by students, taking into account the limited time and motivational resources. At a given point in time, the system proposes to the students the activity which makes them progress faster. We introduce two algorithms that rely on the empirical estimation of the learning progress, RiARiT that uses information about the difficulty of each exercise and ZPDES that uses much less knowledge about the problem. The system is based on the combination of three approaches. First, it leverages recent models of intrinsically motivated learning by transposing them to active teaching, relying on empirical estimation of learning progress provided by specific activities to particular students. Second, it uses state-of-the-art Multi-Arm Bandit (MAB) techniques to efficiently manage the exploration/exploitation challenge of this optimization process. Third, it leverages expert knowledge to constrain and bootstrap initial exploration of the MAB, while requiring only coarse guidance information of the expert and allowing the system to deal with didactic gaps in its knowledge. The system is evaluated in a scenario where 7-8 year old schoolchildren learn how to decompose numbers while manipulating money. Systematic experiments are presented with simulated students, followed by results of a user study across a population of 400 school children.&lt;/p&gt;</description>
    <description descriptionType="Other">The file is in PDF format. If your computer does not recognize it, simply download the file and then open it with your browser.</description>
All versions This version
Views 118118
Downloads 1010
Data volume 80.6 MB80.6 MB
Unique views 105105
Unique downloads 99


Cite as