Journal article Open Access

Towards online reinforced learning of assembly sequence planning with interactive guidance systems for industry 4.0 adaptive manufacturing

de Giorgio, Andrea; Maffei, Antonio; Onori, Mauro; Wang, Lihui

DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="" xmlns="" xsi:schemaLocation="">
  <identifier identifierType="URL"></identifier>
      <creatorName>de Giorgio, Andrea</creatorName>
      <familyName>de Giorgio</familyName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="">0000-0001-6064-5634</nameIdentifier>
      <affiliation>KTH Royal Institute of Technology</affiliation>
      <creatorName>Maffei, Antonio</creatorName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="">0000-0002-0723-1712</nameIdentifier>
      <affiliation>KTH Royal Institute of Technology</affiliation>
      <creatorName>Onori, Mauro</creatorName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="">0000-0002-0006-283X</nameIdentifier>
      <affiliation>KTH Royal Institute of Technology</affiliation>
      <creatorName>Wang, Lihui</creatorName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="">0000-0001-8679-8049</nameIdentifier>
      <affiliation>KTH Royal Institute of Technology</affiliation>
    <title>Towards online reinforced learning of assembly sequence planning with interactive guidance systems for industry 4.0 adaptive manufacturing</title>
    <date dateType="Issued">2021-05-11</date>
  <resourceType resourceTypeGeneral="Text">Journal article</resourceType>
    <alternateIdentifier alternateIdentifierType="url"></alternateIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsIdenticalTo">10.1016/j.jmsy.2021.05.001</relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="URL" relationType="IsPartOf"></relatedIdentifier>
    <rights rightsURI="">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
    <description descriptionType="Abstract">&lt;p&gt;Literature shows that reinforcement learning (RL) and the well-known optimization algorithms derived from it have been applied to assembly sequence planning (ASP); however, the way this is done, as an offline process, ends up generating optimization methods that are not exploiting the full potential of RL. Today&amp;rsquo;s assembly lines need to be adaptive to changes, resilient to errors and attentive to the operators&amp;rsquo; skills and needs. If all of these aspects need to evolve towards a new paradigm, called Industry 4.0, the way RL is applied to ASP needs to change as well: the RL phase has to be part of the assembly execution phase and be optimized with time and several repetitions of the process. This article presents an agile exploratory experiment in ASP to prove the effectiveness of&amp;nbsp;&lt;a href=""&gt;RL techniques&lt;/a&gt;&amp;nbsp;to execute ASP as an adaptive, online and experience-driven optimization process, directly at assembly time. The human-assembly interaction is modelled through the input-outputs of an assembly guidance system built as an assembly digital twin. Experimental assemblies are executed without pre-established assembly sequence plans and adapted to the operators&amp;rsquo; needs. The experiments show that precedence and transition matrices for an assembly can be generated from the statistical knowledge of several different assembly executions. When the frequency of a given&amp;nbsp;&lt;a href=""&gt;subassembly&lt;/a&gt;&amp;nbsp;reinforces its importance, statistical results obtained from the experiments prove that online RL applications are not only possible but also effective for learning, teaching, executing and improving assembly tasks at the same time. This article paves the way towards the application of online RL algorithms to ASP.&lt;/p&gt;</description>
Views 7
Downloads 6
Data volume 77.3 MB
Unique views 6
Unique downloads 5


Cite as