Journal article Open Access

Deep Motifs and Motion Signatures

Aristidou Andreas; Cohen-Or Daniel; Hodgins Jessica K; Chrysanthou Yiorgos; Shamir Ariel

DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="" xmlns="" xsi:schemaLocation="">
  <identifier identifierType="URL"></identifier>
      <creatorName>Aristidou Andreas</creatorName>
      <affiliation>The Interdisciplinary Centre</affiliation>
      <creatorName>Cohen-Or Daniel</creatorName>
      <affiliation>Tel-Aviv University</affiliation>
      <creatorName>Hodgins Jessica K</creatorName>
      <affiliation>Carnegie Mellon University</affiliation>
      <creatorName>Chrysanthou Yiorgos</creatorName>
      <affiliation>Research Centre on Interactive Media Smart Systems and Emerging Technologies</affiliation>
      <creatorName>Shamir Ariel</creatorName>
      <affiliation>The Interdisciplinary Centre</affiliation>
    <title>Deep Motifs and Motion Signatures</title>
    <subject>Motion capture</subject>
    <subject>Motion processing</subject>
    <subject>Motion Word</subject>
    <subject>Motion Signature</subject>
    <subject>Convolutional Network,</subject>
    <subject>Triplet Loss</subject>
    <date dateType="Issued">2018-11-01</date>
  <resourceType resourceTypeGeneral="JournalArticle"/>
    <alternateIdentifier alternateIdentifierType="url"></alternateIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsIdenticalTo">10.1145/3272127.3275038</relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="URL" relationType="IsPartOf"></relatedIdentifier>
    <rights rightsURI="">Creative Commons Attribution Non Commercial No Derivatives 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
    <description descriptionType="Abstract">&lt;p&gt;Many analysis tasks for human motion rely on high-level similarity between sequences of motions, that are not an exact matches in joint angles, timing, or ordering of actions. Even the same movements performed by the same person can vary in duration and speed. Similar motions are characterized by similar sets of actions that appear frequently. In this paper we introduce motion motifs and motion signatures that are a succinct but descriptive representation of motion sequences. We first break the motion sequences to short-term movements called motion words, and then cluster the words in a high-dimensional feature space to find motifs. Hence, motifs are words that are both common and descriptive, and their distribution represents the motion sequence. To cluster words and find motifs, the challenge is to define an effective feature space, where the distances among motion words are semantically meaningful, and where variations in speed and duration are handled. To this end, we use a deep neural network to embed the motion&amp;nbsp;words into feature space using a triplet loss function. To define a signature, we choose a finite set of motion-motifs, creating a bag-of-motifs representation for the sequence. Motion signatures are agnostic to movement order, speed or duration variations, and can distinguish fine-grained differences between motions of the same class. We illustrate examples of characterizing motion sequences by motifs, and for the use of motion signatures in anumber of applications.&lt;/p&gt;</description>
    <description descriptionType="Other">This work has received funding from the European Union's Horizon 2020 Research and Innovation Programme under Grant Agreement  No 739578 and the Government of the Republic of Cyprus through the Directorate General for European Programmes, Coordination and Development.

@2018 ACM Copyright under the CC-BY-NC-ND 4.0 license (

Citation: Andreas Aristidou, Daniel Cohen-Or, Jessica K. Hodgins, Yiorgos Chrysanthou, and Ariel Shamir. 2018. Deep motifs and motion signatures. ACM Trans. Graph. 37, 6, Article 187 (December 2018), 13 pages. DOI:</description>
      <funderName>European Commission</funderName>
      <funderIdentifier funderIdentifierType="Crossref Funder ID">10.13039/501100000780</funderIdentifier>
      <awardNumber awardURI="info:eu-repo/grantAgreement/EC/H2020/739578/">739578</awardNumber>
      <awardTitle>Research Center on Interactive Media, Smart System and Emerging Technologies</awardTitle>
Views 200
Downloads 169
Data volume 4.3 GB
Unique views 175
Unique downloads 165


Cite as