Project deliverable Open Access

WhoLoDancE: Deliverable 2.6 - Motion capture sequences and skeleton avatar

Even Zohar, Oshri; Brekelmans, Jasper; Aarts, Jochem; Heuklom, Markus

DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="" xmlns="" xsi:schemaLocation="">
  <identifier identifierType="DOI">10.5281/zenodo.1069018</identifier>
      <creatorName>Even Zohar, Oshri</creatorName>
      <familyName>Even Zohar</familyName>
      <creatorName>Brekelmans, Jasper</creatorName>
      <creatorName>Aarts, Jochem</creatorName>
      <creatorName>Heuklom, Markus</creatorName>
    <title>WhoLoDancE: Deliverable 2.6 - Motion capture sequences and skeleton avatar</title>
    <subject>motion capture sequence</subject>
    <subject>skeleton avatar</subject>
    <date dateType="Issued">2017-06-30</date>
  <resourceType resourceTypeGeneral="Text">Project deliverable</resourceType>
    <alternateIdentifier alternateIdentifierType="url"></alternateIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.1069015</relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="URL" relationType="IsPartOf"></relatedIdentifier>
    <rights rightsURI="">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
    <description descriptionType="Abstract">&lt;p&gt;The&amp;nbsp;conceptualization&amp;nbsp;development&amp;nbsp;of generic&amp;nbsp;inverse&amp;nbsp;kinematic&amp;nbsp;(1)&amp;nbsp;(IK)&amp;nbsp;avatar skeletons&amp;nbsp;for the&amp;nbsp;WhoLoDance&amp;nbsp;project&amp;nbsp;was&amp;nbsp;derived from the&amp;nbsp;guidelines and requirements that emerged from discussions with the consortium dance partners&amp;nbsp;from the project&amp;rsquo;s start and through several dance partners and technical partners meetings in the last 14 month.&amp;nbsp;&amp;nbsp;&lt;/p&gt;

&lt;p&gt;The creation of a unified performer IK Skeleton Fitting (retargeting) and visualization&amp;nbsp;was based&amp;nbsp;on several principles manifested in those&amp;nbsp;guidelines and&amp;nbsp;pertained to the type of functionality an&amp;nbsp;IK&amp;nbsp;avatar&amp;nbsp;skeleton&amp;nbsp;should have in&amp;nbsp;the&amp;nbsp;project&amp;rsquo;s&amp;nbsp;context.&amp;nbsp;&amp;nbsp;&lt;/p&gt;

&lt;p&gt;For the avatar skeletons creation stage to be executed properly, there was first the need to&amp;nbsp;analyse&amp;nbsp;the motion capture sequences from the perspectives of:&amp;nbsp;&lt;/p&gt;

	&lt;p&gt;Global scale deviations between&amp;nbsp;performers&amp;nbsp;&lt;/p&gt;
	&lt;p&gt;Range of motions rotational scope per performer&amp;nbsp;&lt;/p&gt;
	&lt;p&gt;Unified mean deviation across all performers&amp;nbsp;&lt;/p&gt;

&lt;p&gt;Once this stage was complete, the data was used to determine the dimensions and internal scale of an empiric unified avatar skeleton that would fit the scaling of all the performers that were captured for the project.&amp;nbsp;&amp;nbsp;&amp;nbsp;&amp;nbsp;&lt;/p&gt;

&lt;p&gt;The stages of the skeleton creation pipeline involved 3D&amp;nbsp;modelling&amp;nbsp;of skeletal hierarchies, setting up correct biomechanical human limits rotations constraints for the skeleton and coding of transformation parameters so that motion capture data could be propagated correctly into the avatar skeletons.&amp;nbsp;&amp;nbsp;Furthermore, work was carried out in enabling the use of 3D geometry on top of the avatar skeletons,&amp;nbsp;whether&amp;nbsp;in a form of parent-child relation&amp;nbsp;(2), or as a flexible envelope&amp;nbsp;(3)&amp;nbsp;&lt;/p&gt;

&lt;p&gt;This&amp;nbsp;deliverable describes&amp;nbsp;the&amp;nbsp;processes of&amp;nbsp;creation and implementation of inverse kinematic skeletons for the avatars&amp;nbsp;modelled&amp;nbsp;in T2.4, next to the creation of materials, textures, lighting setup and&amp;nbsp;shaders&amp;nbsp;for the models. This&amp;nbsp;deliverable&amp;nbsp;also includes preliminary&amp;nbsp;results of&amp;nbsp;real-time testing of those assets.&amp;nbsp;&lt;/p&gt;

&lt;p&gt;In the upcoming WP6, the data will also undergo a stage of 3D modelling optimizations of avatar for volumetric / holographic projection and optimization for alternative projection methods and systems. The last part of this task involves the skeleton&amp;nbsp;fitting&amp;nbsp;(retargeting to fit the anatomy and morphology of the 3D avatars with the human performers that&amp;nbsp;will be captured in the future), optimization of the inverse kinematic skeleton, and, finally, optimization of materials, textures, lighting setup and&amp;nbsp;shaders&amp;nbsp;for real-time interactive display.&amp;nbsp;&lt;/p&gt;

&lt;p&gt;(1):&amp;nbsp;Inverse kinematics is the&amp;nbsp;Mathematical&amp;nbsp;process of recovering the movements of an object in the world from some other data, such as a film of those movements, or a film of the world as seen by a camera which is itself making those movements. This is useful in robotics and in film animation. In robotics, inverse kinematics makes use of the kinematics equations to determine the joint parameters that provide the desired position for each of the robot&amp;#39;s end-effectors. Specification of the movement of a robot so that its end-effectors achieve the desired tasks is known as motion planning. Inverse kinematics transforms the motion plan into joint actuator trajectories for the robot. Similar formulae determine the positions of the skeleton of an animated character that is to move in a particular way in a film, or of a vehicle such as a car or boat containing the camera which is shooting a scene of a film. Once a vehicle&amp;#39;s motions are known, they can be used to determine the constantly-changing viewpoint for computer-generated imagery of objects in the landscape such as buildings, so that these objects change in perspective while not themselves appearing to move as the vehicle-borne camera goes past them. The movement of a kinematic chain, whether it is a robot or an animated character is&amp;nbsp;modelled&amp;nbsp;by the kinematics equations of the chain. These equations define the configuration of the chain in terms of its joint parameters. Forward kinematics uses the joint parameters to compute the configuration of the chain, and inverse kinematics reverses this calculation to determine the joint parameters that achieve the desired configuration.&lt;/p&gt;

&lt;p&gt;&amp;nbsp;(2):&amp;nbsp;Parent-child relational&amp;nbsp;modelling In the world of 3D, users are able to organize their scenes by creating a hierarchy. The hierarchy is created through the process of parenting objects to one another from inside the program. When an object becomes a Child of another object (Parent), it will follow all transformations applied to the Parent. This is useful in the case where a character or 3D object has multiple parts and needs to move around in the scene. That way you only need to animate the Parent model and the Child objects will follow automatically.&amp;nbsp;&lt;/p&gt;

&lt;p&gt;&amp;nbsp;(3):&amp;nbsp;Flexible envelope&amp;nbsp;Avatars can be enveloped (skinned) to a skeletal rig. The skeletal rig is then animated with keyframes, or in the case of&amp;nbsp;Wholodance, driven by motion capture data. This animation in turn, deforms the envelope.&amp;nbsp;&amp;nbsp;&lt;/p&gt;</description>
      <funderName>European Commission</funderName>
      <funderIdentifier funderIdentifierType="Crossref Funder ID">10.13039/501100000780</funderIdentifier>
      <awardNumber awardURI="info:eu-repo/grantAgreement/EC/H2020/688865/">688865</awardNumber>
      <awardTitle>Whole-Body Interaction Learning for Dance Education</awardTitle>
All versions This version
Views 3939
Downloads 1818
Data volume 22.6 MB22.6 MB
Unique views 3838
Unique downloads 1818


Cite as