Journal article Embargoed Access

A Deep Generic to Specific Recognition Model for Group Membership Analysis using Non-verbal Cues

Mou, Wenxuan; Tzelepis, Christos; Mezaris, Vasileios; Gunes, Hatice; Patras, Ioannis


MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nam##2200000uu#4500</leader>
  <datafield tag="942" ind1=" " ind2=" ">
    <subfield code="a">2019-10-03</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">Non-verbal behavior analysis, Group membership, Automatic group analysis, Deep learning</subfield>
  </datafield>
  <controlfield tag="005">20190409142216.0</controlfield>
  <controlfield tag="001">1464113</controlfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Information Technologies Institute/Centre for Research and Technology Hellas (CERTH), Greece</subfield>
    <subfield code="a">Tzelepis, Christos</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Information Technologies Institute/Centre for Research and Technology Hellas (CERTH), Greece</subfield>
    <subfield code="a">Mezaris, Vasileios</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Cambridge, UK</subfield>
    <subfield code="a">Gunes, Hatice</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">Queen Mary University of London, UK</subfield>
    <subfield code="a">Patras, Ioannis</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">embargoed</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2018-10-03</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">user-moving-h2020</subfield>
    <subfield code="o">oai:zenodo.org:1464113</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="4">
    <subfield code="p">Image and Vision Computing</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">Queen Mary University of London, UK</subfield>
    <subfield code="a">Mou, Wenxuan</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">A Deep Generic to Specific Recognition Model for Group Membership Analysis using Non-verbal Cues</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-moving-h2020</subfield>
  </datafield>
  <datafield tag="536" ind1=" " ind2=" ">
    <subfield code="c">693092</subfield>
    <subfield code="a">Training towards a society of data-savvy information professionals to enable open leadership innovation</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u">http://creativecommons.org/licenses/by-nc-nd/4.0/legalcode</subfield>
    <subfield code="a">Creative Commons Attribution Non Commercial No Derivatives 4.0 International</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;Automatic understanding and analysis of groups has attracted increasing attention in the vision and multimedia communities in recent years. However, little attention has been paid to the automatic analysis of the non-verbal behaviors and how this can be utilized for analysis of group membership, i.e., recognizing which group each individual is part of. This paper presents a novel Support Vector Machine (SVM) based Deep &lt;em&gt;Specific Recognition Model (DeepSRM)&lt;/em&gt; that is learned based on a &lt;em&gt;generic recognition model&lt;/em&gt;. The &lt;em&gt;generic recognition model&lt;/em&gt; refers to the model trained with data across different conditions, i.e., when people are watching movies of different types. Although the &lt;em&gt;generic recognition model&lt;/em&gt; can provide a baseline for the recognition model trained for each specific condition, the different behaviors people exhibit in different conditions limit the recognition performance of the generic model. Therefore, the &lt;em&gt;specific recognition model&lt;/em&gt; is proposed for each condition separately and built on top of the &lt;em&gt;generic recognition model&lt;/em&gt;. A number of experiments are conducted using a database aiming to study group analysis while each group (i.e., four participants together) were watching a number of long movie segments. Our experimental results show that the proposed &lt;em&gt;deep specific recognition model&lt;/em&gt; (44%) outperforms the &lt;em&gt;generic recognition model&lt;/em&gt; (26%). The recognition of group membership also indicates that the non-verbal behaviors of individuals within a group share commonalities.&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.1016/j.imavis.2018.09.005</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">publication</subfield>
    <subfield code="b">article</subfield>
  </datafield>
</record>
33
3
views
downloads
Views 33
Downloads 3
Data volume 8.0 MB
Unique views 28
Unique downloads 1

Share

Cite as