Conference paper Open Access

Pairwise Ranking Network for Affect Recognition

Georgios Zoumpourlis; Ioannis Patras

In this work we study the problem of emotion recognition under the prism of preference learning. Affective datasets are typically annotated by assigning a single absolute label, i.e. a numerical value that describes the intensity of an emotional attribute, to each sample. Then, the majority of existing works on affect recognition employ sample-wise classification/regression methods to predict affective states, using those annotations. We take a different approach and use a deep network architecture that performs joint training on the tasks of classification/regression of samples and ordinal ranking between pairs of samples. By treating input samples in a pairwise manner, we leverage the auxiliary task of inferring the ordinal relation between their corresponding affective states. Incorporating the ranking objective allows capturing the inherently ordinal structure of emotions and learning the inter-sample relations, resulting in better generalization. Our method is incorporated into existing affect recognition architectures and evaluated on datasets of electroencephalograms (EEG) and images. We show that the approach proposed in this work leads to consistent performance gains when incorporated in classification/regression networks.

Files (314.6 kB)
Name Size
Pairwise_Ranking_Network_for_Affect_Recognition.pdf
md5:585b8cb9abb9a5dd742a41a49e3ea33f
314.6 kB Download
34
24
views
downloads
All versions This version
Views 3434
Downloads 2424
Data volume 7.5 MB7.5 MB
Unique views 2828
Unique downloads 2121

Share

Cite as