Conference paper Open Access

Deep Spatio-Temporal Modeling for Object-Level Gaze-Based Relevance Assessment

Stavridis, Konstantinos; Psaltis, Athanasios; Dimou, Anastasios; Papadopoulos, Georgios Th.; Daras, Petros


JSON Export

{
  "files": [
    {
      "links": {
        "self": "https://zenodo.org/api/files/fffea9da-d4d8-442d-8fcc-6c7171ab69f7/Deep%20Spatio-Temporal%20Modeling%20for%20Object-Level%20Gaze-Based%20Relevance%20Assessment%20.pdf"
      }, 
      "checksum": "md5:07e86d309910b5b27d6c316231b0f9b4", 
      "bucket": "fffea9da-d4d8-442d-8fcc-6c7171ab69f7", 
      "key": "Deep Spatio-Temporal Modeling for Object-Level Gaze-Based Relevance Assessment .pdf", 
      "type": "pdf", 
      "size": 1003747
    }
  ], 
  "owners": [
    19291
  ], 
  "doi": "10.23919/EUSIPCO.2019.8902990", 
  "stats": {
    "version_unique_downloads": 13.0, 
    "unique_views": 26.0, 
    "views": 29.0, 
    "version_views": 29.0, 
    "unique_downloads": 13.0, 
    "version_unique_views": 26.0, 
    "volume": 13048711.0, 
    "version_downloads": 13.0, 
    "downloads": 13.0, 
    "version_volume": 13048711.0
  }, 
  "links": {
    "doi": "https://doi.org/10.23919/EUSIPCO.2019.8902990", 
    "latest_html": "https://zenodo.org/record/3560515", 
    "bucket": "https://zenodo.org/api/files/fffea9da-d4d8-442d-8fcc-6c7171ab69f7", 
    "badge": "https://zenodo.org/badge/doi/10.23919/EUSIPCO.2019.8902990.svg", 
    "html": "https://zenodo.org/record/3560515", 
    "latest": "https://zenodo.org/api/records/3560515"
  }, 
  "created": "2019-12-11T08:15:15.431330+00:00", 
  "updated": "2020-05-18T08:20:25.453871+00:00", 
  "conceptrecid": "3560514", 
  "revision": 3, 
  "id": 3560515, 
  "metadata": {
    "access_right_category": "success", 
    "embargo_date": "2020-05-18", 
    "doi": "10.23919/EUSIPCO.2019.8902990", 
    "description": "<p>The current work investigates the problem of objectlevel relevance assessment prediction, taking into account the user&rsquo;s captured gaze signal (behaviour) and following the Deep Learning (DL) paradigm. Human gaze, as a sub-conscious response, is influenced from several factors related to the human mental activity. Several studies have so far proposed methodologies based on the use of gaze statistical modeling and naive classifiers for assessing images or image patches as relevant or not to the user&rsquo;s interests. Nevertheless, the outstanding majority of literature approaches only relied so far on the use of handcrafted features and relative simple classification schemes. On the contrary, the current work focuses on the use of DL schemes that will enable the modeling of complex patterns in the captured gaze signal and the subsequent derivation of corresponding discriminant features. Novel contributions of this study include: a) the introduction of a large-scale annotated gaze dataset, suitable for training DL models, b) a novel method for gaze modeling, capable of handling gaze sensor errors, and c) a DL based method, able to capture gaze patterns for assessing image objects as relevant or non-relevant, with respect to the user&rsquo;s preferences. Extensive experiments demonstrate the efficiency of the proposed method, taking also into consideration key factors related to the human gaze behaviour.</p>", 
    "license": {
      "id": "CC-BY-4.0"
    }, 
    "title": "Deep Spatio-Temporal Modeling for Object-Level Gaze-Based Relevance Assessment", 
    "relations": {
      "version": [
        {
          "count": 1, 
          "index": 0, 
          "parent": {
            "pid_type": "recid", 
            "pid_value": "3560514"
          }, 
          "is_last": true, 
          "last_child": {
            "pid_type": "recid", 
            "pid_value": "3560515"
          }
        }
      ]
    }, 
    "grants": [
      {
        "code": "787061", 
        "links": {
          "self": "https://zenodo.org/api/grants/10.13039/501100000780::787061"
        }, 
        "title": "Advanced tools for fighting oNline Illegal TrAfficking", 
        "acronym": "ANITA", 
        "program": "H2020", 
        "funder": {
          "doi": "10.13039/501100000780", 
          "acronyms": [], 
          "name": "European Commission", 
          "links": {
            "self": "https://zenodo.org/api/funders/10.13039/501100000780"
          }
        }
      }
    ], 
    "keywords": [
      "Gaze modeling", 
      "Deep learning", 
      "Relevance assessment"
    ], 
    "publication_date": "2019-11-18", 
    "creators": [
      {
        "affiliation": "CERTH", 
        "name": "Stavridis, Konstantinos"
      }, 
      {
        "affiliation": "CERTH", 
        "name": "Psaltis, Athanasios"
      }, 
      {
        "affiliation": "CERTH", 
        "name": "Dimou, Anastasios"
      }, 
      {
        "affiliation": "CERTH", 
        "name": "Papadopoulos, Georgios Th."
      }, 
      {
        "name": "Daras, Petros"
      }
    ], 
    "meeting": {
      "acronym": "EUSIPCO", 
      "dates": "2-6 September 2019", 
      "place": "A Coruna, Spain", 
      "title": "2019 27th European Signal Processing Conference"
    }, 
    "access_right": "open", 
    "resource_type": {
      "subtype": "conferencepaper", 
      "type": "publication", 
      "title": "Conference paper"
    }
  }
}
29
13
views
downloads
Views 29
Downloads 13
Data volume 13.0 MB
Unique views 26
Unique downloads 13

Share

Cite as