Conference paper Open Access

Optimizing QoE and Cost in a 3D Immersive Media Platform: A Reinforcement Learning Approach

Panagiotis Athanasoulis; Emmanouil Christakis; Konstantinos Konstantoudakis; Petros Drakoulis; Stamatia Rizou; Avi Weit; Alexandros Doumanoglou; Nikolaos Zioulis; Dimitrios Zarpalas


JSON-LD (schema.org) Export

{
  "inLanguage": {
    "alternateName": "eng", 
    "@type": "Language", 
    "name": "English"
  }, 
  "description": "<p>Recent advances in media-related technologies, including&nbsp;capturing and processing, have facilitated novel forms&nbsp;of 3D media content, increasing the degree of user immersion.&nbsp;In order to ensure these technologies can readily support the&nbsp;rising demand for more captivating entertainment, both the&nbsp;production and delivery mechanisms should be transformed to&nbsp;support the application of media or network-related optimizations&nbsp;and refinements on-the-fly. Network peculiarities deriving&nbsp;from geographic and other factors make it difficult for a greedy&nbsp;or a supervised machine learning algorithm to successfully foresee&nbsp;the need for reconfiguration of the content production or delivery&nbsp;procedures. For these reasons, Reinforcement Learning (RL)&nbsp;approaches have lately gained popularity as partial information&nbsp;on the environment is enough for an algorithm to begin its&nbsp;training and converge to an optimal policy. The contribution&nbsp;of this work is a Cognitive Network Optimizer (CNO) in the&nbsp;form of an RL agent, designed to perform corrective actions on&nbsp;both the production and consumption ends of an immersive 3D&nbsp;media platform, depending on a collection of real-time monitoring&nbsp;parameters, including infrastructure, application-level and quality&nbsp;of experience (QoE) metrics. Our work demonstrates CNO&nbsp;approaches with different foci, i.e., a greedy maximization of&nbsp;the users&rsquo; QoE, a QoE-focused RL approach and a combined&nbsp;QoE-and-Cost RL approach.</p>", 
  "license": "https://creativecommons.org/licenses/by/4.0/legalcode", 
  "creator": [
    {
      "affiliation": "Singular Logic S.A., Athens, Greece", 
      "@type": "Person", 
      "name": "Panagiotis Athanasoulis"
    }, 
    {
      "affiliation": "Visual Computing Lab (VCL), Information Technologies Institute (ITI), Centre for Research and Technology - Hellas (CERTH), Thessaloniki, Greece", 
      "@type": "Person", 
      "name": "Emmanouil Christakis"
    }, 
    {
      "affiliation": "Visual Computing Lab (VCL), Information Technologies Institute (ITI), Centre for Research and Technology - Hellas (CERTH), Thessaloniki, Greece", 
      "@id": "https://orcid.org/0000-0001-5092-8796", 
      "@type": "Person", 
      "name": "Konstantinos Konstantoudakis"
    }, 
    {
      "affiliation": "Visual Computing Lab (VCL), Information Technologies Institute (ITI), Centre for Research and Technology - Hellas (CERTH), Thessaloniki, Greece", 
      "@id": "https://orcid.org/0000-0003-3434-3290", 
      "@type": "Person", 
      "name": "Petros Drakoulis"
    }, 
    {
      "affiliation": "Singular Logic S.A., Athens, Greece", 
      "@type": "Person", 
      "name": "Stamatia Rizou"
    }, 
    {
      "affiliation": "IBM Research, Haifa, Israel", 
      "@type": "Person", 
      "name": "Avi Weit"
    }, 
    {
      "affiliation": "Visual Computing Lab (VCL), Information Technologies Institute (ITI), Centre for Research and Technology - Hellas (CERTH), Thessaloniki, Greece", 
      "@id": "https://orcid.org/0000-0002-4337-1720", 
      "@type": "Person", 
      "name": "Alexandros Doumanoglou"
    }, 
    {
      "affiliation": "Visual Computing Lab (VCL), Information Technologies Institute (ITI), Centre for Research and Technology - Hellas (CERTH), Thessaloniki, Greece", 
      "@id": "https://orcid.org/0000-0002-7898-9344", 
      "@type": "Person", 
      "name": "Nikolaos Zioulis"
    }, 
    {
      "affiliation": "Visual Computing Lab (VCL), Information Technologies Institute (ITI), Centre for Research and Technology - Hellas (CERTH), Thessaloniki, Greece", 
      "@type": "Person", 
      "name": "Dimitrios Zarpalas"
    }
  ], 
  "headline": "Optimizing QoE and Cost in a 3D Immersive Media Platform: A Reinforcement Learning Approach", 
  "image": "https://zenodo.org/static/img/logos/zenodo-gradient-round.svg", 
  "datePublished": "2020-04-22", 
  "url": "https://zenodo.org/record/3761854", 
  "version": "1", 
  "keywords": [
    "immersive media", 
    "cognitive network optimizer", 
    "reinforcement learning", 
    "5g", 
    "5g media"
  ], 
  "@context": "https://schema.org/", 
  "identifier": "https://doi.org/10.5281/zenodo.3761854", 
  "@id": "https://doi.org/10.5281/zenodo.3761854", 
  "@type": "ScholarlyArticle", 
  "name": "Optimizing QoE and Cost in a 3D Immersive Media Platform: A Reinforcement Learning Approach"
}
74
50
views
downloads
All versions This version
Views 7474
Downloads 5050
Data volume 39.1 MB39.1 MB
Unique views 6363
Unique downloads 4444

Share

Cite as