Journal article Open Access

Dopamine: Generalization and bonuses

Kakade, Sham; Dayan, Peter


JSON Export

{
  "files": [
    {
      "links": {
        "self": "https://zenodo.org/api/files/958f449e-a4b0-43ca-8fa2-ad9b98bd1861/article.pdf"
      }, 
      "checksum": "md5:847828d03b945caf08dfee2d7d8a80fa", 
      "bucket": "958f449e-a4b0-43ca-8fa2-ad9b98bd1861", 
      "key": "article.pdf", 
      "type": "pdf", 
      "size": 402468
    }
  ], 
  "owners": [
    13380
  ], 
  "doi": "10.1016/s0893-6080(02)00048-5", 
  "stats": {
    "version_unique_downloads": 102.0, 
    "unique_views": 345.0, 
    "views": 359.0, 
    "version_views": 359.0, 
    "unique_downloads": 102.0, 
    "version_unique_views": 345.0, 
    "volume": 42661608.0, 
    "version_downloads": 106.0, 
    "downloads": 106.0, 
    "version_volume": 42661608.0
  }, 
  "links": {
    "doi": "https://doi.org/10.1016/s0893-6080(02)00048-5", 
    "latest_html": "https://zenodo.org/record/890565", 
    "bucket": "https://zenodo.org/api/files/958f449e-a4b0-43ca-8fa2-ad9b98bd1861", 
    "badge": "https://zenodo.org/badge/doi/10.1016/s0893-6080%2802%2900048-5.svg", 
    "html": "https://zenodo.org/record/890565", 
    "latest": "https://zenodo.org/api/records/890565"
  }, 
  "created": "2017-09-13T09:39:06.683405+00:00", 
  "updated": "2020-01-20T15:33:44.458466+00:00", 
  "conceptrecid": "890564", 
  "revision": 6, 
  "id": 890565, 
  "metadata": {
    "access_right_category": "success", 
    "doi": "10.1016/s0893-6080(02)00048-5", 
    "description": "In the temporal difference model of primate dopamine neurons, their phasic activity reports a prediction error for future reward. This model is supported by a wealth of experimental data. However, in certain circumstances, the activity of the dopamine cells seems anomalous under the model, as they respond in particular ways to stimuli that are not obviously related to predictions of reward. In this paper, we address two important sets of anomalies, those having to do with generalization and novelty. Generalization responses are treated as the natural consequence of partial information; novelty responses are treated by the suggestion that dopamine cells multiplex information about reward bonuses, including exploration bonuses and shaping bonuses. We interpret this additional role for dopamine in terms of the mechanistic attentional and psychomotor effects of dopamine, having the computational role of guiding exploration.", 
    "license": {
      "id": "other-open"
    }, 
    "title": "Dopamine: Generalization and bonuses", 
    "relations": {
      "version": [
        {
          "count": 1, 
          "index": 0, 
          "parent": {
            "pid_type": "recid", 
            "pid_value": "890564"
          }, 
          "is_last": true, 
          "last_child": {
            "pid_type": "recid", 
            "pid_value": "890565"
          }
        }
      ]
    }, 
    "publication_date": "2002-06-01", 
    "creators": [
      {
        "name": "Kakade, Sham"
      }, 
      {
        "name": "Dayan, Peter"
      }
    ], 
    "access_right": "open", 
    "resource_type": {
      "subtype": "article", 
      "type": "publication", 
      "title": "Journal article"
    }
  }
}
359
106
views
downloads
Views 359
Downloads 106
Data volume 42.7 MB
Unique views 345
Unique downloads 102

Share

Cite as