There is a newer version of this record available.

Software Open Access

Game of Threads: Enabling Asynchronous Poisoning Attacks

Jose Rodrigo Sanchez Vicarte; Benjamin Schreiber; Riccardo Paccagnella; Christopher W. Fletcher


JSON Export

{
  "files": [
    {
      "links": {
        "self": "https://zenodo.org/api/files/eeb91a79-2394-46b8-86e0-1b3a66317522/game_of_threads.tar.bz2"
      }, 
      "checksum": "md5:23a7bee7b5fc63295581a3dfeac75d4f", 
      "bucket": "eeb91a79-2394-46b8-86e0-1b3a66317522", 
      "key": "game_of_threads.tar.bz2", 
      "type": "bz2", 
      "size": 61832172
    }
  ], 
  "owners": [
    87162
  ], 
  "doi": "10.5281/zenodo.3598009", 
  "stats": {
    "version_unique_downloads": 41.0, 
    "unique_views": 140.0, 
    "views": 147.0, 
    "version_views": 387.0, 
    "unique_downloads": 13.0, 
    "version_unique_views": 338.0, 
    "volume": 803818236.0, 
    "version_downloads": 43.0, 
    "downloads": 13.0, 
    "version_volume": 991157312.0
  }, 
  "links": {
    "doi": "https://doi.org/10.5281/zenodo.3598009", 
    "conceptdoi": "https://doi.org/10.5281/zenodo.3598008", 
    "bucket": "https://zenodo.org/api/files/eeb91a79-2394-46b8-86e0-1b3a66317522", 
    "conceptbadge": "https://zenodo.org/badge/doi/10.5281/zenodo.3598008.svg", 
    "html": "https://zenodo.org/record/3598009", 
    "latest_html": "https://zenodo.org/record/3628042", 
    "badge": "https://zenodo.org/badge/doi/10.5281/zenodo.3598009.svg", 
    "latest": "https://zenodo.org/api/records/3628042"
  }, 
  "conceptdoi": "10.5281/zenodo.3598008", 
  "created": "2020-01-05T16:48:37.890604+00:00", 
  "updated": "2020-01-26T23:13:05.793496+00:00", 
  "conceptrecid": "3598008", 
  "revision": 7, 
  "id": 3598009, 
  "metadata": {
    "access_right_category": "success", 
    "doi": "10.5281/zenodo.3598009", 
    "description": "<p>As machine learning models continue to grow in size andcomplexity, training is being forced to adopt asynchronicity toavoid scalability bottlenecks. In asynchronous training, manythreads share and update the model in a racy fashion to avoidinter-thread synchronization.This paper studies the security implications of asynchronoustraining codes by introducingasynchronous poisoning attacks.Our attack influences training outcome&mdash;e.g., degrades ac-curacy or biases the model towards an adversary-specifiedlabel&mdash;purely by scheduling asynchronous training threads ina malicious fashion. Since thread scheduling is outside theprotections of modern trusted execution environments (TEEs),e.g., Intel SGX, our attack bypasses these protections evenwhen the training set can be verified as correct. To the bestof our knowledge, this represents the first example where aclass of applications loses integrity guarantees, despite beingprotected by enclave-based TEEs such as Intel SGX.We demonstrate both accuracy degradation and model bi-asing attacks on the CIFAR-10 image recognition task usingLeNet-style and Resnet DNNs, attacking an asynchronoustraining implementation published by Pytorch. Our accuracydegradation attack is trivial to perform and can decreasemodel accuracy by 6-60% with a single malicious update. Ourmodel biasing attack is capable of biasing the model towardsan adversary-chosen label by up to3.5&times;the label&rsquo;s normalprediction rate on a LeNet-style network and up to2&times;onResNet-18.</p>", 
    "language": "eng", 
    "title": "Game of Threads: Enabling Asynchronous Poisoning Attacks", 
    "license": {
      "id": "CC-BY-4.0"
    }, 
    "relations": {
      "version": [
        {
          "count": 5, 
          "index": 0, 
          "parent": {
            "pid_type": "recid", 
            "pid_value": "3598008"
          }, 
          "is_last": false, 
          "last_child": {
            "pid_type": "recid", 
            "pid_value": "3628042"
          }
        }
      ]
    }, 
    "keywords": [
      "machine learning, poisoning attacks, SGX, adversarial machine learning"
    ], 
    "publication_date": "2020-01-05", 
    "creators": [
      {
        "affiliation": "University of Illinois, Urbana Champaign", 
        "name": "Jose Rodrigo Sanchez Vicarte"
      }, 
      {
        "affiliation": "University of Illinois, Urbana Champaign", 
        "name": "Benjamin Schreiber"
      }, 
      {
        "affiliation": "University of Illinois, Urbana Champaign", 
        "name": "Riccardo Paccagnella"
      }, 
      {
        "affiliation": "University of Illinois, Urbana Champaign", 
        "name": "Christopher W. Fletcher"
      }
    ], 
    "meeting": {
      "acronym": "ASPLOS", 
      "dates": "March 16-20, 2020", 
      "place": "Lousanne"
    }, 
    "access_right": "open", 
    "resource_type": {
      "type": "software", 
      "title": "Software"
    }, 
    "related_identifiers": [
      {
        "scheme": "doi", 
        "identifier": "10.5281/zenodo.3598008", 
        "relation": "isVersionOf"
      }
    ]
  }
}
387
43
views
downloads
All versions This version
Views 387147
Downloads 4313
Data volume 991.2 MB803.8 MB
Unique views 338140
Unique downloads 4113

Share

Cite as