Published September 23, 2023 | Version 0.1.0
Software Open

Replication package for the EMSE paper "Generating and Detecting True Ambiguity: A Forgotten Danger in DNN Supervision Testing"

  • 1. Università della Svizzera italiana

Description

Replication package for the EMSE paper (accepted, forthcoming) "Generating and Detecting True Ambiguity: A Forgotten Danger in DNN Supervision Testing"

 

Note: 

  • A preprint of the paper is available on arXiv: https://arxiv.org/abs/2207.10495
  • The datasets created as part of this paper are available on huggingface dataset and github. See https://github.com/testingautomated-usi/ambguess-src#access-to-precompiled-datasets
  • The source files are also hosted on github (https://github.com/testingautomated-usi/ambguess-src). They are uploaded here on zenodo for archival purposes and as the 'artifacts' folder (which is not strictly needed to run our code) is too large to be shared on github.
  • The readme for this replication package can be found in the zip folder: code_and_datasets.7z

Files

Files (49.4 GB)

Name Size Download all
md5:531c318348145771c0cce43200a91f20
49.4 GB Download
md5:8bd68a1562071e36f376830d640f2a65
7.6 MB Download

Additional details

Related works

Is supplement to
Journal article: 10.1007/s10664-023-10393-w (DOI)

Funding

European Commission
PRECRIME – Self-assessment Oracles for Anticipatory Testing 787703