Software Open Access

Reducing DNN Properties to Enable Falsification with Adversarial Attacks

Shriver, David; Elbaum, Sebastian; Dwyer, Matthew

This artifact accompanies the paper Reducing DNN Properties to Enable Falsification with Adversarial Attacks.
In this artifact, we provide the benchmarks and scripts for reproducing the results of our study,
and we also provide our tool, DNNF for running falsification methods such as adversarial attacks on DNN property specifications specified using the DNNP language of DNNV.

While many DNN verification techniques have been introduced in the past few years to enable the checking of DNN safety properties, these techniques are often limited in their applicability, due to simplifying assumptions about DNN structure or to high computational cost.
Falsification is a complementary approach to verification that seeks only to find violations to a safety property.
In the context of DNNs, adversarial attacks can be viewed as falsifiers for DNN local robustness properties.
While these techniques often scale to large real-world DNNs, they are currently limited in the range of properties they can falsify.

In Reducing DNN Properties to Enable Falsification with Adversarial Attacks, we introduce an approach for reducing a DNN and an associated safety property -- a correctness problem -- into an equivalid set of correctness problems formulated with robustness properties which can be processed by existing adversarial attack techniques.
We implement the approach in a tool which we call DNNF, and we perform a study demonstrating that property reduction yields a cost-effective approach to find violations of DNN correctness problems.

Files (8.8 GB)
Name Size
DNNF.ova
md5:bd6cf7ac89d1b54e230c843e4ae1494b
8.8 GB Download
INSTALL.pdf
md5:66c25b6346dcda5ef2a5e6de202beb3a
112.2 kB Download
INSTALL.rst
md5:1c205bb4c7ab0430bb0239b0a79efdc7
2.9 kB Download
LICENSE
md5:501af9383f4f1e79619333ad67877802
1.1 kB Download
README.pdf
md5:fe0bc943b8a205ae2ef91285d3431023
144.0 kB Download
README.rst
md5:fe7657f366f0193c4feec7fa3b002a00
8.3 kB Download
REQUIREMENTS.pdf
md5:16b42c4f24ef665cb98c4d34996616fd
83.6 kB Download
REQUIREMENTS.rst
md5:4234a219094cb4b4314e3dd423409018
1.6 kB Download
80
148
views
downloads
All versions This version
Views 8080
Downloads 148148
Data volume 79.6 GB79.6 GB
Unique views 7676
Unique downloads 103103

Share

Cite as