Published January 16, 2021 | Version v1
Software Open

Reducing DNN Properties to Enable Falsification with Adversarial Attacks

  • 1. University of Virginia

Description

This artifact accompanies the paper Reducing DNN Properties to Enable Falsification with Adversarial Attacks.
In this artifact, we provide the benchmarks and scripts for reproducing the results of our study,
and we also provide our tool, DNNF for running falsification methods such as adversarial attacks on DNN property specifications specified using the DNNP language of DNNV.

While many DNN verification techniques have been introduced in the past few years to enable the checking of DNN safety properties, these techniques are often limited in their applicability, due to simplifying assumptions about DNN structure or to high computational cost.
Falsification is a complementary approach to verification that seeks only to find violations to a safety property.
In the context of DNNs, adversarial attacks can be viewed as falsifiers for DNN local robustness properties.
While these techniques often scale to large real-world DNNs, they are currently limited in the range of properties they can falsify.

In Reducing DNN Properties to Enable Falsification with Adversarial Attacks, we introduce an approach for reducing a DNN and an associated safety property -- a correctness problem -- into an equivalid set of correctness problems formulated with robustness properties which can be processed by existing adversarial attack techniques.
We implement the approach in a tool which we call DNNF, and we perform a study demonstrating that property reduction yields a cost-effective approach to find violations of DNN correctness problems.

Files

INSTALL.pdf

Files (8.8 GB)

Name Size Download all
md5:bd6cf7ac89d1b54e230c843e4ae1494b
8.8 GB Download
md5:66c25b6346dcda5ef2a5e6de202beb3a
112.2 kB Preview Download
md5:1c205bb4c7ab0430bb0239b0a79efdc7
2.9 kB Download
md5:501af9383f4f1e79619333ad67877802
1.1 kB Download
md5:fe0bc943b8a205ae2ef91285d3431023
144.0 kB Preview Download
md5:fe7657f366f0193c4feec7fa3b002a00
8.3 kB Download
md5:16b42c4f24ef665cb98c4d34996616fd
83.6 kB Preview Download
md5:4234a219094cb4b4314e3dd423409018
1.6 kB Download